Affective prosody is an indispensable cognitive cue that moderates social activities, and has become a prevailing research topic in psychology-related disciplines. The present study conducts the first bibliometrics-based visualization analysis concerning affective prosody to evaluate the influential cases, including countries/regions, institutions, publication venues, academic articles, and disciplinary contributions, and the diachronic changes of publication trends and research hotspots. With the combination of statistical results and a qualitative literature inspection, limitations of extant studies and promising research directions were also proposed. The present study extracted the bibliographic data of 1,624 articles retrieved from the Web of Science Core Collection, which were published over the past 25 years (1997-2021). Statistical results revealed four leading powers (the U.S., Germany, England, and Canada) and four emerging fronts (China, France, Netherlands, and Switzerland), and identified three primary research themes in this field, including clinical implication, measurable index, and modality-specific issues. Literature inspection demonstrated current limitations in individual characteristics control and experiment-related influential factors, and proposed two prosperous research directions. Findings of the present study could facilitate academic retrieval of affective prosody research, help concerned researchers identify thematic hotspots and seek appropriate collaboration, and provide convenience for research policy and management in this field.

Virtual reality (VR) technology gains theoretical support from rehabilitation and pedagogical theories and offers a variety of capabilities in educational and interventional contexts with affordable products. VR is attracting increasing attention in the medical and healthcare industry as it provides fully interactive three-dimensional simulations of real-world settings and social situations, which are particularly suitable for cognitive and performance training including social and interaction skills. The worldwide rising trend in the prevalence of autism spectrum disorder calls for innovative and efficacious techniques for assessment and treatment. The article offers a summary of current perspectives and evidence-based applications of VR technology as an educational and intervention tool for individuals with autism spectrum disorder, with a primary focus on social communication including social functioning, emotion recognition, and speech and language. Technology- and design-related limitations as well as the disputes over the application of virtual reality to autism research and therapy are discussed and future directions of this emerging field are highlighted with regards to application expansion and improvement, technology enhancement, and the development of brain-based research and theoretical models.

As artificial intelligence takes an increasingly prominent role in healthcare, a growing body of research is being dedicated to its application in the investigation of communication sciences and disorders (CSD). This study conducts a bibliometric analysis of AI-based research in the field of CSD published up to December 2023. Utilizing the Web of Science and Scopus databases, we identified 15,035 publications, with 4,375 meeting our inclusion criteria. From 1985 onwards, there has been a consistent annual increase in publications, averaging at 16.51%, notably surging from 2012 to 2023. The primary communication disorders studied include autism, dysarthria, dementia, Parkinson’s, and aphasia. Noteworthy AI techniques employed in CSD research encompass machine learning, automatic speech recognition, support vector machine, and deep learning. Our analysis provides a comprehensive overview, serving as a valuable resource for researchers, developers, and professionals seeking to comprehend the evolving landscape of AI in CSD research. Moving forward, collaborative efforts need to prioritize addressing ethical concerns, ensuring data privacy, enhancing methodological enhancements, and considering ecological validity in the application of AI in studies related to communication disorders.

Objectives: Although pitch reception poses a great challenge for individuals with cochlear implants (CIs), formal auditory training (e.g., high variability phonetic training, HVPT) has been shown to provide direct benefits in pitch-related perceptual performances such as lexical tone recognition for CI users. As lexical tones in spoken language are expressed with a multitude of distinct spectral, temporal, and intensity cues, it is important to determine the sources of training benefits for CI users. The purpose of the present study was to conduct a rigorous fine-scale evaluation with the categorical perception (CP) paradigm to control the acoustic parameters and test the efficacy and sustainability of HVPT for Mandarin-speaking pediatric CI recipients. The main hypothesis was that HVPT-induced perceptual learning would greatly enhance CI users’ ability to extract the primary pitch contours from spoken words for lexical tone identification and discrimination. Furthermore, individual differences in immediate and long-term gains from training would likely be attributable to baseline performance and duration of CI use. Design: Twenty-eight prelingually deaf Mandarin-speaking kindergarteners with CIs were tested. Half of them received five sessions of HVPT within a period of three weeks. The other half served as control who did not receive the formal training. Two classical CP tasks on a tonal continuum from Mandarin Tone 1 (high-flat in pitch) to Tone 2 (mid-rising in pitch) with fixed acoustic features of duration and intensity were administered before (pretest), immediately after (posttest), and 10 weeks post training termination (follow-up test). Participants were instructed to either label a speech stimulus along the continuum (i.e., identification task) or determine whether a pair of stimuli separated by zero or two steps from the continuum was the same or different (i.e., discrimination task). Identification function measures (i.e., boundary position and boundary width) and discrimination function scores (i.e., between-category score, within-category score, and peakedness score) were assessed for each child participant across the three test sessions.Results: Linear mixed-effects (LME) models showed significant training-induced enhancement in lexical tone categorization with significantly narrower boundary width and better between-category discrimination in the immediate posttest over pretest for the trainees. Furthermore, training-induced gains were reliably retained in the follow-up test 10 weeks after training. By contrast, no significant changes were found in the control group across sessions. Regression analysis confirmed that baseline performance (i.e., boundary width in the pretest session) and duration of CI use were significant predictors for the magnitude of training-induced benefits. Conclusions: The stringent CP tests with synthesized stimuli that excluded acoustic cues other than the pitch contour and were never used in training showed strong evidence for the efficacy of HVPT in yielding immediate and sustained improvement in lexical tone categorization for Mandarin-speaking children with CIs. The training results and individual differences have remarkable implications for developing personalized computer-based short-term HVPT protocols that may have sustainable long-term benefits for aural rehabilitation in this clinical population.

Purpose: Pitch plays an important role in auditory perception of music and language. This study provides a systematic review with meta-analysis to investigate whether individuals with autism spectrum disorder (ASD) have enhanced pitch processing ability and identify the potential factors associated with processing differences between ASD and neurotypicals. Method: We conducted a systematic search through six major electronic databases focusing on the studies that used nonspeech stimuli to provide a qualitative and quantitative assessment across existing studies on pitch perception in autism. We identified potential participant- and methodology-related moderators and conducted meta-regression analyses using mixed-effects models. Results: On the basis of 22 studies with a total of 464 participants with ASD, we obtained a small-to-medium positive effect size (0.26) in support of enhanced pitch perception in ASD.Moreover, the mean age and non-verbal IQ of participants were found to significantly moderate the between-studies heterogeneity. Conclusion: Our study provides the first meta-analysis on auditory pitch perception in ASD and demonstrates the existence of different developmental trajectories between individuals with ASD and neurotypicals. Non-verbal ability can be a significant contributor to the lower-level/ local processing bias in ASD. We highlight the need for further investigation of pitch perception in ASD under challenging listening conditions. Future neurophysiological and brain imaging research studies with a longitudinal design are also needed to better understand the nature of the atypical processing in ASD to obtain new insights into the underlying neural mechanisms and to help guide auditory-based interventions for improving language and social functioning.

Purpose: This study builds upon an established effective training method to investigate the advantages of high variability phonetic identification training for enhancing lexical tone perception and production in Mandarin-speaking pediatric cochlear implant (CI) recipients, who typically face ongoing challenges in these areas. Method: Thirty two Mandarin-speaking children with CIs were quasi-randomly assigned into the training group (TG) and the control group (CG). The sixteen TG participants received five sessions of high variability phonetic training (HVPT) within a period of three weeks. The CG participants did not receive the training. Perception and production of Mandarin tones were administered before (pretest) and immediately after (posttest) the completion of HVPT via lexical tone recognition task and picture naming task. Both groups participated in the identical pretest and posttest with the same time frame between the two test sessions. Results: TG showed significant improvement from pretest to posttest in identifying Mandarin tones for both trained and untrained speech stimuli. Moreover, perceptual learning of HVPT facilitated trainees’ lexical tone production as rated by a cohort of 10 Mandarin-speaking adults with normal hearing. In contrast, CG did not exhibit significant changes in either perception or production. Conclusion: The results represent initial evidence of HVPT-induced transfer of perceptual learning to lexical tone production in CI users, which supports the application of this speech training protocol to aural rehabilitation practice.

How people recognize linguistic and emotional prosody in different listening conditions is essential for understanding the complex interplay between social context, cognition, and communication. The perception of both lexical tones and emotional prosody depends on prosodic features including pitch, intensity, duration, and voice quality. However, it is unclear which aspect of prosody is perceptually more salient and resistant to noise. This study aimed to investigate the relative perceptual robustness of emotional prosody and lexical tone recognition in quiet and in the presence of multi-talker babble noise. Forty young adults with normal hearing listened to monosyllables either with or without background babble noise and completed two identification tasks, one for emotion recognition and the other for lexical tone recognition. Compared with emotional prosody, lexical tones were more perceptually salient in multi-talker babble noise. Native Mandarin Chinese participants identified lexical tones more accurately and quickly than vocal emotions at the same signal-to-noise ratio. Lexical tone perception is also more robust against babble speech noise degradation than emotional prosody perception for native Mandarin Chinese listeners. Acoustic and cognitive dissimilarities between linguistic prosody and emotional prosody may have led to the phenomenon, which calls for further explorations into the underlying psychobiological and neurophysiological mechanisms.

Purpose: Understanding how older adults perceive and interpret emotional cues in speech prosody contributes to our knowledge of cognitive aging. This study provides a systematic review with meta-analysis to investigate the extent of the decline in affective prosody recognition (APR) among older adults in terms of overall and emotion-specific performance and explore potential moderators that may cause between-study heterogeneity. Method: Incorporated into the literature search were six electronic databases, with a specific emphasis on studies comparing the APR performance of older adults with that of younger adults. This comparison was focused on basic emotions. Meta-regression analyses were executed to pinpoint potential moderators related to demographic and methodological characteristics. Results: A total of 19 studies were included in the meta-analysis, involving 560 older adults with a mean age of 69.15 years. The findings indicated a substantial negative effect size (g = －1.21). Furthermore, the magnitude of aggregated effect sizes showed a distinct valence-related recognition pattern with positive prosody exhibiting smaller effect sizes. Years of education were found to moderate the overall performance effect estimate while age and gender significantly influenced the effect estimate of happiness. Conclusions: The results confirmed a significant decline in APR ability among older adults, but this decline was unbalanced across basic emotions. Educational level emerged as a significant factor influencing APR ability. Moreover, participants with a higher mean age exhibited notably poorer performance in recognizing happy prosody. These findings underscore the need to further investigate the neurobiological mechanisms for APR decline associated with aging.

Purpose: This study aimed to examine how aging and modifications of critical acoustic parameters may affect the perception of whispered speech as a degraded signal. Method: Forty Mandarin-speaking adults were included in the study. Part 1 of the study compared the perception of Mandarin lexical tones, vowels, and syllables in older and younger adults in whispered vs. phonated speech conditions. Parts 2 and 3 further examined how modification of duration and intensity cues contributed to the perceptual outcomes. Results: Perception of whispered tones was compromised in older and younger adults. Older adults identified lexical tones less accurately than their younger counterparts, particularly for phonated T2, T3 and whispered T3. Aging also negatively affected the vowel identification of /i, u/ in the whispered condition. Syllable-level accuracy was largely dependent on the accuracy of lexical tones and vowels. Furthermore, reduced duration led to the decreased accuracy of phonated T3 and whispered T2, T3 but increased accuracy of phonated T4. Reduced intensity lowered the recognition accuracy for phonated vowels /i, ɤ, o, y/ in older adults and /i, u/ in younger adults, and it also lowered the accuracy of whispered vowels /a, ɤ/ in older adults. Contrary to our expectation, increased duration and intensity did not improve older adults’ speech perception in either phonated or whispered conditions. Conclusion: The results suggest that aging adversely affected speech perception in both phonated and whispered conditions with more challenges in identifying whispered speech for older adults. While older adults’ diminished performance may be potentially due to problems with processing the degraded temporal and spectral information of the target speech sounds, it cannot be simply compensated for by increasing the duration and intensity of the target sounds beyond the audible level.

Background: Multisensory integration (MSI) avoids cognitive overload, and the traditional all-or-nothing perspective for dysfunctional MSI in schizophrenia has been increasingly challenged. This study aimed to systematically review and meta-analyze extant evidence on audiovisual MSI in schizophrenia. Methods: We searched Web of Science, PubMed, PsycINFO and PsycARTICLES databases from inception until April 16^th, 2024. Studies using appropriate audiovisual integration tasks to compare either behavioral or neural responses between schizophrenia individuals and healthy controls were included. Primary outcome measures included between-group differences (Hedge’s g) and symptomatic correlations (Fisher’s z) in three components of audiovisual integration tasks, including audiovisual processing, adaptation and integration. The multilevel random-effects models were used to address statistical dependency. Results: In total, 209 between-group and 116 correlational effect sizes were synthesized from 46 studies, representing 1,108 non-overlapped schizophrenia participants and 1,084 healthy controls. The overall dysfunctional audiovisual MSI in schizophrenia (g = -0.50, [95% CI, -0.64 to -0.37]) was primarily ascribed to the impaired audiovisual processing (g = -0.53, [95% CI, -0.71 to -0.35]) and adaptation (g = -0.71, [95% CI, -0.99 to -0.42]), rather than integration itself (g = -0.23, [95% CI, -0.56 to 0.11]). Pooled correlational effect size was extremely small (z = 0.16, [95% CI, 0.03 to 0.30]). Conclusions: Individuals with schizophrenia show dysfunctional multisensory processing and adaptation, but preserve a less impaired multisensory integration ability. Our findings provide implications for clinical interventions, as the relatively preserved audiovisual integration ability may serve as a possible avenue for cognitive training programs.

Purpose: School-age children with autism spectrum conditions (ASC) often experience difficulties in speech-in-noise (SiN) perception, leading to increased listening effort that impacts their well-being and academic performance. This study aimed to investigate the SiN processing challenges faced by Mandarin-speaking children with ASC and its impact on their listening effort. Methods: Participants completed sentence recognition tests in both quiet and noisy conditions, with a steady-state noise masker presented at 0 dB signal-to-noise ratio in the noisy condition. We compared recognition accuracy and task-evoked pupil responses from 23 Mandarin-speaking children with ASC to 19 age-matched neurotypical (NT) counterparts to gauge their behavioral performance and listening effort during these auditory tasks. Results: The ASC group demonstrated notably decreased accuracy in noise compared to their NT peers, suggesting poorer SiN perception. Pupillometric data further revealed significantly larger peak dilations in the ASC group than in the NT group under comparable conditions. Importantly, the ASC group's peak dilation in quiet mirrored the NT group's in noise. However, the ASC group exhibited shorter peak latencies and reduced mean dilations than the NT group in similar conditions. Such patterns indicate the ASC group might initially experience a heightened cognitive load but utilize fewer cognitive resources as the task continued, indicating an atypical allocation of cognitive resources and a potential tendency towards relatively superficial and automated auditory processing. Conclusion: Our findings highlight the unique SiN processing challenges children with ASC face, underscoring the importance of a nuanced, individual-centric approach for interventions and support.

How language mediates emotional perception and experience is poorly understood. The present event-related potential (ERP) study examined the explicit and implicit processing of emotional speech to differentiate the relative influences of communication channel, emotion category and task type in the prosodic salience effect. Thirty participants (15 women) were presented with spoken words denoting happiness, sadness and neutrality in either the prosodic or semantic channel. They were asked to judge the emotional content (explicit task) and speakers’ gender (implicit task) of the stimuli. Results indicated that emotional prosody (relative to semantics) triggered larger N100 and P200 amplitudes with greater delta, theta and alpha inter-trial phase coherence (ITPC) values in the corresponding early time windows, and continued to produce larger LPC amplitudes and faster responses during late stages of higher-order cognitive processing. The relative salience of prosodic and semantics was modulated by emotion and task, though such modulatory effects varied across different processing stages. The prosodic salience effect was reduced for sadness processing and in the implicit task during early auditory processing and decision-making but reduced for happiness processing in the explicit task during conscious emotion processing. Additionally, across-trial synchronization of delta, theta and alpha bands predicted the ERP components with higher ITPC values significantly associated with stronger N100, P200 and LPC enhancement. These findings reveal the neurocognitive dynamics of emotional speech processing with prosodic salience tied to stage-dependent emotion- and task-specific effects, which can reveal insights to research reconciling language and emotion processing from cross-linguistic/cultural and clinical perspectives.

Purpose: Hearing assistive technology (HAT) has been shown to be a viable solution to the speech-in-noise perception (SPIN) issue in children with autism spectrum disorder (ASD); however, little is known about its efficacy in tonal language speakers. This study compared sentence-level SPIN performance between Chinese children with ASD and neurotypical (NT) children and evaluated HAT use in improving SPIN performance and easing SPIN difficulty. Methods: Children with ASD (n=26) and NT children (n=19) aged 6-12 performed two adaptive tests in steady-state noise and three fixed-level tests in quiet and steady-state noise with and without using HAT. Speech recognition thresholds (SRT) and accuracy rates were assessed using adaptive and fixed-level tests, respectively. Parents or teachers of the ASD group completed a questionnaire regarding children’s listening difficulty under six circumstances before and after a ten-day trial period of HAT use. Results: Although the two groups of children had comparable SRTs, the ASD group showed a significantly lower SPIN accuracy rate than the NT group. Also, a significant impact of noise was found in the ASD group’s accuracy rate, but not in the NT group’s. There was a general improvement in the ASD group’s SPIN performance with HAT and a decrease in their listening difficulty ratings across all conditions after the device trial. Conclusion: The findings indicated inadequate SPIN in the ASD group using a relatively sensitive measure to gauge SPIN performance among children. The markedly increased accuracy rate in noise during HAT-on sessions for the ASD group confirmed the feasibility of HAT for improving SPIN performance in controlled laboratory settings, and the reduced post-use ratings of listening difficulty further confirmed the benefits of HAT use in daily scenarios.