Aberrant emotional prosody circuitry predicts social communication impairments in children with autism

Published:October 12, 2022DOI:



      Emotional prosody provides acoustical cues that reflect a communication partner’s emotional state and is crucial for successful social interactions. Many children with autism have deficits in recognizing emotions from voices, however the neural basis for these impairments is unknown. Here we examine brain circuit features underlying emotional prosody processing deficits and their relation to clinical symptoms of autism.


      We used an event-related fMRI task to measure neural activity and connectivity during processing of sad and happy emotional prosody and neutral speech in 22 children with autism and 21 matched control children (7-12 years old). We employed functional connectivity analyses to test competing theoretical accounts which attribute emotional prosody impairments to either sensory processing deficits in auditory cortex or theory of mind deficits instantiated in temporoparietal junction (TPJ).


      Children with autism showed specific behavioral impairments for recognizing emotions from voices. They also showed aberrant functional connectivity between voice-sensitive auditory cortex and bilateral TPJ during emotional prosody processing. Neural activity in bilateral TPJ during processing of both sad and happy emotional prosody stimuli was associated with social communication impairments in children with autism. In contrast, activity and decoding of emotional prosody in auditory cortex was comparable between autism and control groups and did not predict social communication impairments.


      Our findings support a social-cognitive deficit model of autism by identifying a role for TPJ dysfunction during emotional prosody processing. Our study underscores the importance of “tuning in” to vocal-emotional cues for building social connections in children with autism.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


        • Pell M.D.
        • Kotz S.A.
        Comment: The Next Frontier: Prosody Research Gets Interpersonal.
        Emotion Review. 2021; 13: 51-56
        • Keltner D.
        • Haidt J.
        Social Functions of Emotions at Four Levels of Analysis.
        Cognition & Emotion. 1999; 13: 505-521
        • Van Kleef G.A.
        How Emotions Regulate Social Life: The Emotions as Social Information (EASI) Model.
        Current Directions in Psychological Science. 2009; 18: 184-188
        • Hammerschmidt K.
        • Jürgens U.
        Acoustical Correlates of Affective Prosody.
        Journal of Voice. 2007; 21: 531-540
        • Schirmer A.
        • Kotz S.A.
        Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing.
        Trends in Cognitive Sciences. 2006; 10: 24-30
        • Banse R.
        • Scherer K.R.
        Acoustic profiles in vocal emotion expression.
        Journal of Personality and Social Psychology. 1996; 70: 614-636
        • Morningstar M.
        • Nelson E.E.
        • Dirks M.A.
        Maturation of vocal emotion recognition: Insights from the developmental and neuroimaging literature.
        Neuroscience & Biobehavioral Reviews. 2018; 90: 221-230
      1. American Psychiatric Association (2013): Neurodevelopmental Disorders. Diagnostic and Statistical Manual of Mental Disorders: DSM-5: American Psychiatric Publishing.

        • Kanner L.
        Autistic disturbances of affective contact.
        Nervous Child. 1943; 2: 217-250
      2. Baltaxe CAM, Simmons JQ (1985): Prosodic Development in Normal and Autistic Children. In: Schopler E, Mesibov GB, editors. Communication Problems in Autism. Boston, MA: Springer US, pp 95-125.

        • McCann J.
        • Peppé S.
        Prosody in autism spectrum disorders: a critical review.
        International Journal of Language & Communication Disorders. 2003; 38: 325-350
        • Shriberg L.D.
        • Paul R.
        • McSweeny J.L.
        • Klin A.
        • Cohen D.J.
        • Volkmar F.R.
        Speech and Prosody Characteristics of Adolescents and Adults With High-Functioning Autism and Asperger Syndrome.
        Journal of Speech, Language, and Hearing Research. 2001; 44: 1097-1115
        • Paul R.
        • Augustyn A.
        • Klin A.
        • Volkmar F.R.
        Perception and Production of Prosody by Speakers with Autism Spectrum Disorders.
        Journal of Autism and Developmental Disorders. 2005; 35: 205-220
        • Mazefsky C.A.
        • Oswald D.P.
        Emotion Perception in Asperger’s Syndrome and High-functioning Autism: The Importance of Diagnostic Criteria and Cue Intensity.
        Journal of Autism and Developmental Disorders. 2007; 37: 1086-1095
        • Rutherford M.D.
        • Baron-Cohen S.
        • Wheelwright S.
        Reading the Mind in the Voice: A Study with Normal Adults and Adults with Asperger Syndrome and High Functioning Autism.
        Journal of Autism and Developmental Disorders. 2002; 32: 189-194
        • Golan O.
        • Baron-Cohen S.
        • Hill J.J.
        • Rutherford M.D.
        The ‘Reading the Mind in the Voice’ Test-Revised: A Study of Complex Emotion Recognition in Adults with and Without Autism Spectrum Conditions.
        Journal of Autism and Developmental Disorders. 2007; 37: 1096-1106
        • Lindner J.L.
        • Rosén L.A.
        Decoding of Emotion through Facial Expression, Prosody and Verbal Content in Children and Adolescents with Asperger’s Syndrome.
        Journal of Autism and Developmental Disorders. 2006; 36: 769-777
        • Oerlemans A.M.
        • Droste K.
        • van Steijn D.J.
        • de Sonneville L.M.J.
        • Buitelaar J.K.
        • Rommelse N.N.J.
        Co-segregation of Social Cognition, Executive Function and Local Processing Style in Children with ASD, their Siblings and Normal Controls.
        Journal of Autism and Developmental Disorders. 2013; 43: 2764-2778
        • Taylor L.J.
        • Maybery M.T.
        • Grayndler L.
        • Whitehouse A.J.O.
        Evidence for shared deficits in identifying emotions from faces and from voices in autism spectrum disorders and specific language impairment.
        International Journal of Language & Communication Disorders. 2015; 50: 452-466
        • Oerlemans A.M.
        • van der Meer J.M.J.
        • van Steijn D.J.
        • de Ruiter S.W.
        • de Bruijn Y.G.E.
        • de Sonneville L.M.J.
        • et al.
        Recognition of facial emotion and affective prosody in children with ASD (+ADHD) and their unaffected siblings.
        Eur Child Adolesc Psychiatry. 2014; 23: 257-271
        • Fridenson-Hayo S.
        • Berggren S.
        • Lassalle A.
        • Tal S.
        • Pigat D.
        • Bölte S.
        • et al.
        Basic and complex emotion recognition in children with autism: cross-cultural findings.
        Molecular Autism. 2016; 7: 52
        • McCann J.
        • Peppé S.
        • Gibbon F.E.
        • O'Hare A.
        • Rutherford M.
        Prosody and its relationship to language in school-aged children with high-functioning autism.
        International Journal of Language & Communication Disorders. 2007; 42: 682-702
        • Peppé S.
        • McCann J.
        • Gibbon F.
        • O’Hare A.
        • Rutherford M.
        Receptive and Expressive Prosodic Ability in Children With High-Functioning Autism.
        Journal of Speech, Language, and Hearing Research. 2007; 50: 1015-1028
        • Scheerer N.E.
        • Shafai F.
        • Stevenson R.A.
        • Iarocci G.
        Affective Prosody Perception and the Relation to Social Competence in Autistic and Typically Developing Children.
        J Abnorm Child Psychol. 2020; 48: 965-975
        • Robertson C.E.
        • Baron-Cohen S.
        Sensory perception in autism.
        Nature Reviews Neuroscience. 2017; 18: 671-684
        • Baum S.H.
        • Stevenson R.A.
        • Wallace M.T.
        Behavioral, perceptual, and neural alterations in sensory and multisensory function in autism spectrum disorder.
        Progress in Neurobiology. 2015; 134: 140-160
        • Brück C.
        • Kreifelts B.
        • Wildgruber D.
        Emotional voices in context: A neurobiological model of multimodal affective information processing.
        Physics of Life Reviews. 2011; 8: 383-403
        • Leipold S.
        • Abrams D.A.
        • Karraker S.
        • Menon V.
        Neural decoding of emotional prosody in voice-sensitive auditory cortex predicts social communication abilities in children.
        Cerebral Cortex. 2022;
        • Belin P.
        • Zatorre R.J.
        • Lafaille P.
        • Ahad P.
        • Pike B.
        Voice-selective areas in human auditory cortex.
        Nature. 2000; 403: 309-312
      3. Gervais H, Belin P, Boddaert N, Leboyer M, Coez A, Sfaello I, et al. (2004): Abnormal cortical voice processing in autism. Nature Neuroscience. 7:801-801.

        • Baron-Cohen S.
        • Leslie A.M.
        • Frith U.
        Does the autistic child have a “theory of mind”.
        Cognition. 1985; 21: 37-46
        • Happé F.G.E.
        Communicative competence and theory of mind in autism: A test of relevance theory.
        Cognition. 1993; 48: 101-119
        • Premack D.
        • Woodruff G.
        Does the chimpanzee have a theory of mind?.
        Behavioral and Brain Sciences. 1978; 1: 515-526
        • Saxe R.
        • Kanwisher N.
        People thinking about thinking people: The role of the temporo-parietal junction in “theory of mind”.
        NeuroImage. 2003; 19: 1835-1842
        • Saxe R.
        • Powell L.J.
        It's the Thought That Counts: Specific Brain Regions for One Component of Theory of Mind.
        Psychological Science. 2006; 17: 692-699
        • Schurz M.
        • Radua J.
        • Aichhorn M.
        • Richlan F.
        • Perner J.
        Fractionating theory of mind: A meta-analysis of functional brain imaging studies.
        Neuroscience & Biobehavioral Reviews. 2014; 42: 9-34
        • Samson D.
        • Apperly I.A.
        • Chiavarino C.
        • Humphreys G.W.
        Left temporoparietal junction is necessary for representing someone else's belief.
        Nature Neuroscience. 2004; 7: 499-500
        • Mars R.B.
        • Sallet J.
        • Schuffelgen U.
        • Jbabdi S.
        • Toni I.
        • Rushworth M.F.S.
        Connectivity-Based Subdivisions of the Human Right "Temporoparietal Junction Area": Evidence for Different Areas Participating in Different Cortical Networks.
        Cerebral Cortex. 2012; 22: 1894-1903
        • Adolphs R.
        The Social Brain: Neural Basis of Social Knowledge.
        Annual Review of Psychology. 2009; 60: 693-716
        • Lombardo M.V.
        • Chakrabarti B.
        • Bullmore E.T.
        • Baron-Cohen S.
        Specialization of right temporo-parietal junction for mentalizing and its relation to social impairments in autism.
        NeuroImage. 2011; 56: 1832-1838
        • O'Nions E.
        • Sebastian C.L.
        • McCrory E.
        • Chantiluke K.
        • Happé F.
        • Viding E.
        Neural bases of Theory of Mind in children with autism spectrum disorders and children with conduct problems and callous-unemotional traits.
        Developmental Science. 2014; 17: 786-796
        • Pelphrey K.A.
        • Morris J.P.
        • McCarthy G.
        • LaBar K.S.
        Perception of dynamic changes in facial affect and identity in autism.
        Social Cognitive and Affective Neuroscience. 2007; 2: 140-149
        • Pelphrey K.A.
        • Shultz S.
        • Hudac C.M.
        • Wyk B.C.V.
        Research Review: Constraining heterogeneity: the social brain and its development in autism spectrum disorder.
        Journal of Child Psychology and Psychiatry. 2011; 52: 631-644
        • Gengoux G.W.
        • Abrams D.A.
        • Schuck R.
        • Millan M.E.
        • Libove R.
        • Ardel C.M.
        • et al.
        A Pivotal Response Treatment Package for Children With Autism Spectrum Disorder: An RCT.
        Pediatrics. 2019; 144
      4. Koegel RL, Koegel LK (2006): Pivotal response treatments for autism: Communication, social, & academic development. Baltimore, MD, US: Paul H Brookes Publishing.

        • Volkmar F.R.
        Editorial: The Importance of Early Intervention.
        Journal of Autism and Developmental Disorders. 2014; 44: 2979-2980
        • Charpentier J.
        • Latinus M.
        • Andersson F.
        • Saby A.
        • Cottier J.-P.
        • Bonnet-Brilhault F.
        • et al.
        Brain correlates of emotional prosodic change detection in autism spectrum disorder.
        NeuroImage: Clinical. 2020; 28102512
        • Gebauer L.
        • Skewes J.
        • Hørlyck L.
        • Vuust P.
        Atypical perception of affective prosody in Autism Spectrum Disorder.
        NeuroImage: Clinical. 2014; 6: 370-378
        • Rosenblau G.
        • Kliemann D.
        • Dziobek I.
        • Heekeren H.R.
        Emotional prosody processing in autism spectrum disorder.
        Social Cognitive and Affective Neuroscience. 2017; 12: 224-239
        • Eigsti I.-M.
        • Schuh J.
        • Mencl E.
        • Schultz R.T.
        • Paul R.
        The neural underpinnings of prosody in autism.
        Child Neuropsychology. 2012; 18: 600-617
        • Risi S.
        • Lord C.
        • Gotham K.
        • Corsello C.
        • Chrysler C.
        • Szatmari P.
        • et al.
        Combining Information From Multiple Sources in the Diagnosis of Autism Spectrum Disorders.
        Journal of the American Academy of Child & Adolescent Psychiatry. 2006; 45: 1094-1103
        • Lord C.
        • Risi S.
        • Lambrecht L.
        • Cook J.E.H.
        • Leventhal B.L.
        • DiLavore P.C.
        • et al.
        The Autism Diagnostic Observation Schedule—Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism.
        Journal of Autism and Developmental Disorders. 2000; 30: 205-223
        • Lord C.
        • Rutter M.
        • Le Couteur A.
        Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders.
        Journal of Autism and Developmental Disorders. 1994; 24: 659-685
        • Abrams D.A.
        • Kochalka J.
        • Bhide S.
        • Ryali S.
        • Menon V.
        Intrinsic functional architecture of the human speech processing network.
        Cortex. 2020; 129: 41-56
        • McLaren D.G.
        • Ries M.L.
        • Xu G.
        • Johnson S.C.
        A generalized form of context-dependent psychophysiological interactions (gPPI): A comparison to standard approaches.
        NeuroImage. 2012; 61: 1277-1286
        • Baum K.M.
        • Nowicki S.
        Perception of Emotion: Measuring Decoding Accuracy of Adult Prosodic Cues Varying in Intensity.
        Journal of Nonverbal Behavior. 1998; 22: 89-107
        • Nowicki S.
        • Duke M.P.
        Individual differences in the nonverbal communication of affect: The diagnostic analysis of nonverbal accuracy scale.
        Journal of Nonverbal Behavior. 1994; 18: 9-35
        • Haynes J.D.
        A primer on pattern-based approaches to fMRI: Principles, pitfalls, and perspectives.
        Neuron. 2015; 87: 257-270
        • Ethofer T.
        • Van De Ville D.
        • Scherer K.
        • Vuilleumier P.
        Decoding of Emotional Information in Voice-Sensitive Cortices.
        Current Biology. 2009; 19: 1028-1033
        • Carter R.M.
        • Huettel S.A.
        A nexus model of the temporal–parietal junction.
        Trends in Cognitive Sciences. 2013; 17: 328-336
        • Murdaugh D.L.
        • Nadendla K.D.
        • Kana R.K.
        Differential role of temporoparietal junction and medial prefrontal cortex in causal inference in autism: An independent component analysis.
        Neuroscience Letters. 2014; 568: 50-55
        • Kana R.K.
        • Libero L.E.
        • Hu C.P.
        • Deshpande H.D.
        • Colburn J.S.
        Functional Brain Networks and White Matter Underlying Theory-of-Mind in Autism.
        Social Cognitive and Affective Neuroscience. 2014; 9: 98-105
        • Belin P.
        • Fecteau S.
        • Bédard C.
        Thinking the voice: neural correlates of voice perception.
        Trends in Cognitive Sciences. 2004; 8: 129-135
        • Abrams D.A.
        • Chen T.
        • Odriozola P.
        • Cheng K.M.
        • Baker A.E.
        • Padmanabhan A.
        • et al.
        Neural circuits underlying mother's voice perception predict social communication abilities in children.
        Proceedings of the National Academy of Sciences of the United States of America. 2016; 113: 6295-6300
        • Steiner F.
        • Bobin M.
        • Frühholz S.
        Auditory cortical micro-networks show differential connectivity during voice and speech processing in humans.
        Communications Biology. 2021; 4: 801
        • Ethofer T.
        • Anders S.
        • Erb M.
        • Herbert C.
        • Wiethoff S.
        • Kissler J.
        • et al.
        Cerebral pathways in processing of affective prosody: A dynamic causal modeling study.
        NeuroImage. 2006; 30: 580-587
        • Abrams D.A.
        • Padmanabhan A.
        • Chen T.
        • Odriozola P.
        • Baker A.E.
        • Kochalka J.
        • et al.
        Impaired voice processing in reward and salience circuits predicts social communication in children with autism.
        eLife. 2019; 8
        • Abrams D.A.
        • Lynch C.J.
        • Cheng K.M.
        • Phillips J.
        • Supekar K.
        • Ryali S.
        • et al.
        Underconnectivity between voice-selective cortex and reward circuitry in children with autism.
        Proceedings of the National Academy of Sciences of the United States of America. 2013; 110: 12060-12065
        • Luckhardt C.
        • Schütz M.
        • Mühlherr A.
        • Mössinger H.
        • Boxhoorn S.
        • Dempfle A.
        • et al.
        Phase-IIa randomized, double-blind, sham-controlled, parallel group trial on anodal transcranial direct current stimulation (tDCS) over the left and right tempo-parietal junction in autism spectrum disorder—StimAT: study protocol for a clinical trial.
        Trials. 2021; 22: 248
        • Yuan W.
        • Altaye M.
        • Ret J.
        • Schmithorst V.
        • Byars A.W.
        • Plante E.
        • et al.
        Quantification of head motion in children during various fMRI language tasks.
        Human Brain Mapping. 2009; 30: 1481-1489
        • Nee D.E.
        fMRI replicability depends upon sufficient individual-level data.
        Communications Biology. 2019; 2: 1-4
        • Vul E.
        • Harris C.
        • Winkielman P.
        • Pashler H.
        Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition.
        Perspectives on Psychological Science. 2009; 4: 274-290
      5. Constantino JN, Gruber CP (2012): Social Responsiveness Scale: SRS-2. Western Psychological Services.