JSLHR-20-00063lewis_SuppS1.pdf (499.48 kB)
Human mimic voice cortical processing (Talkington et al., 2020)
journal contributionposted on 2020-09-16, 17:19 authored by William J. Talkington, Jeremy Donai, Alexandra S. Kadner, Molly L. Layne, Andrew Forino, Sijin Wen, Si Gao, Margeaux M. Gray, Alexandria J. Ashraf, Gabriela N. Valencia, Brandon D. Smith, Stephanie K. Khoo, Stephen J. Gray, Norman Lass, Julie A. Brefczynski-Lewis, Susannah Engdahl, David Graham, Chris A. Frum, James W. Lewis
Purpose: From an anthropological perspective of hominin communication, the human auditory system likely evolved to enable special sensitivity to sounds produced by the vocal tracts of human conspecifics whether attended or passively heard. While numerous electrophysiological studies have used stereotypical human-produced verbal (speech voice and singing voice) and nonverbal vocalizations to identify human voice–sensitive responses, controversy remains as to when (and where) processing of acoustic signal attributes characteristic of “human voiceness” per se initiate in the brain.
Method: To explore this, we used animal vocalizations and human-mimicked versions of those calls (“mimic voice”) to examine late auditory evoked potential responses in humans.
Results: Here, we revealed an N1b component (96–120 ms poststimulus) during a nonattending listening condition showing significantly greater magnitude in response to mimics, beginning as early as primary auditory cortices, preceding the time window reported in previous studies that revealed species-specific vocalization processing initiating in the range of 147–219 ms. During a sound discrimination task, a P600 (500–700 ms poststimulus) component showed specificity for accurate discrimination of human mimic voice. Distinct acoustic signal attributes and features of the stimuli were used in a classifier model, which could distinguish most human from animal voice comparably to behavioral data—though none of these single features could adequately distinguish human voiceness.
Conclusions: These results provide novel ideas for algorithms used in neuromimetic hearing aids, as well as direct electrophysiological support for a neurocognitive model of natural sound processing that informs both neurodevelopmental and anthropological models regarding the establishment of auditory communication systems in humans.
Supplemental Material S1.
Part A: Error trial AEP data from Task condition.
Part B: Machine learning classification of animal vocals and their human mimics.
Talkington, W. J., Donai, J., Kadner, A. S., Layne, M. L., Forino, A., Wen, S., Gao, S., Gray, M. M., Ashraf, A. J., Valencia, G. N., Smith, B. D., Khoo, S. K., Gray, S. J., Lass, N., Brefczynski-Lewis, J. A., Engdahl, S., Graham, D., Frum, C. A., & Lewis, J. W. (2020). Electrophysiological evidence of early cortical sensitivity to human conspecific mimic voice as a distinct category of natural sound. Journal of Speech, Language, and Hearing Research. Advance online publication. https://doi.org/10.1044/2020_JSLHR-20-00063
This work was supported by National Institute of General Medical Sciences, Centers of Biomedical Research Excellence Grant GM103503 and National Center for Research Resources, Centers of Biomedical Research Excellence Grants E15524 and RR10007935 to the Sensory Neuroscience Research Center of West Virginia University (WVU) and to affiliated WVU Summer Undergraduate Research Internships; to the West Virginia IDeA Network of Biomedical Research Excellence program supported by National Institute of General Medical Sciences Award P20GM103434; plus an individual predoctoral award to W. J. T. funded by the Air Force Office of Scientific Research (American Society for Engineering Education, National Defense Science and Engineering Graduate Fellowship).
voicehumanmimicelectrophysiologicalevidenceearlycorticalsensitivityconspecificdistinctcategorynaturalsoundanthropologicalhominincommunicationauditorysystemvocal tractverbalacousticvoicenessanimalvocalizationmimicryevoked potentialnonattendingattendinglisteningcortexdiscrimination tasksignalmodelneuromimetichearing aidneurocognitiveprocessingneurodevelopmentalCommunication StudiesAnatomy