Fundamental frequency and rate on synthetic speech (Vojtech et al., 2019)
mediaposted on 15.07.2019 by Jennifer M. Vojtech, Jacob P. Noordzij Jr., Gabriel J. Cler, Cara E. Stepp
Media is any form of research output that is recorded and played. This is most commonly video, but can be audio or 3D representations.
Purpose: This study investigated how modulating fundamental frequency (f0) and speech rate differentially impact the naturalness, intelligibility, and communication efficiency of synthetic speech.
Method: Sixteen sentences of varying prosodic content were developed via a speech synthesizer. The f0 contour and speech rate of these sentences were altered to produce 4 stimulus sets: (a) normal rate with a fixed f0 level, (b) slow rate with a fixed f0 level, (c) normal rate with prosodically natural f0 variation, and (d) normal rate with prosodically unnatural f0 variation. Sixteen listeners provided orthographic transcriptions and judgments of naturalness for these stimuli.
Results: Sentences with f0 variation were rated as more natural than those with a fixed f0 level. Conversely, sentences with a fixed f0 level demonstrated higher intelligibility than those with f0 variation. Speech rate did not affect the intelligibility of stimuli with a fixed f0 level. Communication efficiency was highest for sentences produced at a normal rate and a fixed f0 level.
Conclusions: Sentence-level f0 variation increased naturalness ratings of synthesized speech, whether the variation was prosodically natural or not. However, these f0 variations reduced intelligibility. There is evidence of a trade-off in naturalness and intelligibility of synthesized speech, which may impact future speech synthesis designs.
Supplemental Material S1. Normal-Rate Fixed f0
Supplemental Material S2. Slow-Rate Fixed f0
Supplemental Material S3. Normal-Rate Prosodically Natural f0 Variation
Supplemental Material S4. Normal-Rate Prosodically Unnatural f0 Variation
Vojtech, J. M., Noordzij, J. P., Jr., Cler, G. J., & Stepp, C. E. (2019). The effects of modulating fundamental frequency and speech rate on the intelligibility, communication efficiency, and perceived naturalness of synthetic speech. American Journal of Speech-Language Pathology, 28, 875–886. https://doi.org/10.1044/2019_AJSLP-MSC18-18-0052
Publisher Note: This article is part of the Special Issue: Selected Papers From the 2018 Conference on Motor Speech—Clinical Science and Innovations.