Optimized and predictive phonemic interfaces (Cler et al., 2019)
journal contributionposted on 2019-07-15, 21:27 authored by Gabriel J. Cler, Katharine R. Kolin, Jacob P. Noordzij Jr., Jennifer M. Vojtech, Susan K. Fager, Cara E. Stepp
Purpose: We empirically assessed the results of computational optimization and prediction in communication interfaces that were designed to allow individuals with severe motor speech disorders to select phonemes and generate speech output.
Method: Interface layouts were either random or optimized, in which phoneme targets that were likely to be selected together were located in proximity. Target sizes were either static or predictive, such that likely targets were dynamically enlarged following each selection. Communication interfaces were evaluated by 36 users without motor impairments using an alternate access method. Each user was assigned to 1 of 4 interfaces varying in layout and whether prediction was implemented (random/static, random/predictive, optimized/static, optimized/predictive) and participated in 12 sessions over a 3-week period. Six participants with severe motor impairments used both the optimized/static and optimized/predictive interfaces in 1–2 sessions.
Results: In individuals without motor impairments, prediction provided significantly faster communication rates during training (Sessions 1–9), as users were learning the interface target locations and the novel access method. After training, optimization acted to significantly increase communication rates. The optimization likely became relevant only after training when participants knew the target locations and moved directly to the targets. Participants with motor impairments could use the interfaces with alternate access methods and generally rated the interface with prediction as preferred.
Conclusions: Optimization and prediction led to increases in communication rates in users without motor impairments. Predictive interfaces were preferred by users with motor impairments. Future research is needed to translate these results into clinical practice.
Supplemental Material S1. Video showing usage of all four interfaces (random/static; random/predictive; optimized/static; optimized/predictive) to produce messages.
Supplemental Material S2. Survey given to participants with motor impairment following each block of interaction with the interface.
Supplemental Material S3. Results of probes. Top left: Motor task speed. Top right: Visual search speed. Bottom left: phoneme identification speed. Bottom right: phoneme identification accuracy (% correct). Error bars are standard error.
Cler, G. J., Kolin, K. R., Noordzij, J. P., Jr., Vojtech, J. M., Fager, S. K., & Stepp, C. E. (2019). Optimized and predictive phonemic interfaces for augmentative and alternative communication. Journal of Speech, Language, and Hearing Research, 62, 2065–2081. https://doi.org/10.1044/2019_JSLHR-S-MSC18-18-0187
Publisher Note: This article is part of the Forum: Selected Papers From the 2018 Conference on Motor Speech—Basic Science and Clinical Innovation.
This work was supported by National Institute on Deafness and Other Communication Disorders Grant F31 DC014872 (awarded to G. J. C.) and National Science Foundation Grants 1452169 (awarded to C. E. S.) and 1247312 (awarded to J. M. V.)
speechoptimizedpredictiveinterfacecomputationalcommunicationaugmentative and alternative communicationmotor speechdisorderimpairmentseverephonemelayouttargetscontrolsstaticpredictiontrainingmethodsclinicalclinicianLinguistic Processes (incl. Speech Production and Comprehension)Communication Technology and Digital Media Studies