Changes in multimodal communication synchrony (Murillo et al., 2018)
datasetposted on 2018-08-08, 16:27 authored by Eva Murillo, Carlota Ortega, Alicia Otones, Irene Rujas, Marta Casla
Purpose: The aim of this study is to analyze the changes in temporal synchrony between gesture and speech of multimodal communicative behaviors in the transition from babbling to two-word productions.
Method: Ten Spanish-speaking children were observed at 9, 12, 15, and 18 months of age in a semistructured play situation. We longitudinally analyzed the synchrony between gestures and vocal productions and between their prominent parts. We also explored the relationship between gestural–vocal synchrony and independent measures of language development.
Results: Results showed that multimodal communicative behaviors tend to be shorter with age, with an increasing overlap of its constituting elements. The same pattern is found when considering the synchrony between the prominent parts. The proportion of overlap between gestural and vocal elements at 15 months of age as well as the proportion of the stroke overlapped with vocalization appear to be related to lexical development 3 months later.
Conclusions: These results suggest that children produce gestures and vocalizations as coordinated elements of a single communication system before the transition to the two-word stage. This coordination is related to subsequent lexical development in this period.
Examples of Types of Gestures Coded in the Study
Supplemental Material S1. Examples of pointing gestures.
Supplemental Material S2. Example of reaching gesture.
Supplemental Material S3. Example of showing gesture.
Supplemental Material S4. Example of give gesture.
Supplemental Material S5. Example of conventional gesture.
Supplemental Material S6. Example of symbolic gesture.
Supplemental Material S7. Example of “other” gesture.
Supplemental Material S8. Sequence of the preparation phase of the gesture. The arm starts to move until its full extension.
Supplemental Material S9. Sequence of the stroke phase of the gesture. The expression of the gesture is fully accomplished, indicating where the attention of the observer is intended to go.
Examples of the Phases of Gestures Coded in the Study
Supplemental Material S10. Sequence of the retraction phase of the gesture. The arm moves from the stroke position until the initial rest position.
Murillo, E., Ortega, C., Otones, A., Rujas, I., & Casla, M. (2018). Changes in the synchrony of multimodal communication in early language development. Journal of Speech, Language, and Hearing Research, 61, 2235–2245. https://doi.org/10.1044/2018_JSLHR-L-17-0402
This research has been supported by the Ministerio de Economía y Competitividad with Grant PSI2013-44250-P to Marta Casla, Eva Murillo, and Irene Rujas.
languagelanguage developmentchildrentoddlerssynchronycommunicationmultimodal communicationearly language developmenttemporal synchronygesturespeechbabblingtwo-word productionSpanishlongitudinalvocaltypically developingvocalizationmultimodalLanguageLinguistic Processes (incl. Speech Production and Comprehension)