Narrative Assessment Protocol-2 (Bowles et al., 2020)
journal contributionposted on 2020-02-06, 20:17 authored by Ryan P. Bowles, Laura M. Justice, Kiren S. Khan, Shayne B. Piasta, Lori E. Skibbe, Tricia D. Foster
Purpose: Narrative skill, a child’s ability to create a temporally sequenced account of an experience or event, is considered an important domain of children’s language development. Narrative skill is strongly predictive of later language and literacy and is emphasized in curricula and educational standards. However, the need to transcribe a child’s narrative and the lack of psychometrically justified scoring methods have precluded broad consideration of narrative skill among practitioners. We describe the development and validation of the Narrative Assessment Protocol-2 (NAP-2), an assessment of narrative skill for children ages 3–6 years, which uses event-based frequency scoring directly from a video recording of a child’s narrative.
Method: The NAP-2 underwent a rigorous development process involving creation of four wordless picture books and associated scripts and identification of a broad item pool, including aspects of narrative microstructure and macrostructure. We collected two narratives from each of 470 children using the NAP-2 elicitation materials and scored each with the 60 items in the initial item pool.
Results: Cross-validated exploratory factor analyses indicated a single narrative skill factor. Rasch measurement analysis led to selection of 20 items that maintained high reliability while having good fit to the model and no evidence of differential item functioning across books and gender.
Conclusions: The NAP-2 offers a psychometrically sound and easy-to-use assessment of narrative skill for children ages 3–6 years. The NAP-2 is available freely online for use by speech-language pathologists, educational practitioners, and researchers.
Supplemental Material S1. Items from the Narrative Assessment Protocol (Original Version).
Supplemental Material S2. Complete Narrative Assessment Protocol-2 item pool tested.
Bowles, R. P., Justice, L. M., Khan, K. S., Piasta, S. B., Skibbe, L. E., & Foster, T. D. (2020). Development of the Narrative Assessment Protocol-2: A tool for examining young children’s narrative skill. Language, Speech, and Hearing Services in Schools. Advance online publication. https://doi.org/10.1044/2019_LSHSS-19-00038
The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R305A110293 awarded to Michigan State University.
Read the peer-reviewed publication
childrenchildyoungnarrativenarrationstorytellinglanguageskillspeech-language pathologyassessmentprotocolNarrative Assessment ProtocoldevelopmentexperienceeventliteracyeducationpractitionerclinicianclinicaltranscribetranscriptionscoringmethodvideorecordingpicturebookscriptidentificationscoreitemmicrostructuremacrostructureelicitationmaterialreliabilityvalidityfitpsychometrictestresearchLanguage