Meta-analysis reproducibility in speech, language, and hearing research (Chow et al., 2021)

<div><b>Purpose: </b>The purposes of this meta-review are to (a) articulate the importance of transparency and reproducibility in meta-analysis, (b) assess the transparency and reproducibility of meta-analyses published in journals of the American Speech-Language-Hearing Association (ASHA), and (c) discuss the implications of our findings and recommendations for future research.</div><div><b>Method: </b>We conducted a meta-review of all meta-analyses published in ASHA journals through December 31, 2020. Our systematic review yielded 47 meta-analyses for inclusion in this review. We coded all eligible reports on the core elements of transparency and reproducibility in meta-analysis.</div><div><b>Results: </b>Our findings suggest that though reporting tendencies have improved over time, much work is needed to promote transparency and reproducibility in meta-analytic work. Key areas for future accountability include preregistering study protocol, using Preferred Reporting in Systematic Reviews and Meta-Analysis checklists, providing full data sets, and publishing analytic codes.</div><div><b>Conclusions: </b>The state of reporting in meta-analysis is improving over time. We conclude with a discussion of specific areas that need further attention, and recommendations for researchers to consider when conducting future meta-analyses.</div><div><br></div><div><b>Supplemental Material S1.</b> References of the included studies. </div><div><br></div><div><b>Supplemental Material S2.</b> Summary of included studies.</div><div><br></div><div><b>Supplemental Material S3.</b> Coding manual.</div><div><br></div><div><b>Supplemental Material S4.</b> Decision rules for some complicated coding variables.</div><div><br></div><div><b>Supplemental Material S5. </b>Complete data. </div><div><br></div><div>Chow, J. C., Sjogren, A. L., & Zhao, H. (2021). Reporting and reproducibility of meta-analysis in speech, language, and hearing research.<i> Journal of Speech, Language, and Hearing Research</i>. Advance online publication. https://doi.org/10.1044/2021_JSLHR-21-00047</div>