Studies Reviewed and Their Rated Characteristics (Hinckley & Douglas, 2013)
journal contributionposted on 2021-11-11, 00:20 authored by Jacqueline J. Hinckley, Natalie F. Douglas
Purpose: Treatment fidelity is a measure of the reliability of the administration of an intervention in a treatment study. It is an important aspect of the validity of a research study, and it has implications for the ultimate implementation of evidence-supported interventions in typical clinical settings.
Method: Aphasia treatment studies published in the last 10 years in 3 journals were reviewed using coding techniques that were adapted from Gresham, Gansle, Noell, Cohen, and Rosenblum (1993). The following items were noted: identifying information, study design, description of both the dependent and independent variables, and whether a measure of treatment fidelity was explicitly included.
Results: Of the aphasia treatment studies published in the last 10 years, 14% explicitly reported treatment fidelity. Most studies reporting treatment fidelity used checking of videotaped sessions by independent raters. Of the reviewed studies, 45% provided sufficient treatment description to support replication.
Conclusion: Treatment fidelity is widely acknowledged as being critical to research validity and is a foundation for the implementation of evidence-based practices, but only a small percentage of aphasia treatment studies published in the last 10 years explicitly reported treatment fidelity. Recommendations for research practices include increased attention to matters of treatment fidelity in the peer review process and explicit incorporation of 3 levels of treatment fidelity in treatment research.