What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review
- PMID: 26345357
- PMCID: PMC4562107
- DOI: 10.1186/s13012-015-0320-3
What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review
Abstract
Background: Implementation fidelity is critical to the internal and external validity of implementation research. Much of what is written about implementation fidelity addresses fidelity of evidence-informed interventions rather than fidelity of implementation strategies. The documentation and reporting of fidelity to implementation strategies requires attention. Therefore, in this scoping review, we identify the extent and quality of documentation and reporting of fidelity of implementation strategies that were used to implement evidence-informed interventions.
Methods: A six-stage methodological framework for scoping studies guided our work. Studies were identified from the outputs of the Effective Practice and Organization of Care (EPOC) review group within the Cochrane Database of Systematic Reviews. EPOC's primary focus, implementation strategies influencing provider behavior change, optimized our ability to identify articles for inclusion. We organized the retrieved articles from the systematic reviews by journal and selected the three journals with the largest number of retrieved articles. Using a data extraction tool, we organized retrieved article data from these three journals. In addition, we summarized implementation strategies using the EPOC categories. Data extraction pertaining to the quality of reporting the fidelity of implementation strategies was facilitated with an "Implementation Strategy Fidelity Checklist" based on definitions adapted from Dusenbury et al. We conducted inter-rater reliability checks for all of the independently scored articles. Using linear regression, we assessed the fidelity scores in relation to the publication year.
Results: Seventy-two implementation articles were included in the final analysis. Researchers reported neither fidelity definitions nor conceptual frameworks for fidelity in any articles. The most frequently employed implementation strategies included distribution of education materials (n = 35), audit and feedback (n = 32), and educational meetings (n = 25). Fidelity of implementation strategies was documented in 51 (71 %) articles. Inter-rater reliability coefficients of the independent reviews for each component of fidelity were as follows: adherence = 0.85, dose = 0.89, and participant responsiveness = 0.96. The mean fidelity score was 2.6 (SD = 2.25). We noted a statistically significant decline in fidelity scores over time.
Conclusions: In addition to identifying the under-reporting of fidelity of implementation strategies in the health literature, we developed and tested a simple checklist to assess the reporting of fidelity of implementation strategies. More research is indicated to assess the definitions and scoring schema of this checklist. Careful reporting of details about fidelity of implementation strategies will make an important contribution to implementation science.
Similar articles
-
Strategies used for childhood chronic functional constipation: the SUCCESS evidence synthesis.Health Technol Assess. 2024 Jan;28(5):1-266. doi: 10.3310/PLTR9622. Health Technol Assess. 2024. PMID: 38343084 Free PMC article.
-
Defining the optimum strategy for identifying adults and children with coeliac disease: systematic review and economic modelling.Health Technol Assess. 2022 Oct;26(44):1-310. doi: 10.3310/ZUCE8371. Health Technol Assess. 2022. PMID: 36321689 Free PMC article.
-
Exploring conceptual and theoretical frameworks for nurse practitioner education: a scoping review protocol.JBI Database System Rev Implement Rep. 2015 Oct;13(10):146-55. doi: 10.11124/jbisrir-2015-2150. JBI Database System Rev Implement Rep. 2015. PMID: 26571290
-
Falls prevention interventions for community-dwelling older adults: systematic review and meta-analysis of benefits, harms, and patient values and preferences.Syst Rev. 2024 Nov 26;13(1):289. doi: 10.1186/s13643-024-02681-3. Syst Rev. 2024. PMID: 39593159 Free PMC article.
-
Conservative, physical and surgical interventions for managing faecal incontinence and constipation in adults with central neurological diseases.Cochrane Database Syst Rev. 2024 Oct 29;10(10):CD002115. doi: 10.1002/14651858.CD002115.pub6. Cochrane Database Syst Rev. 2024. PMID: 39470206
Cited by
-
A systematic review of the implementation of obesity prevention interventions in early childcare and education settings using the RE-AIM framework.Transl Behav Med. 2020 Oct 12;10(5):1168-1176. doi: 10.1093/tbm/ibz179. Transl Behav Med. 2020. PMID: 33044537 Free PMC article.
-
Mapping Clinical Barriers and Evidence-Based Implementation Strategies in Low-to-Middle Income Countries (LMICs).Worldviews Evid Based Nurs. 2021 Jun;18(3):190-200. doi: 10.1111/wvn.12503. Epub 2021 May 10. Worldviews Evid Based Nurs. 2021. PMID: 33973346 Free PMC article.
-
Building CapaCITY/É for sustainable transportation: protocol for an implementation science research program in healthy cities.BMJ Open. 2024 Apr 17;14(4):e085850. doi: 10.1136/bmjopen-2024-085850. BMJ Open. 2024. PMID: 38631827 Free PMC article.
-
The Canadian Healthy Life Trajectories Initiative (HeLTI) Trial: a study protocol for monitoring fidelity of a preconception-lifestyle behaviour intervention.Trials. 2023 Apr 7;24(1):262. doi: 10.1186/s13063-023-07271-7. Trials. 2023. PMID: 37024918 Free PMC article.
-
"We start where we are": a qualitative study of barriers and pragmatic solutions to the assessment and reporting of implementation strategy fidelity.Implement Sci Commun. 2022 Oct 29;3(1):117. doi: 10.1186/s43058-022-00365-4. Implement Sci Commun. 2022. PMID: 36309715 Free PMC article.
References
-
- Century J, Rudnick M, Freeman C. A framework for measuring fidelity of implementation: a foundation for shared language and accumulation of knowledge. Am J Eval. 2010;31:199–218. doi: 10.1177/1098214010366173. - DOI
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources