Towards a methodology for cluster searching to provide conceptual and contextual "richness" for systematic reviews of complex interventions: case study (CLUSTER)
- PMID: 24073615
- PMCID: PMC3819734
- DOI: 10.1186/1471-2288-13-118
Towards a methodology for cluster searching to provide conceptual and contextual "richness" for systematic reviews of complex interventions: case study (CLUSTER)
Abstract
Background: Systematic review methodologies can be harnessed to help researchers to understand and explain how complex interventions may work. Typically, when reviewing complex interventions, a review team will seek to understand the theories that underpin an intervention and the specific context for that intervention. A single published report from a research project does not typically contain this required level of detail. A review team may find it more useful to examine a "study cluster"; a group of related papers that explore and explain various features of a single project and thus supply necessary detail relating to theory and/or context.We sought to conduct a preliminary investigation, from a single case study review, of techniques required to identify a cluster of related research reports, to document the yield from such methods, and to outline a systematic methodology for cluster searching.
Methods: In a systematic review of community engagement we identified a relevant project - the Gay Men's Task Force. From a single "key pearl citation" we conducted a series of related searches to find contextually or theoretically proximate documents. We followed up Citations, traced Lead authors, identified Unpublished materials, searched Google Scholar, tracked Theories, undertook ancestry searching for Early examples and followed up Related projects (embodied in the CLUSTER mnemonic).
Results: Our structured, formalised procedure for cluster searching identified useful reports that are not typically identified from topic-based searches on bibliographic databases. Items previously rejected by an initial sift were subsequently found to inform our understanding of underpinning theory (for example Diffusion of Innovations Theory), context or both. Relevant material included book chapters, a Web-based process evaluation, and peer reviewed reports of projects sharing a common ancestry. We used these reports to understand the context for the intervention and to explore explanations for its relative lack of success. Additional data helped us to challenge simplistic assumptions on the homogeneity of the target population.
Conclusions: A single case study suggests the potential utility of cluster searching, particularly for reviews that depend on an understanding of context, e.g. realist synthesis. The methodology is transparent, explicit and reproducible. There is no reason to believe that cluster searching is not generalizable to other review topics. Further research should examine the contribution of the methodology beyond improved yield, to the final synthesis and interpretation, possibly by utilizing qualitative sensitivity analysis.
Figures

Similar articles
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
Beyond the black stump: rapid reviews of health research issues affecting regional, rural and remote Australia.Med J Aust. 2020 Dec;213 Suppl 11:S3-S32.e1. doi: 10.5694/mja2.50881. Med J Aust. 2020. PMID: 33314144
-
The Effectiveness of Integrated Care Pathways for Adults and Children in Health Care Settings: A Systematic Review.JBI Libr Syst Rev. 2009;7(3):80-129. doi: 10.11124/01938924-200907030-00001. JBI Libr Syst Rev. 2009. PMID: 27820426
-
CLUSTER searching approach to inform evidence syntheses: A methodological review.Res Synth Methods. 2021 Sep;12(5):576-589. doi: 10.1002/jrsm.1502. Epub 2021 Jul 16. Res Synth Methods. 2021. PMID: 34089291 Review.
-
Intervention Now to Eliminate Repeat Unintended Pregnancy in Teenagers (INTERUPT): a systematic review of intervention effectiveness and cost-effectiveness, and qualitative and realist synthesis of implementation factors and user engagement.Health Technol Assess. 2016 Feb;20(16):1-214. doi: 10.3310/hta20160. Health Technol Assess. 2016. PMID: 26931051 Free PMC article. Review.
Cited by
-
Applicability of evidence from randomized controlled trials and systematic reviews to clinical practice: A conceptual review.J Rehabil Med. 2021 Jun 3;53(6):jrm00202. doi: 10.2340/16501977-2843. J Rehabil Med. 2021. PMID: 33977305 Free PMC article.
-
Improving access to general practice for people with severe and multiple disadvantage: a realist review protocol (The Connection Study).Wellcome Open Res. 2023 Oct 11;8:331. doi: 10.12688/wellcomeopenres.19460.2. eCollection 2023. Wellcome Open Res. 2023. PMID: 38074196 Free PMC article.
-
Searching for the Impact of Participation in Health and Health Research: Challenges and Methods.Biomed Res Int. 2018 May 13;2018:9427452. doi: 10.1155/2018/9427452. eCollection 2018. Biomed Res Int. 2018. PMID: 29862298 Free PMC article. Review.
-
How stakeholder participation can contribute to systematic reviews of complex interventions.J Epidemiol Community Health. 2016 Feb;70(2):207-14. doi: 10.1136/jech-2015-205701. Epub 2015 Oct 16. J Epidemiol Community Health. 2016. PMID: 26475921 Free PMC article. Review.
-
Sustaining community-based interventions for people affected by dementia long term: the SCI-Dem realist review.BMJ Open. 2021 Jul 7;11(7):e047789. doi: 10.1136/bmjopen-2020-047789. BMJ Open. 2021. PMID: 34233990 Free PMC article. Review.
References
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources