Prospective comparison of search strategies for systematic reviews: an objective approach yielded higher sensitivity than a conceptual one
- PMID: 27256930
- DOI: 10.1016/j.jclinepi.2016.05.002
Prospective comparison of search strategies for systematic reviews: an objective approach yielded higher sensitivity than a conceptual one
Abstract
Background: In the development of search strategies for systematic reviews, "conceptual approaches" are generally recommended to identify appropriate search terms for those parts of the strategies for which no validated search filters exist. However, "objective approaches" based on search terms identified by text analysis are increasingly being applied.
Objectives: To prospectively compare an objective with a conceptual approach for the development of search strategies.
Methods: Two different MEDLINE search strategies were developed in parallel for five systematic reviews covering a range of topics and study designs. The Institute for Quality and Efficiency in Health Care (IQWiG) applied an objective approach, and external experts applied a conceptual approach for the same research questions. For each systematic review, the citations retrieved were combined and the overall pool of citations screened to determine sensitivity and precision.
Results: The objective approach yielded a weighted mean sensitivity and precision of 97% and 5%. The corresponding values for the conceptual approach were 75% and 4%.
Conclusion: Our findings indicate that the objective approach applied by IQWiG for search strategy development yields higher sensitivity than and similar precision to a conceptual approach. The main advantage of the objective approach is that it produces consistent results across searches.
Keywords: Data mining; Information storage and retrieval; Medline; Prospective studies; Reproducibility of results; Sensitivity and specificity.
Copyright © 2016 The Author(s). Published by Elsevier Inc. All rights reserved.
Similar articles
-
Retrieval of overviews of systematic reviews in MEDLINE was improved by the development of an objectively derived and validated search strategy.J Clin Epidemiol. 2016 Jun;74:107-18. doi: 10.1016/j.jclinepi.2015.12.002. Epub 2015 Dec 23. J Clin Epidemiol. 2016. PMID: 26723872
-
Development of search strategies for systematic reviews: validation showed the noninferiority of the objective approach.J Clin Epidemiol. 2015 Feb;68(2):191-9. doi: 10.1016/j.jclinepi.2014.09.016. Epub 2014 Nov 29. J Clin Epidemiol. 2015. PMID: 25464826
-
Optimal search strategies for retrieving systematic reviews from Medline: analytical survey.BMJ. 2005 Jan 8;330(7482):68. doi: 10.1136/bmj.38336.804167.47. Epub 2004 Dec 24. BMJ. 2005. PMID: 15619601 Free PMC article.
-
Developing efficient search strategies to identify reports of adverse effects in MEDLINE and EMBASE.Health Info Libr J. 2006 Mar;23(1):3-12. doi: 10.1111/j.1471-1842.2006.00634.x. Health Info Libr J. 2006. PMID: 16466494 Review.
-
The search and selection for primary studies in systematic reviews published in dental journals indexed in MEDLINE was not fully reproducible.J Clin Epidemiol. 2018 Jun;98:53-61. doi: 10.1016/j.jclinepi.2018.02.011. Epub 2018 Feb 21. J Clin Epidemiol. 2018. PMID: 29476922 Review.
Cited by
-
PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews.Syst Rev. 2021 Jan 26;10(1):39. doi: 10.1186/s13643-020-01542-z. Syst Rev. 2021. PMID: 33499930 Free PMC article.
-
Defining the process to literature searching in systematic reviews: a literature review of guidance and supporting studies.BMC Med Res Methodol. 2018 Aug 14;18(1):85. doi: 10.1186/s12874-018-0545-3. BMC Med Res Methodol. 2018. PMID: 30107788 Free PMC article. Review.
-
Opioid-induced analgesia among persons with opioid use disorder receiving methadone or buprenorphine: A systematic review of experimental pain studies.Drug Alcohol Depend. 2021 Nov 1;228:109097. doi: 10.1016/j.drugalcdep.2021.109097. Epub 2021 Sep 22. Drug Alcohol Depend. 2021. PMID: 34601272 Free PMC article. Review.
-
Evaluation of a new method for librarian-mediated literature searches for systematic reviews.Res Synth Methods. 2018 Dec;9(4):510-520. doi: 10.1002/jrsm.1279. Epub 2017 Nov 28. Res Synth Methods. 2018. PMID: 29073718 Free PMC article.
-
Crystallizations of constructs : Lessons learned from a literature review.Perspect Med Educ. 2018 Jun;7(Suppl 1):21-23. doi: 10.1007/s40037-018-0422-0. Perspect Med Educ. 2018. PMID: 29704168 Free PMC article. No abstract available.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
