Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Dec;9(4):510-520.
doi: 10.1002/jrsm.1279. Epub 2017 Nov 28.

Evaluation of a new method for librarian-mediated literature searches for systematic reviews

Wichor M Bramer  1 , Melissa L Rethlefsen  2 , Frans Mast  1 , Jos Kleijnen  3   4
Affiliations

Evaluation of a new method for librarian-mediated literature searches for systematic reviews

Wichor M Bramer et al. Res Synth Methods. 2018 Dec.

Abstract

To evaluate and validate the time of completion and results of a new method of searching for systematic reviews, the exhaustive search method (ESM), using a pragmatic comparison.

Methods: Single-line search strategies were prepared in a text document. Term completeness was ensured with a novel optimization technique. Macros in MS Word converted the syntaxes between databases and interfaces almost automatically. We compared search characteristics, such as number of search terms and databases, and outcomes, such as number of included and retrieved references and precision, from ESM searches and other Dutch academic hospitals identified by searching PubMed for systematic reviews published between 2014 and 2016. We compared time to perform the ESM with a secondary comparator of recorded search times from published literature and contact with authors to acquire unpublished data.

Results: We identified 73 published Erasmus MC systematic reviews and 258 published by other Dutch academic hospitals meeting our criteria. We pooled search time data from 204 other systematic reviews. The ESM searches differed by using 2 times more databases, retrieving 44% more references, including 20% more studies in the final systematic review, but the time needed for the search was 8% of that of the control group. Similarities between methods include precision and the number of search terms.

Conclusions: The evaluated similarities and differences suggest that the ESM is a highly efficient way to locate more references meeting the specified selection criteria in systematic reviews than traditional search methods. Further prospective research is required.

Keywords: bibliographic databases; information storage and retrieval; quality improvement; review literature as topic.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Flowchart of the inclusion exclusion process
Figure 2
Figure 2
Number of databases searched
Figure 3
Figure 3
Number of search terms in the Medline search
Figure 4
Figure 4
Total number of references retrieved after deduplication
Figure 5
Figure 5
Number of included references
Figure 6
Figure 6
Precision (# included references/# retrieved references)
Figure 7
Figure 7
Time needed to create search strategies in hours
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Institute of Medicine, Committee on Standards for Systematic Reviews of Comparative Effectiveness Research . Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press; 2011. - PubMed
    1. Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions. West Sussex, UK: Wiley Online Library; 2008, DOI: 10.1002/9780470712184. - DOI
    1. Chandler J, Churchill R, Higgins J, Lasserson T, Tovey D. Methodological standards for the conduct of new Cochrane Intervention Reviews. 2013; Version 2.3:http://editorial-unit.cochrane.org/sites/editorial-unit.cochrane.org/fil.... Accessed 21 December, 2015.
    1. Saleh AA, Ratajeski MA, Bertolet M. Grey literature searching for health sciences systematic reviews: a prospective study of time spent and resources utilized. Evid Based Libr Inf Pract. 2014;9(3):28‐50. 10.18438/B8DW3K - DOI - PMC - PubMed
    1. Erwin PJ. By the clock: how much time does an expert search take? MLA news. 2004;370:1,12

LinkOut - more resources