Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Apr;107(2):210-221.
doi: 10.5195/jmla.2019.567. Epub 2019 Apr 1.

Errors in search strategies used in systematic reviews and their effects on information retrieval

José Antonio Salvador-Oliván  1 , Gonzalo Marco-Cuenca  2 , Rosario Arquero-Avilés  3
Affiliations

Errors in search strategies used in systematic reviews and their effects on information retrieval

José Antonio Salvador-Oliván et al. J Med Libr Assoc. 2019 Apr.

Abstract

Objectives: Errors in search strategies negatively affect the quality and validity of systematic reviews. The primary objective of this study was to evaluate searches performed in MEDLINE/PubMed to identify errors and determine their effects on information retrieval.

Methods: A PubMed search was conducted using the systematic review filter to identify articles that were published in January of 2018. Systematic reviews or meta-analyses were selected from a systematic search for literature containing reproducible and explicit search strategies in MEDLINE/PubMed. Data were extracted from these studies related to ten types of errors and to the terms and phrases search modes.

Results: The study included 137 systematic reviews in which the number of search strategies containing some type of error was very high (92.7%). Errors that affected recall were the most frequent (78.1%), and the most common search errors involved missing terms in both natural language and controlled language and those related to Medical Subject Headings (MeSH) search terms and the non-retrieval of their more specific terms.

Conclusions: To improve the quality of searches and avoid errors, it is essential to plan the search strategy carefully, which includes consulting the MeSH database to identify the concepts and choose all appropriate terms, both descriptors and synonyms, and combining search techniques in the free-text and controlled-language fields, truncating the terms appropriately to retrieve all their variants.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Flow chart of included studies
See this image and copyright information in PMC

Comment in

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Eden J, Levit L, Berg A, Morton S, editors. Finding what works in health care: standards for systematic reviews. Washington, DC: National Academies Press; 2011. p. 340. - DOI - PubMed
    2. Eden J, Levit L, Berg A, Morton S, eds. Finding what works in health care: standards for systematic reviews. Washington, DC: National Academies Press; 2011. 340 p. DOI: 10.17226/13059. - DOI
    1. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009 Oct;62(10):e1–34. - PubMed
    2. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009 Oct;62(10):e1–34.
    1. Lefevre C, Manheimer E, Glanville J. Searching for studies. In: Higgins J, Green S, editors. Cochrane handbook for systematic reviews of interventions [Internet]. Version 5.1.0. West Sussex, England, UK: John Wiley & Sons; 2011. pp. 95–150. [cited 29 May 2018]. < http://handbook-5-1.cochrane.org/>.
    2. Lefevre C, Manheimer E, Glanville J. Searching for studies. In: Higgins J, Green S, eds. Cochrane handbook for systematic reviews of interventions [Internet]. Version 5.1.0. West Sussex, England, UK: John Wiley & Sons; 2011. p. 95–150 [cited 29 May 2018]. <http://handbook-5-1.cochrane.org/>.
    1. Buckland M, Gey F. The relationship between recall and precision. J Am Soc Inf Sci. 1994 Jan;45(1):12–9.
    2. Buckland M, Gey F. The relationship between recall and precision. J Am Soc Inf Sci. 1994 Jan;45(1):12–9.
    1. McGowan J, Sampson M. Systematic reviews need systematic searchers. J Med Libr Assoc. 2005 Jan;93(1):74–80. - PMC - PubMed
    2. McGowan J, Sampson M. Systematic reviews need systematic searchers. J Med Libr Assoc. 2005 Jan;93(1):74–80.

MeSH terms

LinkOut - more resources