Inclusion of methodological filters in searches for diagnostic test accuracy studies misses relevant studies
- PMID: 21075596
- DOI: 10.1016/j.jclinepi.2010.07.006
Inclusion of methodological filters in searches for diagnostic test accuracy studies misses relevant studies
Abstract
Objective: To compare the performance of MEDLINE searches using index test(s) and target condition (subject searches) with the same searches combined with methodological filters for test accuracy studies.
Study design and setting: We derived a reference set of 506 test accuracy studies indexed on MEDLINE from seven systematic reviews that conducted extensive searches. We compared the performance of "subject" with "filtered" searches (same searches combined with each of 22 filters). Outcome measures were number of reference set records missed, sensitivity, number needed to read (NNR), and precision (Number of reference set studies identified for every 100 records screened).
Results: Subject searches missed 47 of the 506 reference studies; filtered searches missed an additional 21 to 241 studies. Sensitivity was 91% for subject searches and ranged from 43% to 87% for filtered searches. The NNR was 56 (precision 2%) for subject searches and ranged from 7 to 51 (precision 2-15%) for filtered searches.
Conclusions: Filtered searches miss additional studies compared with searches based on index test and target condition. None of the existing filters provided reductions in the NNR for acceptable sensitivity; currently available methodological filters should not be used to identify studies for inclusion in test accuracy reviews.
Copyright © 2011 Elsevier Inc. All rights reserved.
Comment in
-
Inclusion of methodological filters in searches for diagnostic test accuracy studies misses relevant studies.J Clin Epidemiol. 2012 Jan;65(1):116-7; author reply 117-8. doi: 10.1016/j.jclinepi.2011.02.011. J Clin Epidemiol. 2012. PMID: 22118266 No abstract available.
Similar articles
-
Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE.Cochrane Database Syst Rev. 2013 Sep 11;2013(9):MR000022. doi: 10.1002/14651858.MR000022.pub3. Cochrane Database Syst Rev. 2013. PMID: 24022476 Free PMC article. Review.
-
Inclusion of methodological filters in searches for diagnostic test accuracy studies misses relevant studies.J Clin Epidemiol. 2012 Jan;65(1):116-7; author reply 117-8. doi: 10.1016/j.jclinepi.2011.02.011. J Clin Epidemiol. 2012. PMID: 22118266 No abstract available.
-
Should methodological filters for diagnostic test accuracy studies be used in systematic reviews of psychometric instruments? A case study involving screening for postnatal depression.Syst Rev. 2012 Feb 9;1:9. doi: 10.1186/2046-4053-1-9. Syst Rev. 2012. PMID: 22588034 Free PMC article. Review.
-
Use of methodological search filters to identify diagnostic accuracy studies can lead to the omission of relevant studies.J Clin Epidemiol. 2006 Mar;59(3):234-40. doi: 10.1016/j.jclinepi.2005.07.014. J Clin Epidemiol. 2006. PMID: 16488353 Review.
-
Study filters for non-randomized studies of interventions consistently lacked sensitivity upon external validation.BMC Med Res Methodol. 2018 Dec 18;18(1):171. doi: 10.1186/s12874-018-0625-4. BMC Med Res Methodol. 2018. PMID: 30563471 Free PMC article.
Cited by
-
A systematic review and meta-analysis of studies validating Edinburgh Postnatal Depression Scale in fathers.Heliyon. 2022 May 20;8(5):e09441. doi: 10.1016/j.heliyon.2022.e09441. eCollection 2022 May. Heliyon. 2022. PMID: 35663736 Free PMC article.
-
Mini-Mental State Examination (MMSE) for the early detection of dementia in people with mild cognitive impairment (MCI).Cochrane Database Syst Rev. 2021 Jul 27;7(7):CD010783. doi: 10.1002/14651858.CD010783.pub3. Cochrane Database Syst Rev. 2021. PMID: 34313331 Free PMC article.
-
Clinical symptoms, signs and tests for identification of impending and current water-loss dehydration in older people.Cochrane Database Syst Rev. 2015 Apr 30;2015(4):CD009647. doi: 10.1002/14651858.CD009647.pub2. Cochrane Database Syst Rev. 2015. PMID: 25924806 Free PMC article. Review.
-
Chapter 4: effective search strategies for systematic reviews of medical tests.J Gen Intern Med. 2012 Jun;27 Suppl 1(Suppl 1):S28-32. doi: 10.1007/s11606-011-1873-8. J Gen Intern Med. 2012. PMID: 22648672 Free PMC article.
-
Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) for the diagnosis of delirium in adults in critical care settings.Cochrane Database Syst Rev. 2023 Nov 21;11(11):CD013126. doi: 10.1002/14651858.CD013126.pub2. Cochrane Database Syst Rev. 2023. PMID: 37987526 Free PMC article. Review.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Medical