Selecting and appraising studies for a systematic review
- PMID: 9313021
- DOI: 10.7326/0003-4819-127-7-199710010-00005
Selecting and appraising studies for a systematic review
Abstract
After thoroughly searching the potentially relevant literature for a systematic review, reviewers face the sequential tasks of selecting studies for inclusion and appraising these studies. Methodical, impartial, and reliable strategies are necessary for these two tasks because systematic reviews are retrospective exercises and are therefore prone to both bias and random error. To plan for study selection, reviewers begin with a focused clinical question and choose selection criteria that reflect this question. A detailed selection protocol that specifies the study designs and publication status of articles to be included is often helpful. Selection criteria are itemized on customized forms and are used to examine each potentially relevant primary study, usually by two different reviewers. In planning the critical appraisal of included studies, reviewers decide which clinical and methodologic study features require documentation. After choosing methods for evaluating study quality, reviewers construct customized appraisal forms and an explicit protocol for the actual evaluation. Some of the techniques commonly used to minimize the potential for error in study appraisal include duplicate, independent examination; blinding to study results and other identifying features of each article; and correspondence with study authors to clarify issues. Ultimately, primary studies should be selected, appraised, and reported in sufficient detail to allow readers to judge the applicability of the review to clinical practice and to clarify the strength of the inferences that can be drawn from the review.
Similar articles
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
The Effectiveness of Integrated Care Pathways for Adults and Children in Health Care Settings: A Systematic Review.JBI Libr Syst Rev. 2009;7(3):80-129. doi: 10.11124/01938924-200907030-00001. JBI Libr Syst Rev. 2009. PMID: 27820426
-
Recovery schools for improving behavioral and academic outcomes among students in recovery from substance use disorders: a systematic review.Campbell Syst Rev. 2018 Oct 4;14(1):1-86. doi: 10.4073/csr.2018.9. eCollection 2018. Campbell Syst Rev. 2018. PMID: 37131375 Free PMC article.
-
A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews.Int J Nurs Stud. 2009 Apr;46(4):529-46. doi: 10.1016/j.ijnurstu.2009.01.009. Epub 2009 Feb 23. Int J Nurs Stud. 2009. PMID: 19233357 Review.
-
A Process for Robust and Transparent Rating of Study Quality: Phase 1 [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2011 Nov. Report No.: 12-EHC004-EF. Rockville (MD): Agency for Healthcare Research and Quality (US); 2011 Nov. Report No.: 12-EHC004-EF. PMID: 22191113 Free Books & Documents. Review.
Cited by
-
Antimicrobial agent exposure and the emergence and spread of resistant microorganisms: issues associated with study design.Eur J Clin Microbiol Infect Dis. 2013 May;32(5):581-95. doi: 10.1007/s10096-012-1795-3. Epub 2012 Dec 27. Eur J Clin Microbiol Infect Dis. 2013. PMID: 23268203 Review.
-
The effect of swaddling on infant sleep and arousal: A systematic review and narrative synthesis.Front Pediatr. 2022 Nov 30;10:1000180. doi: 10.3389/fped.2022.1000180. eCollection 2022. Front Pediatr. 2022. PMID: 36533224 Free PMC article. Review.
-
Does precut technique improve selective bile duct cannulation or increase post-ERCP pancreatitis rate? A meta-analysis of randomized controlled trials.Surg Endosc. 2010 Nov;24(11):2670-80. doi: 10.1007/s00464-010-1033-y. Epub 2010 Apr 23. Surg Endosc. 2010. PMID: 20414680 Review.
-
The effects of long-term total parenteral nutrition on gut mucosal immunity in children with short bowel syndrome: a systematic review.BMC Nurs. 2005 Feb 1;4(1):2. doi: 10.1186/1472-6955-4-2. BMC Nurs. 2005. PMID: 15686591 Free PMC article.
-
Outcome measures utilized in clinical trials of interventions for post-cardiac arrest syndrome: a systematic review.Resuscitation. 2009 Jun;80(6):617-23. doi: 10.1016/j.resuscitation.2009.03.014. Epub 2009 Apr 21. Resuscitation. 2009. PMID: 19386408 Free PMC article. Review.
MeSH terms
LinkOut - more resources
Full Text Sources