Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Apr;29(4):434-440.
doi: 10.1016/j.cmi.2022.07.019. Epub 2022 Aug 4.

How to conduct a systematic review and meta-analysis of prognostic model studies

Johanna A A Damen  1 , Karel G M Moons  2 , Maarten van Smeden  3 , Lotty Hooft  2
Affiliations

How to conduct a systematic review and meta-analysis of prognostic model studies

Johanna A A Damen et al. Clin Microbiol Infect. 2023 Apr.

Abstract

Background: Prognostic models are typically developed to estimate the risk that an individual in a particular health state will develop a particular health outcome, to support (shared) decision making. Systematic reviews of prognostic model studies can help identify prognostic models that need to further be validated or are ready to be implemented in healthcare.

Objectives: To provide a step-by-step guidance on how to conduct and read a systematic review of prognostic model studies and to provide an overview of methodology and guidance available for every step of the review progress.

Sources: Published, peer-reviewed guidance articles.

Content: We describe the following steps for conducting a systematic review of prognosis studies: 1) Developing the review question using the Population, Index model, Comparator model, Outcome(s), Timing, Setting format, 2) Searching and selection of articles, 3) Data extraction using the Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS) checklist, 4) Quality and risk of bias assessment using the Prediction model Risk Of Bias ASsessment (PROBAST) tool, 5) Analysing data and undertaking quantitative meta-analysis, and 6) Presenting summary of findings, interpreting results, and drawing conclusions. Guidance for each step is described and illustrated using a case study on prognostic models for patients with COVID-19.

Implications: Guidance for conducting a systematic review of prognosis studies is available, but the implications of these reviews for clinical practice and further research highly depend on complete reporting of primary studies.

Keywords: Meta-analysis; Prediction model; Prognosis; Prognostic model; Systematic review.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Review steps. References: the Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies [23], Population, Index model, Comparartor model, Outcome(s) model, Timing, Setting [30], search filters [31,32], Prediction model Risk Of Bias ASsessment tool [24,33], meta-analysis [30,34], the Preferred Items for Systematic Reviews and Meta-analyses guidelines [35], Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis statement [36,37].
Fig. 2
Fig. 2
Risk of bias as assessed using the Prediction model Risk Of Bias Assessment tool. The figure represents the percentage of studies scoring a low (green), high (red), or unclear (orange) risk of bias for each of the four Prediction model Risk Of Bias ASsessment domains and the overall risk of bias.
Fig. 3
Fig. 3
Forest plots of the Observed Expected ratio and c-statistic of the Pooled Cohort Equations for predicting 10-year risk of cardiovascular disease in women in the general population. ∗Performance of the model in the development study after internal validation. The first row contains the performance of the White model, the second the African American model (not included in the pooled estimate of performance).
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Moons K.G., Royston P., Vergouwe Y., Grobbee D.E., Altman D.G. Prognosis and prognostic research: what, why, and how? BMJ. 2009;338:b375. - PubMed
    1. Moons K.G., Kengne A.P., Woodward M., Royston P., Vergouwe Y., Altman D.G., et al. Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart. 2012;98:683–690. - PubMed
    1. Steyerberg E. Springer Science & Business Media; Berlin, Germany: 2008. Clinical prediction models: a practical approach to development, validation, and updating.
    1. Riley R.D., van der Windt D., Croft P., Moons K.G. Oxford University Press; Oxford, UK: 2019. Prognosis research in healthcare: concepts, methods, and impact.
    1. Moons K.G., Hooft L., Williams K., Hayden J.A., Damen J.A., Riley R.D. Implementing systematic reviews of prognosis studies in Cochrane. Cochrane Database Syst Rev. 2018;10:Ed000129. - PMC - PubMed

LinkOut - more resources