Validation, updating and impact of clinical prediction rules: a review
- PMID: 19208371
- DOI: 10.1016/j.jclinepi.2008.04.008
Validation, updating and impact of clinical prediction rules: a review
Abstract
Objective: To provide an overview of the research steps that need to follow the development of diagnostic or prognostic prediction rules. These steps include validity assessment, updating (if necessary), and impact assessment of clinical prediction rules.
Study design and setting: Narrative review covering methodological and empirical prediction studies from primary and secondary care.
Results: In general, three types of validation of previously developed prediction rules can be distinguished: temporal, geographical, and domain validations. In case of poor validation, the validation data can be used to update or adjust the previously developed prediction rule to the new circumstances. These update methods differ in extensiveness, with the easiest method a change in model intercept to the outcome occurrence at hand. Prediction rules -- with or without updating -- showing good performance in (various) validation studies may subsequently be subjected to an impact study, to demonstrate whether they change physicians' decisions, improve clinically relevant process parameters, patient outcome, or reduce costs. Finally, whether a prediction rule is implemented successfully in clinical practice depends on several potential barriers to the use of the rule.
Conclusion: The development of a diagnostic or prognostic prediction rule is just a first step. We reviewed important aspects of the subsequent steps in prediction research.
Similar articles
-
Clinical prediction rules to stratify short-term risk of stroke among patients diagnosed in the emergency department with a transient ischemic attack.Ann Emerg Med. 2009 May;53(5):662-73. doi: 10.1016/j.annemergmed.2008.08.004. Epub 2008 Oct 11. Ann Emerg Med. 2009. PMID: 18849093
-
Validating and updating a prediction rule for neurological sequelae after childhood bacterial meningitis.Scand J Infect Dis. 2006;38(1):19-26. doi: 10.1080/00365540500372671. Scand J Infect Dis. 2006. PMID: 16338834
-
Risk prediction models: II. External validation, model updating, and impact assessment.Heart. 2012 May;98(9):691-8. doi: 10.1136/heartjnl-2011-301247. Epub 2012 Mar 7. Heart. 2012. PMID: 22397946 Review.
-
Good generalizability of a prediction rule for prediction of persistent shoulder pain in the short term.J Clin Epidemiol. 2007 Sep;60(9):947-53. doi: 10.1016/j.jclinepi.2006.11.015. Epub 2007 May 4. J Clin Epidemiol. 2007. PMID: 17689811
-
Clinical prediction rules. Applications and methodological standards.N Engl J Med. 1985 Sep 26;313(13):793-9. doi: 10.1056/NEJM198509263131306. N Engl J Med. 1985. PMID: 3897864 Review.
Cited by
-
Geographical validation of the Smart Triage Model by age group.PLOS Digit Health. 2024 Jul 1;3(7):e0000311. doi: 10.1371/journal.pdig.0000311. eCollection 2024 Jul. PLOS Digit Health. 2024. PMID: 38949998 Free PMC article.
-
Validation of the Kidney Failure Risk Equation in the Colombian Population.Int J Nephrol. 2024 Feb 17;2024:1282664. doi: 10.1155/2024/1282664. eCollection 2024. Int J Nephrol. 2024. PMID: 38405300 Free PMC article.
-
Evaluating the Risk of Suicide and Violence in Severe Mental Illness: A Feasibility Study of Two Risk Assessment Tools (OxMIS and OxMIV) in General Psychiatric Settings.Front Psychiatry. 2022 Jun 30;13:871213. doi: 10.3389/fpsyt.2022.871213. eCollection 2022. Front Psychiatry. 2022. PMID: 35845463 Free PMC article.
-
Predicting Real-world Hypoglycemia Risk in American Adults With Type 1 or 2 Diabetes Mellitus Prescribed Insulin and/or Secretagogues: Protocol for a Prospective, 12-Wave Internet-Based Panel Survey With Email Support (the iNPHORM [Investigating Novel Predictions of Hypoglycemia Occurrence Using Real-world Models] Study).JMIR Res Protoc. 2022 Feb 11;11(2):e33726. doi: 10.2196/33726. JMIR Res Protoc. 2022. PMID: 35025756 Free PMC article.
-
Calibration Drift Among Regression and Machine Learning Models for Hospital Mortality.AMIA Annu Symp Proc. 2018 Apr 16;2017:625-634. eCollection 2017. AMIA Annu Symp Proc. 2018. PMID: 29854127 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources