Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review
- PMID: 22611167
- DOI: 10.1136/bmj.e2809
Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review
Abstract
Objective: To assess the reporting, extent, and handling of loss to follow-up and its potential impact on the estimates of the effect of treatment in randomised controlled trials.
Design: Systematic review. We calculated the percentage of trials for which the relative risk would no longer be significant under a number of assumptions about the outcomes of participants lost to follow-up.
Data sources: Medline search of five top general medical journals, 2005-07.
Eligibility criteria: Randomised controlled trials that reported a significant binary primary patient important outcome.
Results: Of the 235 eligible reports identified, 31 (13%) did not report whether or not loss to follow-up occurred. In reports that did give the relevant information, the median percentage of participants lost to follow-up was 6% (interquartile range 2-14%). The method by which loss to follow-up was handled was unclear in 37 studies (19%); the most commonly used method was survival analysis (66, 35%). When we varied assumptions about loss to follow-up, results of 19% of trials were no longer significant if we assumed no participants lost to follow-up had the event of interest, 17% if we assumed that all participants lost to follow-up had the event, and 58% if we assumed a worst case scenario (all participants lost to follow-up in the treatment group and none of those in the control group had the event). Under more plausible assumptions, in which the incidence of events in those lost to follow-up relative to those followed-up is higher in the intervention than control group, results of 0% to 33% trials were no longer significant.
Conclusion: Plausible assumptions regarding outcomes of patients lost to follow-up could change the interpretation of results of randomised controlled trials published in top medical journals.
Similar articles
-
LOST to follow-up Information in Trials (LOST-IT): a protocol on the potential impact.Trials. 2009 Jun 11;10:40. doi: 10.1186/1745-6215-10-40. Trials. 2009. PMID: 19519891 Free PMC article.
-
Treatment of missing data in follow-up studies of randomised controlled trials: A systematic review of the literature.Clin Trials. 2017 Aug;14(4):387-395. doi: 10.1177/1740774517703319. Epub 2017 Apr 6. Clin Trials. 2017. PMID: 28385071 Review.
-
Bias and Loss to Follow-Up in Cardiovascular Randomized Trials: A Systematic Review.J Am Heart Assoc. 2020 Jul 21;9(14):e015361. doi: 10.1161/JAHA.119.015361. Epub 2020 Jul 9. J Am Heart Assoc. 2020. PMID: 32646264 Free PMC article.
-
Behavioral and Pharmacotherapy Weight Loss Interventions to Prevent Obesity-Related Morbidity and Mortality in Adults: An Updated Systematic Review for the U.S. Preventive Services Task Force [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. PMID: 30354042 Free Books & Documents. Review.
-
The fragility of statistically significant findings in randomised controlled anaesthesiology trials: systematic review of the medical literature.Br J Anaesth. 2018 May;120(5):935-941. doi: 10.1016/j.bja.2018.01.012. Epub 2018 Feb 13. Br J Anaesth. 2018. PMID: 29661411
Cited by
-
Tonsillectomy compared with conservative management in patients over 16 years with recurrent sore throat: the NATTINA RCT and economic evaluation.Health Technol Assess. 2023 Dec;27(31):1-195. doi: 10.3310/YKUR3660. Health Technol Assess. 2023. PMID: 38204203 Free PMC article. Clinical Trial.
-
The Reverse Fragility Index: Interpreting the Evidence for Arthroscopic Rotator Cuff Repair Healing Associated With Early Versus Delayed Mobilization.HSS J. 2024 May;20(2):254-260. doi: 10.1177/15563316231157760. Epub 2023 Mar 9. HSS J. 2024. PMID: 39281999
-
Colonic preparation before colonoscopy in constipated and non-constipated patients: a randomized study.World J Gastroenterol. 2013 Aug 21;19(31):5103-10. doi: 10.3748/wjg.v19.i31.5103. World J Gastroenterol. 2013. PMID: 23964144 Free PMC article. Clinical Trial.
-
Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map.Trials. 2020 Jun 5;21(1):478. doi: 10.1186/s13063-020-04358-3. Trials. 2020. PMID: 32498690 Free PMC article. Review.
-
Impact of missing participant data for dichotomous outcomes on pooled effect estimates in systematic reviews: a protocol for a methodological study.Syst Rev. 2014 Nov 26;3:137. doi: 10.1186/2046-4053-3-137. Syst Rev. 2014. PMID: 25423894 Free PMC article.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources