Quantifying heterogeneity in a meta-analysis
- PMID: 12111919
- DOI: 10.1002/sim.1186
Quantifying heterogeneity in a meta-analysis
Abstract
The extent of heterogeneity in a meta-analysis partly determines the difficulty in drawing overall conclusions. This extent may be measured by estimating a between-study variance, but interpretation is then specific to a particular treatment effect metric. A test for the existence of heterogeneity exists, but depends on the number of studies in the meta-analysis. We develop measures of the impact of heterogeneity on a meta-analysis, from mathematical criteria, that are independent of the number of studies and the treatment effect metric. We derive and propose three suitable statistics: H is the square root of the chi2 heterogeneity statistic divided by its degrees of freedom; R is the ratio of the standard error of the underlying mean from a random effects meta-analysis to the standard error of a fixed effect meta-analytic estimate, and I2 is a transformation of (H) that describes the proportion of total variation in study estimates that is due to heterogeneity. We discuss interpretation, interval estimates and other properties of these measures and examine them in five example data sets showing different amounts of heterogeneity. We conclude that H and I2, which can usually be calculated for published meta-analyses, are particularly useful summaries of the impact of heterogeneity. One or both should be presented in published meta-analyses in preference to the test for heterogeneity.
Copyright 2002 John Wiley & Sons, Ltd.
Similar articles
-
Quantifying, displaying and accounting for heterogeneity in the meta-analysis of RCTs using standard and generalised Q statistics.BMC Med Res Methodol. 2011 Apr 7;11:41. doi: 10.1186/1471-2288-11-41. BMC Med Res Methodol. 2011. PMID: 21473747 Free PMC article.
-
[Application of Stata software to test heterogeneity in meta-analysis method].Zhonghua Liu Xing Bing Xue Za Zhi. 2008 Jul;29(7):726-9. Zhonghua Liu Xing Bing Xue Za Zhi. 2008. PMID: 19031771 Chinese.
-
Alternative measures of between-study heterogeneity in meta-analysis: Reducing the impact of outlying studies.Biometrics. 2017 Mar;73(1):156-166. doi: 10.1111/biom.12543. Epub 2016 May 11. Biometrics. 2017. PMID: 27167143 Free PMC article.
-
The effects of clinical and statistical heterogeneity on the predictive values of results from meta-analyses.Clin Microbiol Infect. 2014 Feb;20(2):123-9. doi: 10.1111/1469-0691.12494. Clin Microbiol Infect. 2014. PMID: 24320992 Review.
-
Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses.Stat Med. 2000 Jul 15;19(13):1707-28. doi: 10.1002/1097-0258(20000715)19:13<1707::aid-sim491>3.0.co;2-p. Stat Med. 2000. PMID: 10861773 Review.
Cited by
-
Comparative evaluation between guided endodontics and conventional techniques for calcific metamorphosis - A systematic review and meta-analysis.J Conserv Dent Endod. 2024 Sep;27(9):891-896. doi: 10.4103/JCDE.JCDE_294_24. Epub 2024 Sep 7. J Conserv Dent Endod. 2024. PMID: 39450363 Free PMC article. Review.
-
The Challenge of Accounting for the Moderator Effect of Risk Exposure on the Effectiveness of Mindfulness-Based Treatments for Youth.Int J Appl Posit Psychol. 2024;9(3):1181-1203. doi: 10.1007/s41042-023-00145-y. Epub 2024 Jan 12. Int J Appl Posit Psychol. 2024. PMID: 39479303 Free PMC article. Review.
-
The current prevalence of child sexual abuse worldwide: a systematic review and meta-analysis.Int J Public Health. 2013 Jun;58(3):469-83. doi: 10.1007/s00038-012-0426-1. Epub 2012 Nov 21. Int J Public Health. 2013. PMID: 23178922 Review.
-
Glutathione S-transferase polymorphisms (GSTM1, GSTT1 and GSTP1) and their susceptibility to renal cell carcinoma: an evidence-based meta-analysis.PLoS One. 2013 May 22;8(5):e63827. doi: 10.1371/journal.pone.0063827. Print 2013. PLoS One. 2013. PMID: 23717494 Free PMC article.
-
The perils of ignoring design effects in experimental studies: lessons from a mammography screening trial.Psychol Health. 2013;28(5):593-602. doi: 10.1080/08870446.2012.756880. Epub 2013 Jan 7. Psychol Health. 2013. PMID: 23289517 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Other Literature Sources
Medical