Methods for estimating the sampling variance of the standardized mean difference
- PMID: 34914477
- DOI: 10.1037/met0000446
Methods for estimating the sampling variance of the standardized mean difference
Abstract
One of the most widely used effect size indices for meta-analysis in psychology is the standardized mean difference (SMD). The most common way to synthesize a set of estimates of the SMD is to weight them by the inverse of their variances. For this, it is necessary to estimate the corresponding sampling variances. Meta-analysts have a formula for obtaining unbiased estimates of sampling variances, but they often use a variety of alternative, simpler methods. The bias and efficiency of five different methods that have been proposed and that are implemented in different computerized calculation tools are compared and assessed. The data from a set of published meta-analyses are also reanalyzed, calculating the combined estimates and their confidence intervals, as well as estimates of the specific, between-studies variance, using the five estimation methods. This test of sensitivity shows that the results of a meta-analysis can change noticeably depending on the method used to estimate the sampling variance of SMD values, especially under a random-effects model. Some practical recommendations are made about how to choose and implement the methods in calculation resources. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Similar articles
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
Multilevel meta-analysis of single-case experimental designs using robust variance estimation.Psychol Methods. 2024 Jun;29(3):537-560. doi: 10.1037/met0000510. Epub 2022 Jul 4. Psychol Methods. 2024. PMID: 35786985
-
Correction for bias in meta-analysis of little-replicated studies.Methods Ecol Evol. 2018 Mar;9(3):634-644. doi: 10.1111/2041-210X.12927. Epub 2017 Nov 21. Methods Ecol Evol. 2018. PMID: 29938012 Free PMC article.
-
Meta-Analytic Statistical Inferences for Continuous Measure Outcomes as a Function of Effect Size Metric and Other Assumptions [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2013 Apr. Report No.: 13-EHC075-EF. Rockville (MD): Agency for Healthcare Research and Quality (US); 2013 Apr. Report No.: 13-EHC075-EF. PMID: 23741762 Free Books & Documents. Review.
-
An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2012 Nov. Report No.: 12(13)-EHC136-EF. Rockville (MD): Agency for Healthcare Research and Quality (US); 2012 Nov. Report No.: 12(13)-EHC136-EF. PMID: 23326899 Free Books & Documents. Review.
Cited by
-
Heterogeneity estimation in meta-analysis of standardized mean differences when the distribution of random effects departs from normal: A Monte Carlo simulation study.BMC Med Res Methodol. 2023 Jan 17;23(1):19. doi: 10.1186/s12874-022-01809-0. BMC Med Res Methodol. 2023. PMID: 36650428 Free PMC article.
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources