A survey of residual analysis and a new test of residual trend
- PMID: 27193244
- DOI: 10.1002/jeab.208
A survey of residual analysis and a new test of residual trend
Abstract
A survey of residual analysis in behavior-analytic research reveals that existing methods are problematic in one way or another. A new test for residual trends is proposed that avoids the problematic features of the existing methods. It entails fitting cubic polynomials to sets of residuals and comparing their effect sizes to those that would be expected if the sets of residuals were random. To this end, sampling distributions of effect sizes for fits of a cubic polynomial to random data were obtained by generating sets of random standardized residuals of various sizes, n. A cubic polynomial was then fitted to each set of residuals and its effect size was calculated. This yielded a sampling distribution of effect sizes for each n. To test for a residual trend in experimental data, the median effect size of cubic-polynomial fits to sets of experimental residuals can be compared to the median of the corresponding sampling distribution of effect sizes for random residuals using a sign test. An example from the literature, which entailed comparing mathematical and computational models of continuous choice, is used to illustrate the utility of the test.
Keywords: cubic polynomial; descriptive adequacy; model selection; quantitative models; residual trends.
© 2016 Society for the Experimental Analysis of Behavior.
Similar articles
-
Gumbel based p-value approximations for spatial scan statistics.Int J Health Geogr. 2010 Dec 17;9:61. doi: 10.1186/1476-072X-9-61. Int J Health Geogr. 2010. PMID: 21167043 Free PMC article.
-
Residual Normality Assumption and the Estimation of Multiple Membership Random Effects Models.Multivariate Behav Res. 2018 Nov-Dec;53(6):898-913. doi: 10.1080/00273171.2018.1533445. Epub 2018 Dec 6. Multivariate Behav Res. 2018. PMID: 30521398
-
[Meta-analysis of the Italian studies on short-term effects of air pollution].Epidemiol Prev. 2001 Mar-Apr;25(2 Suppl):1-71. Epidemiol Prev. 2001. PMID: 11515188 Italian.
-
Meta-Analytic Statistical Inferences for Continuous Measure Outcomes as a Function of Effect Size Metric and Other Assumptions [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2013 Apr. Report No.: 13-EHC075-EF. Rockville (MD): Agency for Healthcare Research and Quality (US); 2013 Apr. Report No.: 13-EHC075-EF. PMID: 23741762 Free Books & Documents. Review.
-
Effect sizes and statistical testing in the determination of clinical significance in behavioral medicine research.Ann Behav Med. 2004 Apr;27(2):138-45. doi: 10.1207/s15324796abm2702_9. Ann Behav Med. 2004. PMID: 15026298 Review.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical