Alternatives to P value: confidence interval and effect size

다국어 초록 (Multilingual Abstract)

The previous articles of the Statistical Round in the Korean Journal of Anesthesiology posed a strong enquiry on the issue of null hypothesis significance testing (NHST). P values lie at the core of NHST and are used to classify all treatments into two groups: “has a significant effect” or “does not have a significant effect.” NHST is frequently criticized for its misinterpretation of relationships and limitations in assessing practical importance. It has now provoked criticism for its limited use in merely separating treatments that “have a significant effect” from others that do not. Effect sizes and CIs expand the approach to statistical thinking. These attractive estimates facilitate authors and readers to discriminate between a multitude of treatment effects. Through this article, I have illustrated the concept and estimating principles of effect sizes and CIs.

참고문헌 (Reference)

1 Thompson B, "What future quantitative social science research could look like: confidence intervals for effect sizes" 31 : 25-32, 2002

2 Stoline MR, "The status of multiple comparisons: simultaneous estimation of all pairwise comparisons in one-way ANOVA designs" 35 : 134-141, 1981

3 Kotrlik JW, "The incorporation of effect size in information technology, learning, and performance research" 21 : 1-7, 2003

4 Warton DI, "The arcsine is asinine: the analysis of proportions in ecology" 92 : 3-10, 2011

5 김태균, "T test as a parametric statistic" 대한마취통증의학회 68 (68): 540-546, 2015

6 Vacha-Haase T, "Statistical significance should not be considered one of life’s guarantees: effect sizes are needed" 61 : 219-224, 2001

7 Cohen J, "Statistical power analysis for the behavioral sciences" Lawrence Erlbaum Publishers 19-27, 1988

8 Cohen J, "Statistical power analysis for the behavioral sciences" Lawrence Erlbaum Publishers 184-185, 1988

9 Hedge LV, "Statistical methods for meta-analysis" Academic Press Inc 86-, 2014

10 이동규, "Standard deviation and standard error of the mean" 대한마취통증의학회 68 (68): 220-223, 2015

11 Kotrlik JW, "Reporting and interpreting effect size in quantitative agricultural education research" 52 : 132-142, 2011

12 Sistrom CL, "Proportions, odds, and risk" 230 : 12-19, 2004

13 Olejnik S, "Measures of effect size for comparative studies: applications, interpretations, and limitations" 25 : 241-286, 2000

14 Tanaka E, "Long-term psychological consequences among adolescent survivors of the Wenchuan earthquake in China: a cross-sectional survey six years after the disaster" 204 : 255-261, 2016

15 Ingelmo PM, "Intraperitoneal nebulization of ropivacaine for pain control after laparoscopic cholecystectomy: a double-blind, randomized, placebo-controlled trial" 110 : 800-806, 2013

16 Vacha-Haase T, "How to estimate and interpret various effect sizes" 51 : 473-481, 2004

17 Olejnik S, "Generalized eta and omega squared statistics: measures of effect size for some common research designs" 8 : 434-447, 2003

18 Szumilas M, "Explaining odds ratios" 13 : 227-229, 2010

19 McGough JJ, "Estimating the size of treatment effects: moving beyond p values" 6 : 21-29, 2009

20 Nakagawa S, "Effect size, confidence interval and statistical significance: a practical guide for biologists" 82 : 591-605, 2007

21 Kelley K, "Confidence intervals for standardized effect sizes: theory, application, and implementation" 20 : 1-24, 2007

22 Kline RB, "Beyond Significance Testing: Reforming data analysis methods in behavioral research" American Psychological Association 114-116, 2004

23 이상석, "Avoiding negative reviewer comments: common statistical errors in anesthesia journals" 대한마취통증의학회 69 (69): 219-226, 2016

24 Ferguson CJ, "An effect size primer: a guide for clinicans and researchers" 40 : 532-538, 2009

25 Rosenthal R, "A simple, general purpose display of magnitude of experimental effect" 74 : 166-169, 1982

26 Thompson B, "'Statistical,' 'practical' and 'clinical': How many kinds of significance do counselors need to consider" 80 : 64-71, 2002