Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations

Contemporary Educational Psychology - Tập 25 Số 3 - Trang 241-286 - 2000
Stephen Olejnik1, James Algina
1University of Georgia;

Tóm tắt

Từ khóa


Tài liệu tham khảo

1994

Bauman, 1992, Effect of think-aloud instruction on elementary students' comprehension monitoring abilities, Journal of Reading, 24, 143

Carroll, 1975, Sampling characteristics of Kelley's ϵ2 and Hays' ω2, Educational and Psychological Measurement, 35, 541, 10.1177/001316447503500304

Carver, 1978, The case against statistical significance testing, Harvard Educational Review, 48, 378, 10.17763/haer.48.3.t490261645281841

Carver, 1993, The case against statistical significance testing, revisted, Journal of Experimental Education, 61, 287, 10.1080/00220973.1993.10806591

Cohen, 1965, Some statistical issues in psychological research, 95

Cohen, 1969

Cohen, 1988

Cohen, 1994, The earth is round (p < .05), American Psychologist, 49, 997, 10.1037/0003-066X.49.12.997

Cramer, 1979, Some symmetric invariant measures of multivariate association, Psychometrika, 44, 43, 10.1007/BF02293783

1986

Dodd, 1973, Computational procedures for estimating magnitude of effect for some analysis of variance designs, Psychological Bulletin, 79, 391, 10.1037/h0034347

Dunlap, 1996, Meta-analysis of experiments with matched groups or repeated measures designs, Psychological Methods, 1, 170, 10.1037/1082-989X.1.2.170

Dwyer, 1974, Analysis of variance and the magnitude of effects, Psychological Bulletin, 81, 731, 10.1037/h0036937

Feldt, 1973, What size samples for methods/materials experiments?, Journal of Educational Measurement, 10, 221, 10.1111/j.1745-3984.1973.tb00800.x

Fern, 1996, Effect-size estimates: Issues and problems in interpretation, Journal of Consumer Research, 23, 89, 10.1086/209469

Frick, 1999, Defending the status quo, Theory & Psychology, 9, 183, 10.1177/095935439992002

Friedman, 1968, Magnitude of experimental effect and a table for its rapid estimation, Psychological Bulletin, 70, 245, 10.1037/h0026258

Gaebelein, 1978, The utility of within-subjects variables: Estimates of strength, Educational and Psychological Measurement, 38, 351, 10.1177/001316447803800216

Glass, 1976, Primary, secondary, and meta-analysis of research, Educational Researcher, 5, 3, 10.3102/0013189X005010003

Glass, 1969, Measures of association in comparative experiments: Their development and interpretation, American Educational Research Journal, 6, 403, 10.3102/00028312006003403

Glass, 1981

Hays, 1963

Hedges, 1981, Distributional theory for Glass's estimator of effect size and related estimators, Journal of Educational Statistics, 6, 107, 10.2307/1164588

Huberty, 1972, Multivariate indices of strength of association, Multivariate Behavioral Research, 7, 523, 10.1207/s15327906mbr0704_8

Huberty, 1994

Hunter, 1997, Needed: A ban on the significance test, Psychological Science, 8, 3, 10.1111/j.1467-9280.1997.tb00534.x

Kelley, 1935, An unbiased correlation ratio measure, Proceedings of the National Academy of Sciences, 21, 554, 10.1073/pnas.21.9.554

Keppel, 1991

Keren, 1979, Partial omega squared for ANOVA designs, Educational and Psychological Measurement, 39, 119, 10.1177/001316447903900116

Keselman, 1998, Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA and ANCOVA analyses, Review of Educational Research, 68, 350, 10.3102/00346543068003350

Kirk, 1982

Kirk, 1996, Practical significance: A concept whose time has come, Educational and Psychological Measurement, 56, 746, 10.1177/0013164496056005002

Levin, 1967, Misinterpreting the significance of “explained variation.”, American Psychologist, 22, 675, 10.1037/h0037681

Levin, 1999, Further reflections on hypothesis testing and editorial policy for primary research journals, Educational Psychology Review, 11, 143, 10.1023/A:1022076425749

Maxwell, 1981, Measures of strength of association: A comparative examination, Journal of Applied Psychology, 66, 525, 10.1037/0021-9010.66.5.525

Maxwell, 1990

McGraw, 1992, A common language effect size statistic, Psychological Bulletin, 111, 361, 10.1037/0033-2909.111.2.361

McNamara, 1978, Practical significance and statistical models, Educational Administration Quarterly, 14, 48, 10.1177/0013161X7801400107

Mitchell, 1981, A cautionary note on the use of omega squared to evaluate the effectiveness of behavioral treatments, Behavioral Assessment, 3, 93

Morris, 1997, Correcting effect sizes computed from factorial analysis of variance for use in meta-analysis, Psychological Methods, 2, 192, 10.1037/1082-989X.2.2.192

Murray, 1987, How significant is a significant difference? Problems with the measurement of magnitude of effect, Journal of Counseling Psychology, 34, 68, 10.1037/0022-0167.34.1.68

Nist, 1995, The role of context and dictionary definitions on varying levels of word knowledge, Reading Research Quarterly, 30, 172, 10.2307/748031

O'Grady, 1982, Measures of explained variance: Cautions and limitations, Psychological Bulletin, 92, 766, 10.1037/0033-2909.92.3.766

Olejnik, S, &, Huberty, C. J. 1993, April, Preliminary statistical tests. Paper presented at the annual meeting of the American Educational Research Association, Atlanta, GA.

Pearson, 1905

Porter, 1978, Practical significance in program evaluation, American Educational Research Association, 15, 529, 10.3102/00028312015004529

Richardson, 1996, Measures of effect size, Behavioral Research Methods, Instruments, & Computers, 28, 12, 10.3758/BF03203631

Robinson, 1997, Reflections on statistical and substantive significance, with a slice of replication, Educational Researcher, 26, 21

Rosenthal, 1994, Parametric measures of effect size, 231

Rosenthal, 1979, A note on percent variance explained as a measure of the importance of effects, Journal of Applied Social Psychology, 9, 395, 10.1111/j.1559-1816.1979.tb02713.x

Rosenthal, 1982, A simple, general purpose display of magnitude of experimental effect, Journal of Educational Psychology, 74, 166, 10.1037/0022-0663.74.2.166

Rosnow, 1988, Focused tests of significance and effect size estimation in counseling psychology, Journal of Counseling Psychology, 35, 203, 10.1037/0022-0167.35.2.203

Sachdeva, 1973, Estimating strength of relationship in multivariate analysis of variance, Educational and Psychological Measurement, 33, 627, 10.1177/001316447303300311

Sechrest, 1982, Magnitudes of experimental effects in social science research, Evaluation Review, 6, 579, 10.1177/0193841X8200600501

Serlin, 1982, A multivariate measure of association based on the Pillai–Bartlett procedure, Psychological Bulletin, 91, 413, 10.1037/0033-2909.91.2.413

Schmidt, 1992, What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology, American Psychologist, 47, 1173, 10.1037/0003-066X.47.10.1173

Smith, 1972, The ETA coefficient in MANOVA, Multivariate Behavioral Research, 7, 361, 10.1207/s15327906mbr0703_6

Stevens, 1972, Global measures of association in multivariate analysis of variance, Multivariate Behavioral Research, 7, 373, 10.1207/s15327906mbr0703_7

Stevens, 1996

Strube, 1988, Some comments on the use of magnitude-of-effect estimates, Journal of Counseling Psychology, 35, 342, 10.1037/0022-0167.35.3.342

Tatsuoka, 1988

Thompson, 1996, AERA editorial policies regarding statistical significance testing: Three suggested reforms, Educational Researcher, 25, 26

Thompson, 1997, Editorial policies regarding statistical significance tests: Further comments, Educational Researcher, 26, 29, 10.3102/0013189X026005029

Thompson, 1999, If statistical significance tests are broken/misused, what practices should supplement or replace them?, Theory & Psychology, 9, 165, 10.1177/095935439992006

Thompson, 1999, Journal editorial policies regarding statistical significance tests: Heat is to fire as p is to importance, Educational Psychology Review, 11, 157, 10.1023/A:1022028509820

Vaughan, 1969, Beyond tests of significance: Estimating strength of effects in selected ANOVA designs, Psychological Bulletin, 72, 204, 10.1037/h0027878

Wilkinson, 1999, Statistical methods in psychology journals: Guidelines and explanations, American Psychologist, 54, 549, 10.1037/0003-066X.54.8.594

Yeaton, 1981, Meaningful measures of effect, Journal of Consulting and Clinical Psychology, 49, 766, 10.1037/0022-006X.49.5.766