Effect sizes and p values: What should be reported and what should be replicated?
Tóm tắt
Despite publication of many well‐argued critiques of null hypothesis testing (NHT). behavioral science researchers continue to rely heavily on this set of practices. Although we agree with most critics' catalogs of NHT's flaws, this article also takes the unusual stance of identifying virtues that may explain why NHT continues to he so extensively used. These virtues include providing results in the form of a dichotomous (yes/no) hypothesis evaluation and providing an index (p value) Mini has a justifiable mapping onto confidence in repeatability of a null hypothesis rejection. The most‐criticized flaws of NHT can be avoided when the importance of a hypothesis, rather than the p value of its test, is used to determine that a finding is worthy of report, and when p=.05 is treated as insufficient basis for confidence in the replicability of an isolated non‐null finding. Together with many recent critics of NHT, we also urge reporting of important hypothesis tests in enough descriptive detail to permit secondary uses such as meta‐analysis.
Từ khóa
Tài liệu tham khảo
Campbell D. T.M., 1966, Experimental and quasi‐experimental designs for research
Cohen J., 1997, Statistical power analysis for the behavioral sciences
Cohen J., 1994, The earth is round (p.05), American Psychologist, 49, 997, 10.1037/0003-066X.49.12.997
Fisher R. A., 1951, The design of experiments
Frick R. W., 1995, Accepting the null hypothesis. Memory and Cognition, 132
Gigerenzer G., 1987, Cognition as intuitive statistics
Glass G. V., 1981, Meta‐analysis in social research
Hays W. L., 1995, Statistics
Hedges L. V., 1985, Statistical methods for meta‐analysis
Kirk R. E., 1995, Experimental design: Procedures for the behavioral sciences
Nunnatly J. C., 1975, Introduction to statistics for psychology and education
Oakes M., 1986, Statistical inference
Rosenthal R., 1993, A handbook of data analysis in the behavioral sciences: Methodological issues, 519
Rosnow R. L., 1989, Statistical procedures and the justification of knowledge in psychological research, American Psychologist, 44, 1276, 10.1037/0003-066X.44.10.1276
Serlin R. C., 1993, A handbook of data analysis in the behavioral sciences: Methodological issues, 199