Avoid Cohen’s ‘Small’, ‘Medium’, and ‘Large’ for Power Analysis

Neyman, 1928, On the use and interpretation of certain test criteria for purposes of statistical inference: Part II, Biometrika, 20, 263 Ioannidis, 2005, Why most published research findings are false, PLoS One, 2 Cohen, 1988 Cohen, 1992, A power primer, Psychol. Bull., 112, 155, 10.1037/0033-2909.112.1.155 Gignac, 2016, Effect size guidelines for individual differences researchers, Pers. Individ. Dif., 102, 74, 10.1016/j.paid.2016.06.069 Richard, 2001, “That’s completely obvious... and important”: lay judgments of social psychological findings, Personal. Soc. Psychol. Bull., 27, 497, 10.1177/0146167201274010 Szucs, 2017, Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature, PLoS Biol., 15, 10.1371/journal.pbio.2000797 Funder, 2019, Evaluating effect size in psychological research: sense and nonsense, Adv. Methods Pract. Psychol. Sci., 2, 156, 10.1177/2515245919847202 Schäfer, 2019, The meaningfulness of effect sizes in psychological research: differences between sub-disciplines and the impact of potential biases, Front. Psychol., 10, 1, 10.3389/fpsyg.2019.00813 Tajfel, 1971, Social categorization and intergroup behaviour, Eur. J. Soc. Psychol., 1, 149, 10.1002/ejsp.2420010202 Meyer, 1971, Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations, J. Exp. Psychol., 90, 227, 10.1037/h0031564 Cohen, 1983 Judd, 2017 Faul, 2007, G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences, Behav. Res. Methods, 39, 175, 10.3758/BF03193146 Rosenthal, 1991 McClelland, 1997, Optimal design in psychological research, Psychol. Methods, 2, 3, 10.1037/1082-989X.2.1.3 McClelland, 2000, Increasing statistical power without increasing sample size, Am. Psychol., 55, 963, 10.1037/0003-066X.55.8.963 Lenth, 2001, Some practical guidelines for effective sample size determination, Am. Stat., 55, 187, 10.1198/000313001317098149 Mordkoff, 2019, A simple mopular measure of standardized effect size: adjusted partial eta squared, Adv. Methods Pract. Psychol. Sci., 2, 228, 10.1177/2515245919855053 Perugini, 2018, A practical primer to power analysis for simple experimental designs, Int. Rev. Soc. Psychol., 31, 1, 10.5334/irsp.181 Anderson, 2017, Sample-size planning for more accurate statistical power: a method adjusting sample effect sizes for publication bias and uncertainty, Psychol. Rev., 28, 1547 Mcshane, 2016, Planning sample sizes when effect sizes are uncertain: the power-calibrated effect size approach, Psychol. Methods, 21, 47, 10.1037/met0000036 Kenny, 2019, The unappreciated heterogeneity of effect sizes: implications for power, precision, planning of research, and replication, Psychol. Methods, 24, 578, 10.1037/met0000209 Green, 2016, SIMR: an R package for power analysis of generalized linear mixed models by simulation, Methods Ecol. Evol., 7, 493, 10.1111/2041-210X.12504 Lakens, 2014, Performing high-powered studies efficiently with sequential analyses, Eur. J. Psychol. Assess., 44, 701 O’Keefe, 2007, Brief report: post hoc power, observed power, a priori power, retrospective power, prospective power, achieved power: sorting out appropriate uses of statistical power analyses, Commun. Methods Meas., 1, 291, 10.1080/19312450701641375 Thomas, 1997, Retrospective power analysis, Conserv. Biol., 11, 276, 10.1046/j.1523-1739.1997.96102.x Kruschke, 2011 Kruschke, 2013, Bayesian estimation supersedes the t test, J. Exp. Psychol. Gen., 142, 573, 10.1037/a0029146 Hadfield, 2010, MCMC methods for multi-response generalized linear mixed models: the MCMCglmm R package, J. Stat. Softw., 33, 1, 10.18637/jss.v033.i02