Six statistical issues in scientific writing that might lead to rejection of a manuscript

Agathokleous E (2022) Mastering the scientific peer review process: tips for young authors from a young senior editor. J Res 33:1–20 Agathokleous E, Saitanis CJ (2020) Plant susceptibility to ozone: a tower of Babel? Sci Total Environ 703:134962. https://doi.org/10.1016/j.scitotenv.2019.134962 Agathokleous E, Paoletti E, Saitanis CJ, Manning WJ, Sugai T, Koike T (2016) Impacts of ethylene diurea (EDU) soil drench and foliar spray in Salix sachalinensis protection against O3-induced injury. Sci Total Environ 573:1053–1062 Alexander BCS, Davis AS (2022) Perspective: Scientific rigor or ritual? statistical significance in pest management science. Pest Manag Sci 78:847–854 Amrhein V, Greenland S, McShane B (2019) Retire statistical significance. Nature 567:305–307 Armstrong RARA (2014) When to use the Bonferroni correction. Ophthal Physiol Opt 34:502–508 Binkley D, Fernandez ME, Fredricksen T, Mäkinen H, Prescott C, Tomé M (2020) How to avoid having your manuscript rejected: Perspectives from the Editors of Forest Ecology and Management. For Ecol Manage 473:118321 Butler RC (2021) Popularity leads to bad habits: Alternatives to “the statistics” routine of significance, “alphabet soup” and dynamite plots. Ann Appl Biol 180:182–195 Connor JT (2004) The value of a p-valueless paper. Am J Gastroenterol 99:1638–1640 Cottenie K, De Meester L (2003) Comment to Oksanen (2001): reconciling Oksanen (2001) and Hurlbert (1984). Oikos 100:394–396 Dorey F (2011) Statistics in brief: Interpretation and use of p values: all p values are not equal. Clin Orthop Relat Res 469:3259–3261 Fanelli D (2010) Do pressures to publish increase scientists’ bias? An empirical support from US States data. PLoS One 5:e10271. https://doi.org/10.1371/journal.pone.0010271 Goodman S (2008) A dirty dozen: twelve p-value misconceptions. Semin Hematol 45:135–140 Hawkins CP (1986) Pseudo-understanding of pseudoreplication: a cautionary note. Bull Ecol Soc Am 67:184–185 Heffner RA, Butler MJ IV, Reilly CK (1996) Pseudoreplication revisited. Ecology 77:2558–2562 Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70 Hurlbert SH (1984) Pseudoreplication and the design of ecological field experiments. Ecol Monogr 54:187–211 Hurlbert SH (2004) On misinterpretations of pseudoreplication and related matters: a reply to Oksanen. Oikos 104:591–597 Hurlbert SH (2013) Pseudofactorialism, response structures and collective responsibility. Austral Ecol 38:646–663 Johnson VE (2013) Revised standards for statistical evidence. Proc Natl Acad Sci USA 110:19313–19317 Kozak M, Powers SJ (2017) If not multiple comparisons, then what? Ann Appl Biol 171:277–280 Kramer MH, Paparozzi ET, Stroup WW (2016) Statistics in a horticultural journal: problems and solutions. Hort Sci 51:1073–1078 Kukull WA (2020) Association, cause, and causal association, revised: reasoning and methods. Rosenberg’s Mol Genet Basis Neurol Psychiatr Dis 65:121–128 Lew MJ (2012) Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don’t know P. Br J Pharmacol 166:1559–1567 Masicampo EJ, Lalande DR (2012) A peculiar prevalence of p values just below.05. Q J Exp Psychol 65:2271–2279 Muff S, Nilsen EB, O’Hara RB, Nater CR (2022a) Response to ‘Why P-values are not measures of evidence’ by D Lakens. Trends Ecol Evol 37:291–292 Muff S, Nilsen EB, O’Hara RB, Nater CR (2022b) Rewriting results sections in the language of evidence. Trends Ecol Evol 37:203–210 Nakagawa S (2004) A farewell to Bonferroni: the problems of low statistical power and publication bias. Behav Ecol 15:1044–1045 Nuzzo R (2014) Scientific method: statistical errors. Nature 506:150–152 Oksanen L (2001) Logic of experiments in ecology: is pseudoreplication a pseudoissue? Oikos 94:27–38 Potvin C, Tardif S (1988) Sources of variability and experimental designs in growth chambers. Funct Ecol 2:123 Powers SJ, Kozak M (2019) Repeated measures: There’s added value in modelling over time. Ann Appl Biol 175:129–135 Rillig MC, Ryo M, Lehmann A, Aguilar-Trigueros C, Buchert S, Wulf A, Iwasaki A, Roy J, Yang G (2019) The role of multiple global change factors in driving soil functions and microbial biodiversity. Science 366:886–890 Rillig MC, Ryo M, Lehmann A (2021) Classifying human influences on terrestrial ecosystems. Glob Chang Biol 27:2273–2278 Rosnow RL, Rosenthal R (1989) Statistical procedures and the justification of knowledge in psychological science. Am Psychol 44:1276–1284 Ruxton GD, Beauchamp G (2008) Time for some a priori thinking about post hoc testing. Behav Ecol 19:690–693 Sellke T, Bayarri MJ, Berger JO (2001) Calibration of p values for testing precise null hypotheses. Am Stat 55:62–71 Senn S (2001) Two cheers for P-values? J Epidemiol Biostat 6:193–204 Solla F, Tran A, Bertoncelli D, Musoff C, Bertoncelli CM (2018) Why a p-value is not enough. Clin Spine Surg 31:385–388 Stovitz SD, Verhagen E, Shrier I (2019) Distinguishing between causal and non-causal associations: implications for sports medicine clinicians. Br J Sports Med 53:398–399 Sullivan GM, Feinn R (2012) Using effect size—or why the P value is not enough. J Grad Med Educ 4:279–282 Wiens S, Nilsson ME (2017) Performing contrast analysis in factorial designs: from nhst to confidence intervals and beyond. Educ Psychol Meas 77:690–715 Ziliak ST, McCloskey DN (2008) The cult of statistical significance : how the standard error costs us jobs, justice, and lives, 1st edn. University of Michigan Press APA (2019) Publication Manual of The American Psychological Association, 7th Edition. The American Psychological Association. Lenhard W, Lenhard A (2016) Computation of effect sizes. Retrieved from: https://www.psychometrica.de/effect_size.html. Psychometrica.