The reign of the p -value is over: what alternative analyses could we employ to fill the power vacuum?

Biology Letters - Tập 15 Số 5 - Trang 20190174 - 2019
Lewis G. Halsey1
1University of Roehampton, London SW15 4JD, UK

Tóm tắt

The p -value has long been the figurehead of statistical analysis in biology, but its position is under threat. p is now widely recognized as providing quite limited information about our data, and as being easily misinterpreted. Many biologists are aware of p 's frailties, but less clear about how they might change the way they analyse their data in response. This article highlights and summarizes four broad statistical approaches that augment or replace the p -value, and that are relatively straightforward to apply. First, you can augment your p -value with information about how confident you are in it, how likely it is that you will get a similar p -value in a replicate study, or the probability that a statistically significant finding is in fact a false positive. Second, you can enhance the information provided by frequentist statistics with a focus on effect sizes and a quantified confidence that those effect sizes are accurate. Third, you can augment or substitute p -values with the Bayes factor to inform on the relative levels of evidence for the null and alternative hypotheses; this approach is particularly appropriate for studies where you wish to keep collecting data until clear evidence for or against your hypothesis has accrued. Finally, specifically where you are using multiple variables to predict an outcome through model building, Akaike information criteria can take the place of the p -value, providing quantified information on what model is best. Hopefully, this quick-and-easy guide to some simple yet powerful statistical options will support biologists in adopting new approaches where they feel that the p -value alone is not doing their data justice.

Từ khóa


Tài liệu tham khảo

10.1177/0956797613504966

10.1037/0003-066X.49.12.997

10.1037/h0020412

10.1080/01621459.1942.10501760

10.1038/506150a

10.1038/nmeth.3288

10.1111/j.1745-6924.2008.00079.x

10.1098/rsos.171085

10.1080/00031305.2016.1154108

10.1111/j.1476-5381.2012.01931.x

10.1038/d41586-019-00857-9

10.1037/0003-066X.45.12.1304

10.1214/ss/1177011945

10.1098/rsos.140216

Fisher R, 1959, Statistical methods and scientific inference, 2

10.1198/tas.2011.10129

Lew MJ. 2013 To P or not to P: on the evidential nature of P-values and their place in scientific inference. arXiv 1311.0081.

10.1038/nmeth.3741

10.1038/nmeth.3934

10.1038/s41398-017-0024-3

10.1038/nmeth.4210

10.1037/h0027108

10.2307/3802789

10.1111/j.1469-185X.2007.00027.x

10.3758/BF03204506

10.1890/13-1112.1

10.4324/9781315708607

10.1083/jcb.200611141

10.1890/13-0590.1

10.1890/13-1291.1

10.1080/00031305.2018.1518266

Ho J Tumkaya T Aryal S Choi H Claridge-Chang A. 2018 Moving beyond P values: Everyday data analysis with estimation plots. bioRxiv 377978.

10.1038/jcbfm.2010.116

10.1037/1082-989X.8.3.243

10.1086/313443

10.1037/0033-2909.86.3.638

10.1111/jne.12384

Morey RD et al. 2015 BayesFactor: Computation of Bayes factors for common designs. See https://cran.r-project.org/web/packages/BayesFactor/index.html.

10.1198/000313002137

10.1037/met0000061

10.4249/scholarpedia.5230

10.1097/00001648-200105000-00006

10.1242/jeb.147058

10.1080/19312450701641375

Cohen J, 1988, Statistical power analysis for the behavioural sciences

10.1177/0956797611430953

10.1086/593303

10.1038/nmeth.2900

Sakamoto Y, 1986, Akaike information criterion statistics

10.1007/s00265-010-1029-6

10.1007/s11222-013-9416-2

10.1071/WR99107

10.2193/0022-541X(2006)70[1497:MSHTAR]2.0.CO;2

10.1890/13-1911.1

Popper K, 1963, Conjectures and refutations: the growth of scientific knowledge

10.1037/a0015251

10.1080/00031305.2018.1564697

10.1890/13-1858.1

10.1113/jphysiol.2011.205062

10.1037/h0087426

Fisher RA, 1938, Presidential address to the First Indian Statistical Congress, Sankhya, 4, 14

Thông tin
Thông tin xuất bản

Biology Letters

Tập 15 Số 5

20190174

Thông tin tác giả