Lies, damned lies and statistics: Clinical importance versus statistical significance in research

Ioannidis, 2005, Why Most Published Research Findings Are False, PLoS Medicine, 2, 10.1371/journal.pmed.0020124 Nuzzo, 2014, P values, the ‘gold standard’ of statistical validity, are not as reliable as many scientists assume, Nature, 506, 150, 10.1038/506150a Colquhoun, 2014, An investigation of the false discovery rate, and the misinterpretation of p-values, R. Soc. Open Sci., 10.1098/rsos.140216 Wasserstein, 2016, The ASA's Statement on p-Values: Context, Process, and Purpose, The American Statistician, 70, 129, 10.1080/00031305.2016.1154108 Guyatt, 2015 Strauss, 2011 Armitage, 1987, Edition 2 Altman, 1991 Greenland, 2016, Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations, Eur J Epidemiol, 31, 337, 10.1007/s10654-016-0149-3 Goodman, 1999, Toward evidence-based medical statistics. Part 1: The P value fallacy, Ann Intern Med, 130, 995, 10.7326/0003-4819-130-12-199906150-00008 Aschwanden, 2015 Goodman, 2008, A Dirty Dozen: Twelve P-Value Misconceptions, Semin Hematol, 45, 135, 10.1053/j.seminhematol.2008.04.003 Sellke, 2001, Calibration of p Values for Testing Precise Null Hypotheses, The American Statistician, 55, 62, 10.1198/000313001300339950 Ioannidis, 2011, The False-positive to False-negative Ratio in Epidemiologic Studies, Epidemiology, 22, 450, 10.1097/EDE.0b013e31821b506e Ioannidis, 2001, Replication validity of genetic association studies, Nature Genetics, 29, 306, 10.1038/ng749 Ross J. p-value misuse running rampant. The Australian Newspaper, Mar 30, 2016. Ross J. p-value misuse running rampant. The Australian Newspaper, Mar 30, 2016. Ioannidis, 2005, Contradicted and initially stronger effects in highly cited clinical research, JAMA, 294, 218, 10.1001/jama.294.2.218 Button, 2013, Power failure: why small sample size undermines the reliability of neuroscience. Nature Reviews, Neuroscience, 14, 365 Ioannidis, 2014, How to Make More Published Research True, PLOS Medicine, 11, e1001747, 10.1371/journal.pmed.1001747 Chavalarias, 2016, Evolution of Reporting P Values in the Biomedical Literature, 1990–2015, JAMA, 315, 1141, 10.1001/jama.2016.1952 Kyriacou, 2016, Editorial: The Enduring Evolution of the P Value, JAMA, 315, 1113, 10.1001/jama.2016.2152 Trafimow, 2015, Editorial: Announcing ban on p values, & null hypothesis significance testing, Basic and Applied Social Psychology, 37, 1, 10.1080/01973533.2015.1012991 Ioannidis, 1998, Effect of the Statistical Significance of Results on the Time to Completion and Publication of Randomized Efficacy Trials, JAMA, 279, 281, 10.1001/jama.279.4.281 Sullivan, 2012, Using Effect Size—or Why the P Value Is Not Enough, Journal of Graduate Medical Education, 4, 279, 10.4300/JGME-D-12-00156.1 Gardner, 1986, Confidence intervals rather than P values: estimation rather than hypothesis testing, BMJ, 292, 746, 10.1136/bmj.292.6522.746 Fleming, 1996, Surrogate End Points in Clinical Trials: Are We Being Misled?, Ann Intern Med, 125, 605, 10.7326/0003-4819-125-7-199610010-00011 Riggs, 1990, Effect of fluoride on the fracture rate in postmenopausal women with osteoporosis, NEJM, 322, 802, 10.1056/NEJM199003223221203 Horton, 2015, Offline: What is medicine’s 5 sigma?, Lancet, 385, 1380, 10.1016/S0140-6736(15)60696-1 Mayor, 2002, Researchers claim clinical trials are reported with misleading statistics, BMJ, 324, 1353, 10.1136/bmj.324.7350.1353/a Guyatt, 2015 Barratt, 2004, Tips for learners of evidence-based medicine: 1. Relative risk reduction, absolute risk reduction and number needed to treat, CMAJ, 171, 353, 10.1503/cmaj.1021197 Prasad, 2007, Tips for Teachers of Evidence-Based Medicine: Understanding Odds Ratios and Their Relationship to Risk Ratios, J Gen Intern Med, 23, 635, 10.1007/s11606-007-0453-4 Montori, 2004, Tips for learners of evidence-based medicine: 2. Measures of precision (confidence intervals), CMAJ, 171, 611, 10.1503/cmaj.1031667 Armitage, 1987, Edition 2 Altman, 1991 Johnson, 2013, Revised standards for statistical evidence, PNAS, 110, 19313, 10.1073/pnas.1313476110 Morey, 2016, The fallacy of placing confidence in confidence intervals, Psychon Bull Rev, 23, 103, 10.3758/s13423-015-0947-8 Ioannidis, 2008, Why Most Discovered True Associations Are Inflated, Epidemiology, 19, 640, 10.1097/EDE.0b013e31818131e7 Krum, 2003, Why do phase III trials of promising heart failure drugs often fail? The contribution of regression to the truth, J of Cardiac Failure, 9, 364, 10.1054/S1071-9164(03)00018-6 Guyatt, 2015 Hatala, 2005, Tips for learners of evidence-based medicine: 4. Assessing heterogeneity of primary studies in systematic reviews and whether to combine their results, CMAJ, 172, 661, 10.1503/cmaj.1031920 Moher, 2009, Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement, PLoS Med, 6, e1000097, 10.1371/journal.pmed.1000097 Sedgwick, 2013, Meta-analyses: how to read a funnel plot, BMJ, 346, f1342, 10.1136/bmj.f1342 Duval, 2000, Trim and Fill: A Simple Funnel-Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis, BIOMETRIC, 56, 455, 10.1111/j.0006-341X.2000.00455.x Cornell, 2014, Random-Effects Meta-analysis of Inconsistent Effects: A Time for Change, Ann Intern Med, 160, 267, 10.7326/M13-2886 Lawson, 2014, Asthma incidence and risk factors in a national longitudinal sample of adolescent Canadians: a prospective cohort study, BMC Pulmonary Medicine, 14, 51, 10.1186/1471-2466-14-51 Goodman, 1999, Toward evidence based medical statistics 2. The Bayes Factor, Ann Intern Med, 130, 1005, 10.7326/0003-4819-130-12-199906150-00019 Gelman, 2014, The Statistical Crisis in Science, American Scientist, 102, 460, 10.1511/2014.111.460