Methodology over metrics: current scientific standards are a disservice to patients and society

Journal of Clinical Epidemiology - Tập 138 - Trang 219-226 - 2021
Ben Van Calster1,2,3, Laure Wynants1,3,4, Richard D Riley5, Maarten van Smeden6, Gary S Collins7,8,9
1Department of Development and Regeneration, KU Leuven, Leuven, Belgium
2Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, Netherlands
3EPI-centre, KU Leuven, Leuven, Belgium
4Department of Epidemiology, CAPHRI Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands
5Centre for Prognosis Research, School of Medicine, Keele University, Keele, UK
6Julius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, the Netherlands
7Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Musculoskeletal Sciences, University of Oxford, Oxford, UK
8NIHR Oxford Biomedical Research Centre, John Radcliffe Hospital, Oxford, UK
9UK EQUATOR Centre, Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford, UK

Tài liệu tham khảo

Glasziou, 2020, Waste in covid-19 research, BMJ, 369, m1847, 10.1136/bmj.m1847 Schwab, 2020, Science after Covid-19: faster, better, stronger?, Significance, 4, 8 Wynants, 2020, Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal, BMJ, 369, m1328, 10.1136/bmj.m1328 Alexander, 2020, COVID-19 coronavirus research has overall low methodological quality thus far: case in point for chloroquine/hydroxychloroquine, J Clin Epidemiol, 123, 120, 10.1016/j.jclinepi.2020.04.016 Chalmers, 2009, Avoidable waste in the production and reporting of research evidence, Lancet, 374, 86, 10.1016/S0140-6736(09)60329-9 Englund, 2020, Rise and fall: Hydroxychloroquine and COVID-19 global trends: interest, political influence, and potential implications, ACR Open Rheumatol, 2, 760, 10.1002/acr2.11207 Altman, 1994, The scandal of poor medical research, BMJ, 308, 283, 10.1136/bmj.308.6924.283 Higginson, 2016, Current incentives for scientists lead to underpowered studies with erroneous conclusions, PLOS Biol, 14, 10.1371/journal.pbio.2000995 Rice, 2020, Academic criteria for promotion and tenure in biomedical sciences faculties: cross sectional analysis of international sample of universities, BMJ, 369, m2081, 10.1136/bmj.m2081 Ioannidis, 2014, Increasing value and reducing waste in research design, conduct, and analysis, Lancet, 383, 166, 10.1016/S0140-6736(13)62227-8 Glasziou, 2014, Reducing waste from incomplete or unusable reports of biomedical research, Lancet, 383, 267, 10.1016/S0140-6736(13)62228-X Hemingway, 2009, Ten steps towards improving prognosis research, BMJ, 339, b4184, 10.1136/bmj.b4184 Wang, 2018, Researcher requests for inappropriate analysis and reporting: a U.S. survey of consulting biostatisticians, Ann Intern Med, 169, 554, 10.7326/M18-1230 Begley, 2015, Reproducibility in science: improving the standard for basic and preclinical research, Circ Res, 116, 116, 10.1161/CIRCRESAHA.114.303819 Altman, 2002, How statistical expertise is used in medical research, JAMA, 287, 2817, 10.1001/jama.287.21.2817 Gigerenzer, 1998, We need statistical thinking, not statistical rituals, Behav Brain Sci, 21, 199, 10.1017/S0140525X98281167 Glasziou, 2018, Research waste is still a scandal – an essay by Paul Glasziou and Iain Chalmers, BMJ, 363, k4645, 10.1136/bmj.k4645 Saginur, 2020, Journal impact factor, trial effect size, and methodological quality appear scantly related: a systematic review and meta-analysis, Syst Rev, 9, 53, 10.1186/s13643-020-01305-w Waltman, 2012, Some Limitations of the H Index: a commentary on Ruscio and Colleagues’ analysis of bibliometric indices, Measurement, 10, 172 Koole, 2012, Rewarding replications: a sure and simple way to improve psychological science, Perspect Psychol Sci, 7, 608, 10.1177/1745691612462586 Pereira, 2012, Empirical evaluation of very large treatment effects of medical interventions, JAMA, 308, 1676, 10.1001/jama.2012.13444 Bierer, 2018, Universal funder responsibilities that advance social value, Am J Bioeth, 18, 30, 10.1080/15265161.2018.1523498 Bendiscioli, 2019, The troubles with peer review for allocating research funding, EMBO Rep, 20, e49472, 10.15252/embr.201949472 Moher, 2020, The Hong Kong Principles for assessing researchers: fostering research integrity, PLoS Biol, 18, 10.1371/journal.pbio.3000737 Hardwicke, 2020, How often do leading biomedical journals use statistical experts to evaluate statistical methods? The results of a survey, PLOS One, 15, 10.1371/journal.pone.0239598 Luykx, 1949, Progress without statistics, JAMA, 141, 195, 10.1001/jama.1949.62910030004007 Vassar, 2019, Using the CONSORT statement to evaluate the completeness of reporting of addiction randomised trials: a cross-sectional review, BMJ Open, 9, 10.1136/bmjopen-2019-032024 Peat, 2014, Improving the transparency of prognosis research: the role of reporting, data sharing, registration, and protocols, PLoS Med, 11, 10.1371/journal.pmed.1001671 Fanelli, 2015, Misconduct policies, academic culture and career stage, not gender or pressures to publish, affect scientific integrity, PLoS One, 10, 10.1371/journal.pone.0127556 Head, 2015, The extent and consequences of p-hacking in science, PLoS Biol, 13, 10.1371/journal.pbio.1002106 Dwan, 2014, Evidence for the selective reporting of analyses and discrepancies in clinical trials: a systematic review of cohort studies of clinical trials, PLOS Med, 11, 10.1371/journal.pmed.1001666 Goldacre, 2019, COMPARE: a prospective cohort study correcting and monitoring 58 misreported trials in real time, Trials, 20, 118, 10.1186/s13063-019-3173-2 Boutron, 2020, Spin in scientific publications: a frequent detrimental research practice, Ann Emerg Med, 75, 432, 10.1016/j.annemergmed.2019.11.002 Sumner, 2014, The association between exaggeration in health related science news and academic press releases: retrospective observational study, BMJ, 349, g7015, 10.1136/bmj.g7015 Blümle, 2014, Fate of clinical research studies after ethical approval–follow-up of study protocols until publication, PLoS One, 9, e87184, 10.1371/journal.pone.0087184 Zarin, 2019, Harms from uninformative clinical trials, JAMA, 322, 813, 10.1001/jama.2019.9892 Duyx, 2017, Scientific citations favor positive results: a systematic review and meta-analysis, J Clin Epidemiol, 88, 92, 10.1016/j.jclinepi.2017.06.002 Rubin, 2017, When Does HARKing Hurt? Identifying when different types of undisclosed post hoc hypothesizing harm scientific progress, Rev Gen Psychol, 21, 308, 10.1037/gpr0000128 Yordanov, 2015, Avoidable waste of research related to inadequate methods in clinical trials, BMJ, 350, h809, 10.1136/bmj.h809 Adams-Huet, 2009, Bridging clinical investigators and statisticians: writing the statistical methodology for a research proposal, J Investig Med, 57, 818, 10.2310/JIM.0b013e3181c2996c Delgado-Rodriguez, 2001, Participation of epidemiologists and/or biostatisticians and methodological quality of published controlled clinical trials, J Epidemiol Community Health, 55, 569, 10.1136/jech.55.8.569 Emanuel, 2000, What makes clinical research ethical?, JAMA, 283, 2701, 10.1001/jama.283.20.2701 Odutayo, 2015, Reporting of a publicly accessible protocol and its association with positive study findings in cardiovascular trials (from the Epidemiological Study of Randomized Trials [ESORT]), Am J Cardiol, 116, 1280, 10.1016/j.amjcard.2015.07.046 Savović, 2012, Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials, Ann Intern Med, 157, 429, 10.7326/0003-4819-157-6-201209180-00537 Thompson, 2019, The ego has landed! What can be done about research misconduct, scandals, and spins?, Am J Med, 132, 552, 10.1016/j.amjmed.2018.11.034 Moher, 2016, Increasing value and reducing waste in biomedical research: who's listening?, Lancet, 387, 1573, 10.1016/S0140-6736(15)00307-4 Altman, 2008, EQUATOR: reporting guidelines for health research, Open Med, 2, e49 Nosek, 2015, Scientific standards. Promoting an open research culture, Science, 348, 1422, 10.1126/science.aab2374 Chambers, 2019, What's next for registered reports?, Nature, 573, 187, 10.1038/d41586-019-02674-6 Wilkinson, 2016, The FAIR Guiding Principles for scientific data management and stewardship, Sci Data, 3, 10.1038/sdata.2016.18 Siebert, 2020, Data-sharing recommendations in biomedical journals and randomized controlled trials: an audit of journals following the ICMJE recommendations, BMJ Open, 10, 10.1136/bmjopen-2020-038887 Bradley, 2020, Reducing bias and improving transparency in medical research: a critical overview of the problems, progress so far and suggested next steps, J R Soc Med, 113, 433, 10.1177/0141076820956799 Omar, 2006, Quality research in healthcare: are researchers getting enough statistical support?, BMC Health Serv Res, 6