Evaluating Journal Impact Factor: a systematic survey of the pros and cons, and overview of alternative measures

Eugene Mech1, Muhammad Muneeb Ahmed2, Edward Tamale3, Matthew Holek3, Guowei Li4, Lehana Thabane5
1Department of Biochemistry and Biomedical Sciences, McMaster University, Hamilton, ON, Canada.Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada.
2Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada.Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada.
3Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada
4Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada.Center for Clinical Epidemiology and Methodology (CCEM), Guangdong Second Provincial General Hospital, China.
5Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada.Biostatistics Unit, Research Institute at St Joseph's Healthcare, Hamilton, ON, Canada.Department of Anesthesia, McMaster University, Hamilton, ON, Canada.Department of Pediatrics, McMaster University, Hamilton, ON, Canada.School of Nursing, McMaster University, Hamilton, ON, Canada.School of Rehabilitation Science, McMaster University, Hamilton, ON, Canada.

Tóm tắt

Từ khóa


Tài liệu tham khảo

Kurmis AP, 2003, Understanding the Limitations of the Journal Impact Factor, J Bone Jt Surg Am, 85, 2449, 10.2106/00004623-200312000-00028

Bornmann L, 2012, Diversity, value and limitations of the Journal Impact Factor and alternative metrics, Rheumatol Int, 32, 1861, 10.1007/s00296-011-2276-1

Amin M, 2000, Impact Factors: Use and Abuse, Int J Environ Sci Technol, 1

Sims J, 2003, Citation analysis and journal impact factors in ophthalmology and vision science journals, Clinical & Experimental Ophthalmology, 31, 14, 10.1046/j.1442-9071.2003.00610.x

Saha S, 2003, Impact factor: A valid measure of journal quality?, J Med Libr Assoc, 91, 42

Smith AT, 2002

Suhrbier A, 2013, Are Impact Factors corrupting truth and utility in biomedical research?, Vaccine, 31, 6041, 10.1016/j.vaccine.2013.09.076

Shashikiran ND, 2013, Appraising journals - Impact factor, citation index, …?, J Indian Soc Pedod Prev Dent, 31, 133, 10.4103/0970-4388.117961

Hecht F, 1998, The Journal “ Impact Factor ”: A Misnamed , Misleading , Misused Measure, Cancer Genet Cytogenet, 104, 77

Garfield E, 1999, Journal Impact Factor: A Brief Review, CMAJ, 161, 979

Falagas ME, 2008, Comparison of SCImago journal rank indicator with journal impact factor, FASEB J, 22, 2623, 10.1096/fj.08-107938

Falagas ME, 2008, The top-ten in journal impact factor manipulation, Arch Immunol Ther Exp, 56, 223, 10.1007/s00005-008-0024-5

Glänzel W, 2002, Journal Impact Measures in Bibliometric Research, Scientometrics, 53, 171, 10.1023/A:1014848323806

Alberts B, 2013, Impact Factor Distortions, Science, 340, 15, 10.1126/science.1240319

2012

Metze K, 2010, Bureaucrats, researchers, editors, and the impact factor - a vicious circle that is detrimental to science, Clinics, 65, 937, 10.1590/S1807-59322010001000002

Gaba DM, 2011, A remarkable journal impact factor for simulation in healthcare, Simul Healthc, 6, 313, 10.1097/SIH.0b013e31823ca798

Triaridis S, 2010, Peer review and journal impact factor: the two pillars of contemporary medical publishing, Hippokratia, 14, 5

Coleman A, 2007, Assessing the Value of a Journal Beyond the Impact Factor, J Am Soc Inf Sci Technol, 58, 1148, 10.1002/asi.20599

Pendlebury DA, 2009, The use and misuse of journal metrics and other citation indicators, Arch Immunol Ther Exp (Warsz), 57, 1, 10.1007/s00005-009-0008-y

Hunt GE, 2013, A citation analysis of nurse education journals using various bibliometric indicators, J Adv Nurs, 69, 1441, 10.1111/jan.12069

Herrmann-Lingen C, 2014, Evaluation of medical research performance-position paper of the Association of the Scientific Medical Societies in Germany (AWMF), Ger Med Sci, 12

Durieux V, 2010, Bibliometric indicators: quality measurements of scientific publication, Radiology, 255, 342, 10.1148/radiol.09090626

Bollen J, 2009, A principal component analysis of 39 scientific impact measures, PLoS One, 4, 10.1371/journal.pone.0006022

Neylon C, 2009, Article-level metrics and the evolution of scientific impact, PLoS Biol, 7, 10.1371/journal.pbio.1000242

Nigam A, 2012, Citation Index and Impact factor, Indian J Dermatol Venereol Leprol, 78, 511, 10.4103/0378-6323.98093

Elwood TW, 2017, Altmetrics, Biased Metrics, and Contentious Metrics, J Allied Health, 46

Van Noorden R, 2016, Controversial impact factor gets a heavyweight rival, Nature, 540, 325, 10.1038/nature.2016.21131

Friedberg EC, 2010, A closer look at bibliometrics, DNA Repair (Amst), 9, 1018, 10.1016/j.dnarep.2010.07.010

Mansour AM, 2015, Bibliometric trends in ophthalmology 1997-2009, INDIAN J Ophthalmol, 63, 54, 10.4103/0301-4738.151471

McVeigh ME, 2009, The journal impact factor denominator: Defining citable (counted) items, JAMA, 302, 1107, 10.1001/jama.2009.1301

Scully C, 2009, Impact and other newer factors, Oral Oncol, 45, 10.1016/j.oraloncology.2009.10.001

Miller CS, 2012, Impact versus impact factor and Eigenfactor, Oral Surg Oral Med Oral Pathol Oral Radiol, 113, 145, 10.1016/j.tripleo.2011.08.009

Roberts WC, 2011, Piercing the impact factor and promoting the Eigenfactor, Am J Cardiol, 108, 896, 10.1016/j.amjcard.2011.07.002

Kali A, 2015, Scientific impact and altmetrics, Indian J Pharmacol, 47, 570, 10.4103/0253-7613.165184

Conn VS, 2015, Moving beyond counting publications to assess impact, West J Nurs Res, 37, 283, 10.1177/0193945914531700

Eysenbach G, 2011, Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact, J Med Internet Res, 13, 10.2196/jmir.2012

Li X, 2003, A review of the development and application of the Web impact factor, ONLINE Inf Rev, 27, 407, 10.1108/14684520310510046

Kamath PS, 2009, Impact factor: misused and overhyped?, Hepatology, 49, 1787, 10.1002/hep.23040

Garcia-Romero A, 2016, Another brick in the wall: a new ranking of academic journals in Economics using FDH, Scientometrics, 107, 91, 10.1007/s11192-016-1843-3

Hsu W-C, 2015, A hybrid indicator for journal ranking: An example from the field of Health Care Sciences and Services, Online Inf Rev, 39, 858, 10.1108/OIR-11-2014-0277

Oosthuizen JC, 2014, Alternatives to the impact factor, Surgeon, 12, 239, 10.1016/j.surge.2013.08.002

Elkins MR, 2010, Correlation between the Journal Impact Factor and three other journal citation indices, Scientometrics, 85, 81, 10.1007/s11192-010-0262-0

Mingers J, 2017, Evaluating journal quality: A review of journal citation indicators, and ranking in business and management, Eur J Oper Res, 257, 323, 10.1016/j.ejor.2016.07.058

Andersson A, 2015, Operating in an era of impact factor mania, Ups J Med Sci, 120, 124

Santangelo GM, 2017, Article-level assessment of influence and translation in biomedical research, Mol Biol Cell, 28, 1401, 10.1091/mbc.e16-01-0037

Leydesdorff L, 2012, Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers, Scientometrics, 92, 355, 10.1007/s11192-012-0660-6

Wagner CS, 2012, An Integrated Impact Indicator: A new definition of `Impact’ with policy relevance, Res Eval, 21, 183, 10.1093/reseval/rvs012

Wurtz M, 2016, The stratified H-index, Ann Epidemiol, 26, 299, 10.1016/j.annepidem.2016.01.006

Lippi G, 2014, A short story on how the H-index may change the fate of scientists and scientific publishing, Clin Chem Lab Med, 52, e1, 10.1515/cclm-2013-0715

Aoun SG, 2013, Standardizing the Evaluation of Scientific and Academic Performance in Neurosurgery-Critical Review of the “h” Index and its Variants, WORLD Neurosurg, 80, E85, 10.1016/j.wneu.2012.01.052

Abbas AM, 2012, Bounds and inequalities relating h-index, g-index, e-index and generalized impact factor: an improvement over existing models, PLoS One, 7, 10.1371/journal.pone.0033699

Bornmann L, 2009, Hirsch-Type Index Values for Organic Chemistry Journals: A Comparison of New Metrics with the Journal Impact Factor, European J Org Chem, 1471, 10.1002/ejoc.200801243

De Sordi JO, 2016, Bibliometric indicators in the context of regional repositories: proposing the {D}-index, Scientometrics, 107, 235, 10.1007/s11192-016-1873-x

Stallings J, 2013, Determining scientific impact using a collaboration index, Proc Natl Acad Sci U S A, 110, 9680, 10.1073/pnas.1220184110

Finch A, 2010, Can we do better than existing author citation metrics?, BIOESSAYS, 32, 744, 10.1002/bies.201000053

Stojanovska J, 2015, The Figley Fellowship : An Entrance to Fundamentals, Am J Roentgenol, 204, 2013, 10.2214/AJR.15.14511

Martin BR, 2016, Editors ’ JIF boosting stratagems - which are appropriate and which not ?, Res Policy, 45, 1, 10.1016/j.respol.2015.09.001

Karanatsiou D, 2017, Bibliometrics and altmetrics literature review: Performance indicators and comparison analysis, Perform Meas METRICS, 18, 16, 10.1108/PMM-08-2016-0036

Jacso P, 2010, Eigenfactor and article influence scores in the Journal Citation Reports, ONLINE Inf Rev, 34, 339, 10.1108/14684521011037034

Fang FC, 2011, Retracted Science and the Retraction Index, Infect Immun, 79, 3855, 10.1128/IAI.05661-11

Dodson MV, 2009, Citation analysis: Maintenance of h-index and use of e-index, Biochem Biophys Res Commun, 387, 625, 10.1016/j.bbrc.2009.07.091

Lando T, 2014, A new bibliometric index based on the shape of the citation distribution, PLoS One, 9, 10.1371/journal.pone.0115962

Johnston M, 2015, A glaring paradox, Genetics, 199, 637, 10.1534/genetics.115.174771