The inconsistency of h-index: A mathematical analysis

Journal of Informetrics - Tập 15 - Trang 101106 - 2021
Ricardo Brito1, Alonso Rodríguez Navarro1,2
1Departamento de Estructura de la Materia, Física Térmica y Electrónica and GISC, Universidad Complutense de Madrid, Plaza de las Ciencias 3, 28040, Madrid, Spain
2Departamento de Biotecnología-Biología Vegetal, Universidad Politécnica de Madrid, Avenida Puerta de Hierro 2, 28040, Madrid, Spain

Tài liệu tham khảo

Abramo, 2014, How do you define and measure research productivity?, Scientometrics, 101, 1129, 10.1007/s11192-014-1269-8 Aitchison, 1963 Aksnes, 2019, Citations, citation indicators, and research quality: An overview of basic concepts and theories, SAGE Open, 1 Albarrán, 2017, The Herrero-Villar approach to citation impact, Journal of Informetrics, 11, 625, 10.1016/j.joi.2017.04.008 Allen, 2009, Looking for landmarks: The role of expert review and bibliometric analysis in evaluating scientific publication outputs, PloS One, 4, e5910, 10.1371/journal.pone.0005910 Bertoli-Barsotti, 2017, A theoretical model of the relationship between the h-index and other simple citation indicators, Scientometrics, 111, 1415, 10.1007/s11192-017-2351-9 Bornmann, 2013, What is societal impact of reserach and how can it be assessed? A literature survey, Journal of the American Society for Information Science, 64, 217, 10.1002/asi.22803 Bornmann, 2014, h-index reserach in scientometrics: A summary, Journal of Informetrics, 8, 749, 10.1016/j.joi.2014.07.004 Bornmann, 2017, Does evaluative scientometrics lose its main focus on scientific quality by the new orintation towards societal impact?, Scientometrics, 110, 937, 10.1007/s11192-016-2200-2 Bornmann, 2018, Count highly-cited papers instead of papers with h citations: Use normalized citations counts and compare “like with like”!, Scientometrics, 115, 1119, 10.1007/s11192-018-2682-1 Bornmann, 2019, Heuristics as conceptual lens for understanding and studying the usage of bibliometrics in reserach evaluation, Scientometrics, 120, 419, 10.1007/s11192-019-03018-x Bornmann, 2011, Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization, Journal of Informetrics, 5, 228, 10.1016/j.joi.2010.10.009 Bornmann, 2009, Do we need the h index and its variants in addition to standard bibliometric measures?, Journal of the American Society for Information Science, 60, 1286, 10.1002/asi.21016 Bornmann, 2011, A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants, Journal of Informetrics, 5, 346, 10.1016/j.joi.2011.01.006 Brito, 2018, Research assessment by percentile-based double rank analysis, Journal of Informetrics, 12, 315, 10.1016/j.joi.2018.01.011 De Bellis, 2009 Egghe, 2006, An informetric model for the Hirsch-index, Scientometrics, 69, 121, 10.1007/s11192-006-0143-8 Evans, 2012, Universality of performance indicators based on citation and reference counts, Scientometrics, 93, 473, 10.1007/s11192-012-0694-9 Gautschi, 1965, Error function and Fresnel integrals Glänzel, 2006, On the h-index - A mathematical approach to a new measure of publications activity and citation impact, Scientometrics, 67, 315, 10.1007/s11192-006-0102-4 Harnad, 2009, Open access scientometrics and the UK research assessment exercise, Scientometrics, 79, 147, 10.1007/s11192-009-0409-z Hirsch, 2005, An index to quantify an individual’s scientific reserach output, Proceedings of the National Academy of Sciences United States of America, 102, 16569, 10.1073/pnas.0507655102 Ke, 2015, Defining and identifying sleeping beauties in science, Proceedings of the National Academy of Sciences United States of America, 112, 7426, 10.1073/pnas.1424329112 Leydesdorff, 2011, Turning the tables on citation analysis one more time: Principles for comparing sets of documents, Journal of the American Society for Information Science and Technology, 62, 1370, 10.1002/asi.21534 MacRoberts, 2018, The mismeasure of science: Citation analysis, Journal of the Association for Information Science and Technology, 69, 474, 10.1002/asi.23970 Malesios, 2015, Some variations on the standard theretical models for the h-index: A comparative analysis, Journal of the Association for Information Science and Technology, 66, 2384, 10.1002/asi.23410 Molinari, 2008, Mathematical aspects of a new criterion for ranking scientific institutions based on the h-index, Scientometrics, 75, 339, 10.1007/s11192-007-1872-z Montazerian, 2019, A new parameter for (normalized) evaluation of H-index: Countries as a case study, Scientometrics, 118, 1065, 10.1007/s11192-018-2996-z Newman, 2005, Power laws, Pareto distributions and Zipf’s law, Conterporary Physiscs, 46, 323 Press, 2013, What’s so special about science (and how much should we spend on it?), Science, 342, 817, 10.1126/science.342.6160.817 Pride, 2018, Peer review and citation data in predicting university rankings, a large scale analysis, Vol. 11057 Radicchi, 2008, Universality of citation distributions: Toward an objective measure of scientific impact, Proceedings of the National Academy of Sciences of the United States of America, 105, 17268, 10.1073/pnas.0806977105 Redner, 2005, Citation statistics from 110 years of Physical Review, Physics Today, 58, 49, 10.1063/1.1996475 REF2014, 2011 Rodríguez-Navarro, 2011, A simple index for the high-citation tail of citation distribution to quantify research performance in countries and institutions, PloS One, 6, 10.1371/journal.pone.0020510 Rodríguez-Navarro, 2016, Research assessment based on infrequent achievements: A comparison of the United States and Europe in terms of highly cited papers and Noble Prizes, Journal of the Association for Information Science and Technology, 67, 731, 10.1002/asi.23412 Rodríguez-Navarro, 2018, Double rank analysis for research assessment, Journal of Informetrics, 12, 31, 10.1016/j.joi.2017.11.004 Rodríguez-Navarro, 2020, Like-for-like bibliometric substitutes for peer review: Advantages and limits of indicators calculated from the ep index, Research Evaluation, 29, 215, 10.1093/reseval/rvaa002 Ruiz-Castillo, 2012, The evaluation of citation distribution, SERIEs, 3, 291, 10.1007/s13209-011-0074-3 Schreiber, 2013, A case study of the arbitrariness of the h-index and the highly-cited publication indicator, Journal of Informetrics, 7, 379, 10.1016/j.joi.2012.12.006 Stringer, 2010, Statistical validation of a global model for the distribution of the ultimate number of citations accrued by papers published in a scientific journal, Journal of the American Society for Information Science, 61, 1377, 10.1002/asi.21335 Thelwall, 2016, Citation count distributions for large monodisciplinary journals, Journal of Informetrics, 10, 863, 10.1016/j.joi.2016.07.006 Thelwall, 2016, Not dead, just resting: The practical value of per publication citation indicators, Journal of Informetrics, 10, 667, 10.1016/j.joi.2015.12.009 Thelwall, 2016, The precision of the arithmetic mean, geometric mean and percentiles for citation data: An experimental simulation modelling approach, Journal of Informetrics, 10, 110, 10.1016/j.joi.2015.12.001 Thelwall, 2014, Distributions for cited articles from individual subjects and years, Journal of Informetrics, 8, 824, 10.1016/j.joi.2014.08.001 Thelwall, 2014, Regression for citation data: An evaluation of different methods, Journal of Informetrics, 8, 963, 10.1016/j.joi.2014.09.011 Tijssen, 2002, Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?, Scientometrics, 54, 381, 10.1023/A:1016082432660 Traag, 2019, Systematic analysis of agreement between metrics and peer review in the UK REF, Palgrave Communications, 5, 29, 10.1057/s41599-019-0233-x van Raan, 2004, Sleeping beaties in science, Scientometrics, 59, 467, 10.1023/B:SCIE.0000018543.82441.f1 van Raan, 2005, Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods, Scientometrics, 62, 133, 10.1007/s11192-005-0008-6 van Raan, 2006, Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups, Scientometrics, 67, 491, 10.1556/Scient.67.2006.3.10 Viiu, 2018, The lognormal distribution explains the remarkable pattern documented by characteristic scores and scales in scientometrics, Journal of Informetrics, 12, 401, 10.1016/j.joi.2018.02.002 Waltman, 2012, The inconsistency of the h-index, Journal of the American Society for Information Science and Technology, 63, 406, 10.1002/asi.21678 Wang, 2017, Bias against novelty in science: A cautionary tale for users of bibliometric indicators, Research Policy, 46, 1416, 10.1016/j.respol.2017.06.006 Wilsdon, 2015