SCiMet: Stable, sCalable and reliable Metric-based framework for quality assessment in collaborative content generation systems

Allahbakhsh, 2015, An iterative method for calculating robust rating scores, IEEE Transactions on Parallel and Distributed Systems, 26, 340, 10.1109/TPDS.2013.215 Allahbakhsh, 2013, Quality control in crowdsourcing systems: Issues and directions, IEEE Internet Computing, 17, 76, 10.1109/MIC.2013.20 Allahbakhsh, 2014, Harnessing implicit teamwork knowledge to improve quality in crowdsourcing processes, in: 2014 IEEE 7th International Conference on Service-Oriented Computing and Applications IEEE, 17 Amintoosi, 2014, A reputation framework for social participatory sensing systems, Mobile Networks and Applications, 19, 88, 10.1007/s11036-013-0455-x Behkamal, 2016, A metric suite for systematic quality assessment of linked open data, International Journal of Information and Communication Technology, 8, 27 Bergstrom, 2007, Eigenfactor: Measuring the value and prestige of scholarly journals, College & Research Libraries News, 68, 314, 10.5860/crln.68.5.7804 Bollen, 2009, A principal component analysis of 39 scientific impact measures, PLOS ONE, 4, 10.1371/journal.pone.0006022 Braithwaite, 2019, Comprehensive researcher achievement model (cram): a framework for measuring researcher achievement, impact and inuence derived from a systematic literature review of metrics and models, BMJ Open, 9, e025320, 10.1136/bmjopen-2018-025320 Briand, 1996, Property-based software engineering measurement, IEEE Transactions on Software Engineering, 22, 68, 10.1109/32.481535 Cagan, 2013 Ciaccio, 2019, Comparison of several author indices for gauging academic productivity, Informatics in Medicine Unlocked, 100166, 10.1016/j.imu.2019.100166 Daniel, 2018, Quality control in crowdsourcing: a survey of quality attributes, assessment techniques, and assurance actions, ACM Computing Surveys, 51, 10.1145/3148148 de Kerchove, 2010, Iterative filtering in reputation systems, SIAM Journal of Matrix Analysis and Applications, 31, 1812, 10.1137/090748196 Dehdarirad, 2017, Research impact in co-authorship networks: A two-mode analysis, Journal of Informetrics, 11, 371, 10.1016/j.joi.2017.02.002 Doan, 2011, Crowdsourcing systems on the world-wide web, Communications of the ACM, 54, 86, 10.1145/1924421.1924442 Ferrara, 2017, Dynamics of content quality in collaborative knowledge production, in: Eleventh International AAAI Conference on Web and Social Media Guan, 2017, The impact of collaboration and knowledge networks on citations, Journal of Informetrics, 11, 407, 10.1016/j.joi.2017.02.007 Haustein, 2015, Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns, PLOS ONE, 10, e0120495, 10.1371/journal.pone.0120495 Hirsch, 2005, An index to quantify an individual’s scientific research output, Proceedings of the National Academy of Sciences, 102, 16569, 10.1073/pnas.0507655102 Huang, 2016, Positive correlation between quality and quantity in academic journals, Journal of Informetrics, 10, 329, 10.1016/j.joi.2016.02.002 Laureti, 2006, Information filtering via iterative refinement, EPL (Europhysics Letters), 75, 1006, 10.1209/epl/i2006-10204-8 Matei, 2018, Social-collaborative determinants of content quality in online knowledge production systems: comparing wikipedia and stack overow, Social Network Analysis and Mining, 8, 36, 10.1007/s13278-018-0512-3 Mingers, 2015, A review of theory and practice in scientometrics, European Journal of Operational Research, 246, 1, 10.1016/j.ejor.2015.04.002 Page, 1999 Panagopoulos, 2017, Detecting rising stars in dynamic collaborative networks, Journal of Informetrics, 11, 198, 10.1016/j.joi.2016.11.003 Perianes-Rodriguez, 2016, Constructing bibliometric networks: A comparison between full and fractional counting, Journal of Informetrics, 10, 1178, 10.1016/j.joi.2016.10.006 Persson, 2017, Bibliometric author evaluation through linear regression on the coauthor network, Journal of Informetrics, 11, 299, 10.1016/j.joi.2017.01.003 Poels, 2000, Distance-based software measurement: necessary and suficient properties for software measures, Information and Software Technology, 42, 35, 10.1016/S0950-5849(99)00053-1 Rezvani, 2015, An iterative algorithm for reputation aggregation in multi-dimensional and multinomial rating systems, 189 Rousseau, 2016, Positive correlation between journal production and journal impact factors, Journal of Informetrics, 10, 567, 10.1016/j.joi.2016.04.012 Salk, 2016, Assessing quality of volunteer crowdsourcing contributions: lessons from the cropland capture game, International Journal of Digital Earth, 9, 410, 10.1080/17538947.2015.1039609 Schmid, 2017, Five years post-dora: promoting best practices for research assessment, Molecular Biology of the Cell, 28, 2941, 10.1091/mbc.e17-08-0534 Shen, 2014, Collective credit allocation in science, Proceedings of the National Academy of Sciences, 111, 12325, 10.1073/pnas.1401992111 Sidiropoulos, 2016, Gazing at the skyline for star scientists, Journal of Informetrics, 10, 789, 10.1016/j.joi.2016.04.009 Tang, 2008, Arnetminer: extraction and mining of academic social networks, in: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, 990 Teplitskiy, 2020 Thuan, 2016, Factors inuencing the decision to crowdsource: A systematic literature review, Information Systems Frontiers, 18, 47, 10.1007/s10796-015-9578-x Waltman, 2016, A review of the literature on citation impact indicators, Journal of Informetrics, 10, 365, 10.1016/j.joi.2016.02.007 West, 2013, Author-level eigenfactor metrics: Evaluating the inuence of authors institutions and countries within the social science research network community, Journal of the American Society for Information Science and Technology, 64, 787, 10.1002/asi.22790 Zeng, 2017, The science of science: From the perspective of complex systems, Physics Reports, 714, 1, 10.1016/j.physrep.2017.10.001