Identifying outlier scores and outlier jurors to reduce manipulation in classical music competitions
Journal of Cultural Economics - Trang 1-50 - 2023
Tóm tắt
Manipulations in classical music competitions are a proven problem that has as yet not been eradicated from the competition practice. Several examples are provided. We aim to compare and analyze different methods of reducing manipulation in classical music competitions, focusing on outlier scores and on outlier jurors. First, we investigate the typical approach of correcting or discarding individual jurors' scores that significantly deviate from the mean or median of scores received by a given candidate. We then introduce a new method that involves the exclusion of outlier jurors (EOJ). This approach implies that all scores of jurors with ratings that substantially differ from those of other jurors are removed and not taken into account when determining the ranking of candidates. The properties of both approaches are discussed in hypothetical voting scenarios, where one or more jurors assign scores that deviate markedly from those awarded by other jurors. Finally, we present examples of applying various methods to real-world data from classical music competitions, demonstrating the potential effectiveness and implications of each approach in reducing manipulation within these events. Two examples are taken from the International Karol Szymanowski Music Competition, which took place in September 2023 in Katowice, Poland, where EOJ was adopted for the first time as the official scoring system in four competition categories: piano, violin, vocal, and string quartet.
Tài liệu tham khảo
Arrow, K. J. (1951). Social choice and individual values (2nd edition on 1963). Wiley.
Arrow, K. J., Sen, A. K., & Suzumura, K. (2002). Handbook of social choice and welfare (Vol. 1). Elsevier.
Asmat, R., Borowiecki, K. J., & Law, M. T. (2023). Do experts and laypersons differ? Some evidence from international classical music competitions. Journal of Economic Behavior and Organization, 214, 270–290.
Austen-Smith, D., & Banks, J. S. (2002). Positive political theory. The University of Michigan Press.
Balinski, M., & Laraki, R. (2010). Majority judgment: Measuring, ranking, and electing. The MIT Press.
Budzinski, O., & Pannicke, J. (2017). Does popularity matter in a TV song competition? Evidence from a National Music Contest. Ilmenau Economics Discussion Papers (Vol. 21, No. 106).
Budzinski, O., Gaenssle, S., & Weimar, D. (2023). Disentangling individual biases in jury voting: An empirical analysis of voting behavior in the eurovision song contest. Ilmenau Economics Discussion Papers (Vol. 28, No. 171).
Chmurzyńska, M. (2015). Influence of a priori information on music performance assessment. Proceedings of the Ninth Triennale Conference of the European Society for the Cognitive Sciences of Music, Manchester, 2015, 292–295.
Dijkstra, S. G., & Haan, M. (2005). Expert judgment versus public opinion–evidence from the Eurovision Song Contest. Journal of Cultural Economics., 29(1), 59–78.
Dogru, B. (2013). Modeling voting behavior in the Eurovision Song Contest. MPRA Paper No. 42801.
Ellis-Petersen, H. (2014). Julian Lloyd Webber: classical music competitions are rife with corruption. The Guardian. https://www.theguardian.com/music/2014/jul/25/julian-lloyd-webber-classical-music-competitions-corrupt
Flores, R., & Ginsburgh, V. (1996). The Queen Elisabeth musical competition how fair is the final ranking. J R Stat Soc Stat., 45, 97–104.
Gibbard, A. (1973). Manipulation of voting schemes: A general result. Econometrica, 41, 587–601.
Ginsburgh, V. (2003). Awards, success and aesthetic quality in the arts. Journal of Economic Perspectives, 17(2), 99–111.
Ginsburgh, V., & Noury, V. (2008). The Eurovision Song Contest. Is voting political or cultural? European Journal of Political Economy., 24, 41–52.
Ginsburgh, V., & Moreno-Ternero, J. D. (2022). The eurovision song contest: Voting rules, biases and rationality. Journal of Cultural Economics, 2023(47), 247–277.
Ginsburgh, V., & van Ours, J. (2003). Expert opinion and compensation: Evidence from a musical competition. American Econonomic Review., 93, 289–298.
Glejser, H., & Heyndels, B. (2001). Efficiency and inefficiency in the ranking in competitions: The case of the Queen Elisabeth music contest. Journal of Cultural Economics., 25(2), 109–129.
Green-Armytage, J., Tideman, T. N., & Cosman, R. (2016). Statistical evaluation of voting rules. Social Choice and Welfare, 46(1), 183–212.
Kontek, K., & Sosnowska, H. (2020). Specific tastes or cliques of jurors? How to reduce the level of manipulation in group decisions? Group Decision and Negotiation, 29, 1057–1084.
Lebrecht, N. (2014). Was the last Chopin Competition fair? The Slippedisc. https://slippedisc.com/2014/09/was-the-last-chopin-competition-fair/
Maccormick, L. (2018). Pogorelich at the Chopin: Towards a sociology of competition scandals. The Chopin Review, 1(1), 1–16.
Nurmi, H. (1987). Comparing voting systems. D. Reidel Publishing Company.
Ochoa, A., Muñoz-Zavala, A., & Hernández-Aguirre, A. (2009). A hybrid system approach to determine the ranking of a debutant country in Eurovision. Journal of Computers, 4(8), 713–720.
Satterhwaite, M. A. (1975). Strategy-proofness and arrow’s conditions: Existence and correspondence for voting procedures and social welfare functions. Journal of Economic Theory, 10, 187–217.
Sosnowska, H. (2017). Comparison of voting methods used in some classical music competitions. In J. Mercik (Ed.), Transactions on computational collective intelligence XXVII (Vol. 10480, pp. 108–117). Springer.
Spierdijk, L., & Vellekoop, M. (2009). The structure of bias in peer voting systems: Lessons from the Eurovision Song Contest. Empirical Economics, 36(2), 403–425.
Sutton, A. C. (2020). The composition of success: Competition and the creative self in contemporary art music. Qualitative Sociology., 43, 489–513.
Tsay, C.-J. (2014). The vision heuristic: Judging music ensembles by sight alone. Organizational Behavior and Human Decision Processes, 124, 24–33.
Verrier, D. (2012). Evidence for the infuence of the mere-exposure efect on voting in the Eurovision Song Contest. Judgment and Decision Making, 7(5), 639–643.
Voting System—Szymanowski Competition Webpage. https://szymanowski-competition.com/en/voting-system/
Wilcox, R. (2012). Introduction to robust estimation and hypothesis testing. Elsevier Academic Press.