Beyond the Big Five personality traits for music recommendation systems
Tóm tắt
The aim of this paper is to investigate the influence of personality traits, characterized by the BFI (Big Five Inventory) and its significant revision called BFI-2, on music recommendation error. The BFI-2 describes the lower-order facets of the Big Five personality traits. We performed experiments with 279 participants, using an application (called Music Master) we developed for music listening and ranking, and for collecting personality profiles of the users. Additionally, 29-dimensional vectors of audio features were extracted to describe the music files. The data obtained from our experiments were used to test several hypotheses about the influence of personality traits and the audio features on music recommendation error. The performed analyses take into account three types of ratings that refer to the cognitive-emotional, motivational, and social components of the attitude towards the song. The experiments showed that every combination of Big Five personality traits produces worse results than using lower-order personality facets. Additionally, we found a small subset of personality facets that yielded the lowest recommendation error. This finding can condense the personality questionnaire to only the most essential questions. The collected data set is publicly available and ready to be used by other researchers.
Tài liệu tham khảo
J.B. Schafer, D. Frankowski, J. Herlocker, S. Sen, in The adaptive web. Collaborative filtering recommender systems (Springer, Berlin Heidelberg, 2007), p. 291–324
J.L. Herlocker, J.A. Konstan, A. Borchers, J. Riedl, in Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval. An algorithmic framework for performing collaborative filtering (Association for Computing Machinery, New York, 1999), p. 230–237
Y. Tao, Y. Zhang, K. Bian, in 2019 IEEE Fourth International Conference on Data Science in Cyberspace (DSC). Attentive context-aware music recommendation (IEEE, Hangzhou, 2019), p. 54–61
F. Ricci, L. Rokach, B. Shapira, in Recommender systems handbook. Introduction to recommender systems handbook (Springer, Berlin, Heidelberg, 2011), p. 1–35
J. Herce-Zelaya, C. Porcel, J. Bernabé-Moreno, A. Tejeda-Lorente, E. Herrera-Viedma, New technique to alleviate the cold start problem in recommender systems using information from social media and random decision forests. Inf. Sci. 536, 156–170 (2020)
S. Ojagh, M.R. Malek, S. Saeedi, A social-aware recommender system based on user’s personal smart devices. ISPRS Int. J. Geo-Inf. 9(9), 519 (2020)
L.A.G. Camacho, S.N. Alves-Souza, Social network data to alleviate cold-start in recommender system: A systematic review. Inf. Process. Manag. 54(4), 529–544 (2018)
T.Z. Gizaw, H. Dong Jun, A. Oad, Solving cold-start problem by combining personality traits and demographic attributes in a user based recommender system. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 7(5), 231–239 (2017)
V. Tiwari, A. Ashpilaya, P. Vedita, U. Daripa, P.P. Paltani, in ICT Systems and Sustainability. Exploring demographics and personality traits in recommendation system to address cold start problem (Springer, Singapore, 2020), p. 361–369
R. Hu, P. Pu, in Proceedings of the fifth ACM conference on Recommender systems. Enhancing collaborative filtering systems with personality information (Association for Computing Machinery, New York, 2011), p. 197–204
R.R. McCrae, P.T. Costa, Personality in adulthood: a five-factor theory perspective. (Guilford Press, New York, 2003)
M. Schedl, Deep learning in music recommendation systems. Front. Appl. Math. Stat. 5, 44 (2019)
F. Fessahaye, L. Perez, T. Zhan, R. Zhang, C. Fossier, R. Markarian et al., in 2019 IEEE International Conference on Consumer Electronics (ICCE). T-recsys: a novel music recommendation system using deep learning (IEEE, Las Vegas, 2019), p. 1–6
M. Khoali, A. Tali, Y. Laaziz, in Proceedings of the 3rd International Conference on Networking, Information Systems & Security. Advanced recommendation systems through deep learning (Association for Computing Machinery, New York, 2020), p. 1–8
R.T. Irene, C. Borrelli, M. Zanoni, M. Buccoli, A. Sarti, in 2019 27th European Signal Processing Conference (EUSIPCO). Automatic playlist generation using convolutional neural networks and recurrent neural networks (IEEE, A Coruna, 2019), p. 1–5
M.F. Aljunid, M. Dh, An efficient deep learning approach for collaborative filtering recommender system. Procedia Comput. Sci. 171, 829–836 (2020)
S.H. Chang, A. Abdul, J. Chen, H.Y. Liao, in 2018 IEEE International Conference on Applied System Invention (ICASI). A personalized music recommendation system using convolutional neural networks approach (IEEE, Chiba, 2018), p. 47–49
P. Knees, M. Schedl, B. Ferwerda, A. Laplante, User awareness in music recommender systems. Personalized Hum.-Comput. Interact. 223–252 (2019)
C. Bauer, A. Novotny, A consolidated view of context for intelligent systems. J. Ambient. Intell. Smart Environ. 9(4), 377–393 (2017)
P.N. Juslin, P. Laukka, Expression, perception, and induction of musical emotions: A review and a questionnaire study of everyday listening. J. New Music Res. 33(3), 217–238 (2004)
A.C. North, D.J. Hargreaves, Situational influences on reported musical preference. Psychomusicology J. Res. Music Cognit. 15(1–2), 30 (1996)
K. Bai, K. Kawagoe, in Proceedings of the 2018 10th International Conference on Computer and Automation Engineering. Background music recommendation system based on user’s heart rate and elapsed time (Association for Computing Machinery, New York, 2018), p. 49–52
S. Lavanya, G. Saranya, K. Navin, in 2017 International Conference on IoT and Application (ICIOT). Weather based playlist generation in mobile devices using hash map (IEEE, Nagapattinam, 2017), p. 1–7
P. Álvarez, F. Zarazaga-Soria, S. Baldassarri, Mobile music recommendations for runners based on location and emotions: the dj-running system. Pervasive. Mob. Comput. 67, 101242 (2020)
J.H. Su, H.H. Yeh, S.Y. Philip, V.S. Tseng, Music recommendation using content and context information mining. IEEE Intell. Syst. 25(1), 16–26 (2010)
J. Chen, P. Ying, M. Zou, Improving music recommendation by incorporating social influence. Multimed. Tools Appl. 78(3), 2667–2687 (2019)
D. Wu, in 2019 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS). Music personalized recommendation system based on hybrid filtration (IEEE, Changsha, 2019), p. 430–433
R. Wang, X. Ma, C. Jiang, Y. Ye, Y. Zhang, Heterogeneous information network-based music recommendation system in mobile networks. Comput. Commun. 150, 429–437 (2020)
Y. Jin, N.N. Htun, N. Tintarev, K. Verbert, in Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization. Contextplay: evaluating user control for context-aware music recommendation (Association for Computing Machinery, New York, 2019), p. 294–302
P.N. Juslin, J. Sloboda, Handbook of music and emotion: theory, research, applications. (Oxford University Press, Oxford, 2011)
S. Gilda, H. Zafar, C. Soni, K. Waghurdekar, in 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET). Smart music player integrating facial emotion recognition and music mood recommendation (IEEE, Chennai, 2017), p. 154–158
Z. Hyung, J.S. Park, K. Lee, Utilizing context-relevant keywords extracted from a large collection of user-generated documents for music discovery. Inf. Process. Manag. 53(5), 1185–1200 (2017)
M. Polignano, P. Basile, M. de Gemmis, G. Semeraro, in Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization. Social tags and emotions as main features for the next song to play in automatic playlist continuation (Association for Computing Machinery, New York, 2019), p. 235–239
P.S. Lopes, E.L. Lasmar, R.L. Rosa, D.Z. Rodríguez, in Proceedings of the XIV Brazilian Symposium on Information Systems. The use of the convolutional neural network as an emotion classifier in a music recommendation system (Association for Computing Machinery, New York, 2018), p. 1–8
A.V. Iyer, V. Pasad, S.R. Sankhe, K. Prajapati, in 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT). Emotion based mood enhancing music recommendation (IEEE, Bangalore, 2017), p. 1573–1577
D. Ayata, Y. Yaslan, M.E. Kamasak, Emotion based music recommendation system using wearable physiological sensors. IEEE Trans. Consum. Electron. 64(2), 196–203 (2018)
S. Kulkarni, S.F. Rodd, Context aware recommendation systems: A review of the state of the art techniques. Comput. Sci. Rev. 37, 100255 (2020)
L. Xu, X. Wen, J. Shi, S. Li, Y. Xiao, Q. Wan et al., Effects of individual factors on perceived emotion and felt emotion of music: based on machine learning methods. Psychol. Music. 49, 1069–1087 (2020)
P.N. Juslin, J.A. Sloboda, Music and emotion: theory and research. (Oxford University Press, Oxford, 2001)
S. Dhelim, N. Aung, M.A. Bouras, H. Ning, E. Cambria, A survey on personality-aware recommendation systems. Artif. Intell. Rev. 55(3), 2409–2454 (2022)
P.J. Rentfrow, S.D. Gosling, The do re mi’s of everyday life: the structure and personality correlates of music preferences. J. Pers. Soc. Psychol. 84(6), 1236 (2003)
P.G. Dunn, B. de Ruyter, D.G. Bouwhuis, Toward a better understanding of the relation between music preference, listening behavior, and personality. Psychol. Music 40(4), 411–428 (2012)
P.J. Rentfrow, L.R. Goldberg, D.J. Levitin, The structure of musical preferences: a five-factor model. J. Pers. Soc. Psychol. 100(6), 1139 (2011)
J. Bansal, M.B. Flannery, M.H. Woolhouse, Influence of personality on music-genre exclusivity. Psychol. Music. 49, 1356–1371 (2020)
R.L. Zweigenhaft, A do re mi encore: A closer look at the personality correlates of music preferences. J. Individ. Differ. 29(1), 45–55 (2008)
J. Bansal, M. Woolhouse, in ISMIR. Predictive power of personality on music-genre exclusivity (Proceedings of the 16th International Society for Music Information Retrieval Conference, Malaga, 2015), p. 652–658
S.B. Kaufman, Opening up openness to experience: A four-factor model and relations to creative achievement in the arts and sciences. J. Creat. Behav. 47(4), 233–255 (2013)
T. Chamorro-Premuzic, A. Furnham, Personality and music: can traits explain how people use music in everyday life? Br. J. Psychol. 98(2), 175–185, (Wiley-Blackwell, Hoboken, 2007)
B. Ferwerda, M. Tkalcic, M. Schedl, in Proceedings of the 25th conference on user modeling, adaptation and personalization. Personality traits and music genres: What do people prefer to listen to? (2017), pp. 285–288
B. Ferwerda, E. Yang, M. Schedl, M. Tkalcic, Personality and taxonomy preferences, and the influence of category choice on the user experience for music streaming services. Multimed. Tools. Appl. 78(14), 20157–20190, (Springer, Berlin, 2019)
B. Ferwerda, M. Tkalčič, in Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization. Exploring online music listening behaviors of musically sophisticated users (2019), pp. 33–37
M.B. Flannery, M.H. Woolhouse, Musical preference: Role of personality and music-related acoustic features. Music. Sci. 4, 20592043211014016 (2021)
A. Dorochowicz, A. Kurowski, B. Kostek, Employing subjective tests and deep learning for discovering the relationship between personality types and preferred music genres. Electronics 9(12), 2016 (2020)
I. Fernández-Tobías, M. Braunhofer, M. Elahi, F. Ricci, I. Cantador, Alleviating the new user problem in collaborative filtering by exploiting personality information. User Model. User-Adap. Inter. 26(2), 221–255 (2016)
M. Atas, A. Felfernig, S. Polat-Erdeniz, A. Popescu, T.N.T. Tran, M. Uta, Towards psychology-aware preference construction in recommender systems: overview and research issues. J. Intell. Inf. Syst. 57, 1–23 (2021)
R.P. Karumur, T.T. Nguyen, J.A. Konstan, in Proceedings of the 10th ACM conference on recommender systems. Exploring the value of personality in predicting rating behaviors: a study of category preferences on movie lens (Association for Computing Machinery, New York, 2016), p. 139–142
R. Liu, X. Hu, in Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020. A multimodal music recommendation system with listeners’ personality and physiological signals (Association for Computing Machinery, New York, 2020), p. 357–360
T.T. Nguyen, F. Maxwell Harper, L. Terveen, J.A. Konstan, User personality and user satisfaction with recommender systems. Inf. Syst. Front. 20(6), 1173–1189 (2018)
W. Wu, L. Chen, L. He, in Proceedings of the 24th ACM conference on hypertext and social media. Using personality to adjust diversity in recommender systems (Association for Computing Machinery, New York, 2013), p. 225–229
M. Onori, A. Micarelli, G. Sansonetti, in Empire@ RecSys. A comparative analysis of personality-based music recommender systems (Association for Computing Machinery, New York, 2016), p. 55–59
F. Lu, N. Tintarev, in IntRS@ RecSys. A diversity adjusting strategy with personality for music recommendation (2018), p. 7–14. CEUR-WS.org
O.P. John, L.P. Naumann, C.J. Soto, Paradigm shift to the integrative big five trait taxonomy. Handb. Pers. Theory Res. 3(2), 114–158 (2008)
B.D.E. Raad, M.E. Perugini, Big five factor assessment: introduction. (Hogrefe & Huber Publishers, Cambridge, 2002), p. 1–18
M.G. Ehrhart, K.H. Ehrhart, S.C. Roesch, B.G. Chung-Herrera, K. Nadler, K. Bradshaw, Testing the latent factor structure and construct validity of the ten-item personality inventory. Personal. Individ. Differ. 47(8), 900–905 (2009)
J. Golbeck, C. Robles, M. Edmondson, K. Turner, in 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing. Predicting personality from twitter (IEEE, Boston, 2011), p. 149–156
G. Dunn, J. Wiersema, J. Ham, L. Aroyo, in International Conference on User Modeling, Adaptation, and Personalization. Evaluating interface variants on personality acquisition for recommender systems (Springer, Berlin, 2009), p. 259–270
C.J. Soto, O.P. John, The next big five inventory (bfi-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. J. Pers. Soc. Psychol. 113(1), 117 (2017)
O.P. John, S. Srivastava et al., The big five trait taxonomy: History, measurement, and theoretical perspectives. Handb. Pers. Theory Res. 2(1999), 102–138 (1999)
H.J. Eysenck, Dimensions of personality: 16, 5 or 3?—criteria for a taxonomic paradigm. Personal. Individ. Differ. 12(8), 773–790 (1991)
M.C. Ashton, K. Lee, Empirical, theoretical, and practical advantages of the hexaco model of personality structure. Personal. Soc. Psychol. Rev. 11(2), 150–166 (2007)
J. Cieciuch, W. Strus, V. Zeigler-Hill, T.K. Shackelford, Two-factor model of personality. (Springer, Cham, 2018)
W. Strus, J. Cieciuch, Are the questionnaire and the psycho-lexical big twos the same? towards an integration of personality structure within the circumplex of personality metatraits. Int. J. Pers. Psychol. 5, 18–35 (2019)
L.R. Goldberg, An alternative “description of personality’’: the big-five factor structure. J. Pers. Soc. Psychol. 59(6), 1216 (1990)
M.A.S.N. Nunes, Recommender systems based on personality traits. Ph.D. thesis, Université Montpellier II-Sciences et Techniques du Languedoc (2008)
M. Tkalcic, L. Chen, in Recommender systems handbook. Personality and recommender systems (Springer, Berlin, 2015), p. 715–739
O. Lartillot, P. Toiviainen, in International conference on digital audio effects. A matlab toolbox for musical feature extraction from audio, vol. 237 (SCRIME and the LaBRI, Bordeaux, 2007), p. 244. https://dafx.labri.fr/main/dafx07_proceedings.html
O. Lartillot, Mirtoolbox 1.7. 2 user’s manual. Oslo: University of Oslo. [Google Scholar] (2019)
F. Alías, J.C. Socoró, X. Sevillano, A review of physical and perceptual feature extraction techniques for speech, music and environmental sounds. Appl. Sci. 6(5), 143 (2016)
G. Tzanetakis, P. Cook, Musical genre classification of audio signals. IEEE Trans. Speech Audio Process. 10(5), 293–302 (2002)
O. Lartillot, T. Eerola, P. Toiviainen, J. Fornari, in ISMIR. Multi-feature modeling of pulse clarity: design, validation and optimization (Proceedings of the 9th International Conference of Music Information Retrieval, Drexel University, Philadelphia, 2008), p. 521–526
A. Pearce, T. Brookes, R. Mason, Modelling the microphone-related timbral brightness of recorded signals. Appl. Sci. 11(14), 6461 (2021)
P.N. Juslin, Cue utilization in communication of emotion in music performance: Relating performance to perception. J. Exp. Psychol. Hum. Percept. Perform. 26(6), 1797 (2000)
T. Eerola, O. Lartillot, P. Toiviainen, in Ismir. Prediction of multidimensional emotional ratings in music from audio using multivariate regression models (Proceedings of the 16th International Society for Music Information Retrieval Conference, Kobe, 2009), p. 621–626
S. Zhang, L. Yao, A. Sun, Y. Tay, Deep learning based recommender system: A survey and new perspectives. ACM Comput. Surv. (CSUR) 52(1), 1–38 (2019)
D. Rawlings, V. Ciancarelli, Music preference and the five-factor model of the neo personality inventory. Psychol. Music 25(2), 120–132 (1997)
T. Schäfer, C. Mehlhorn, Can personality traits predict musical style preferences? a meta-analysis. Personal. Individ. Differ. 116, 265–273 (2017)
M. Braunhofer, M. Elahi, F. Ricci, in Information and communication technologies in tourism 2015. User personality and the new user problem in a context-aware point of interest recommender system (Springer, Berlin, 2015), p. 537–549
F.O. Isinkaye, Y.O. Folajimi, B.A. Ojokoh, Recommendation systems: Principles, methods and evaluation. Egypt. Inform. J. 16(3), 261–273 (2015)
M. Nilashi, O. bin Ibrahim, N. Ithnin, Hybrid recommendation approaches for multi-criteria collaborative filtering. Expert Syst. Appl. 41(8), 3879–3900 (2014)
D.M. Greenberg, S.J. Wride, D.A. Snowden, D. Spathis, J. Potter, P.J. Rentfrow, Universals and variations in musical preferences: A study of preferential reactions to western music in 53 countries. J. Pers. Soc. Psychol. 122(2), 286 (2022)