Good vibrations: A review of vocal expressions of positive emotions

Psychonomic Bulletin & Review - Tập 27 - Trang 237-265 - 2020
Roza G. Kamiloğlu1, Agneta H. Fischer1, Disa A. Sauter1
1Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands

Tóm tắt

Researchers examining nonverbal communication of emotions are becoming increasingly interested in differentiations between different positive emotional states like interest, relief, and pride. But despite the importance of the voice in communicating emotion in general and positive emotion in particular, there is to date no systematic review of what characterizes vocal expressions of different positive emotions. Furthermore, integration and synthesis of current findings are lacking. In this review, we comprehensively review studies (N = 108) investigating acoustic features relating to specific positive emotions in speech prosody and nonverbal vocalizations. We find that happy voices are generally loud with considerable variability in loudness, have high and variable pitch, and are high in the first two formant frequencies. When specific positive emotions are directly compared with each other, pitch mean, loudness mean, and speech rate differ across positive emotions, with patterns mapping onto clusters of emotions, so-called emotion families. For instance, pitch is higher for epistemological emotions (amusement, interest, relief), moderate for savouring emotions (contentment and pleasure), and lower for a prosocial emotion (admiration). Some, but not all, of the differences in acoustic patterns also map on to differences in arousal levels. We end by pointing to limitations in extant work and making concrete proposals for future research on positive emotions in the voice.

Tài liệu tham khảo

Abelin, Å., & Allwood, J. (2000, September). Cross linguistic interpretation of emotional prosody. Paper presented at the ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion, Newcastle, Northern Ireland, UK. Retrieved from https://www.isca-speech.org/archive_open/archive_papers/speech_emotion/spem_110.pdf Adolphs, R., & Andler, D. (2018). Investigating emotions as functional states distinct from feelings. Emotion Review, 10, 191–201. https://doi.org/10.1177/1754073918765662 Al-Watban, A. M. (1998). Psychoacoustic analysis of intonation as a carrier of emotion in Arabic and English. Unpublished doctoral dissertation, Ball State University, Muncie, IN. Anikin, A., & Lima, C. F. (2017). Perceptual and acoustic differences between authentic and acted nonverbal emotional vocalizations. The Quarterly Journal of Experimental Psychology, 71(3), 1–21. https://doi.org/10.1080/17470218.2016.1270976 Anikin, A., & Persson, T. (2016). Nonlinguistic vocalizations from online amateur videos for emotion research: A validated corpus. Behavior Research Methods, 49, 758–771. https://doi.org/10.3758/s13428-016-0736-y Aubergé, V., Audibert, N., & Rilliard, A. (2004, March). Acoustic morphology of expressive speech: What about contours? Paper presented at the Speech Prosody 2004, International Conference, Nara, Japan. Retrieved from https://www.isca-speech.org/archive_open/sp2004/sp04_201.pdf Aubergé, V., & Cathiard, M. (2003). Can we hear the prosody of smile? Speech Communication, 40, 87–97. https://doi.org/10.1016/S0167-6393(02)00077-8 Audibert, N., Aubergé, V., & Rilliard, A. (2005, September). The prosodic dimensions of emotion in speech: The relative weights of parameters. Paper presented at the Ninth European Conference on Speech Communication and Technology, Lisbon, Portugal. Retrieved from https://www.isca-speech.org/archive/interspeech_2005/i05_0525.html Bachorowski, J. A., & Owren, M. J., (1995). Vocal expression of emotion: Acoustic properties of speech are associated with emotional intensity and context. Psychological Science, 6, 219–224. https://doi.org/10.1111/j.1467-9280.1995.tb00596.x Bachorowski, J. A., Smoski, M. J., & Owren, M. J. (2001). The acoustic features of human laughter. The Journal of the Acoustical Society of America, 110, 1581–1597. https://doi.org/10.1121/1.1391244 Baldwin, C. M. (1988). The voice of emotion: Acoustic properties of six emotional expressions. Dissertation Abstracts International: Section: B, Sciences and Engineering, 49(0)5, 1987. Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614. https://doi.org/10.1037/0022-3514.70.3.614 Bänziger, T., Mortillaro, M., & Scherer, K. R. (2012). Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception. Emotion, 12, 1161–1165. https://doi.org/10.1037/a0025827 Bänziger, T., Patel, S., & Scherer, K. R. (2013). The Role of Perceived Voice and Speech Characteristics in Vocal Emotion Communication. Journal of Nonverbal Behavior, 38, 31–52. https://doi.org/10.1007/s10919-013-0165-x Bänziger, T., & Scherer, K. R. (2005). The role of intonation in emotional expressions. Speech Communication, 46, 252–267. https://doi.org/10.1016/j.specom.2005.02.016 Baroni, M., Caterina, R., Regazzi, F., & Zanarini, G. (1997). Emotional aspects of singing voice. In A. Gabrielsson (Ed.), Proceedings of the Third Triennial ESCOM Conference (pp. 484–489). Uppsala, Sweden: Uppsala University. Baroni, M., & Finarelli, L. (1994). Emotions in spoken language and in vocal music. In I. Deliège (Ed.), Proceedings of the 3rd International Conference for Music Perception and Cognition (pp. 343–345). Liège, Belgium: University of Liège. Barrett, J., & Paus, T. (2002). Affect-induced changes in speech production. Experimental Brain Research, 146, 531–537. https://doi.org/10.1007/s00221-002-1229-z Belin, P., Fillion-Bilodeau, S., & Gosselin, F. (2008). The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing. Behavior Research Methods, 40, 531–539. https://doi.org/10.3758/BRM.40.2.531 Belyk, M., & Brown, S. (2014). The acoustic correlates of valence depend on emotion family. Journal of Voice: Official Journal of the Voice Foundation, 28, 523.e9–523.e18. https://doi.org/10.1016/j.jvoice.2013.12.007 Braun, A., & Katerbow, M. (2005, September). Emotions in dubbed speech: An intercultural approach with respect to F0. Paper presented at the Ninth European Conference on Speech Communication and Technology, Lisbon, Portugal. Brehm, J. W. (1999). The intensity of emotion. Personality and Social Psychology Review, 3, 2–22. https://doi.org/10.1207/s15327957pspr0301_1 Breitenstein, C., Lancker, D. V, & Daum, I. (2001). The contribution of speech rate and pitch variation to the perception of vocal emotions in a German and an American sample. Cognition and Emotion, 15, 57–79. https://doi.org/10.1080/02699930126095 Briefer, E. F. (2012). Vocal expression of emotions in mammals: Mechanisms of production and evidence. Journal of Zoology, 288, 1–20. https://doi.org/10.1111/j.1469-7998.2012.00920.x Bryant, G. A., & Aktipis, C. A. (2014). The animal nature of spontaneous human laughter. Evolution and Human Behavior, 35, 327–335. https://doi.org/10.1016/j.evolhumbehav.2014.03.003 Burkhardt, F., & Sendlmeier, W. F. (2000). Verification of acoustical correlates of emotional speech using formant synthesis. Speech and Emotion, 2000, 151–156. Retrieved from https://www.isca-speech.org/archive_open/speech_emotion/spem_151.html Cahn, J. E. (1990). The generation of affect in synthesized speech. Journal of the American Voice I/O Society, 8, 1–19. Carlson, R., Granström, B., & Nord, L. (1992, October). Experiments with emotive speech-acted utterances and synthesized replicas. Paper presented at the Second International Conference on Spoken Language Processing, Banff, Alberta, Canada. Retrieved from https://www.isca-speech.org/archive/icslp_1992/i92_0671.html Cavanaugh, L. A., MacInnis, D. J., & Weiss, A. M. (2016). Perceptual dimensions differentiate emotions. Cognition and Emotion, 30, 1430–1445. https://doi.org/10.1080/02699931.2015.1070119 Chirico, A., Ferrise, F., Cordella, L., & Gaggioli, A. (2018). Designing awe in virtual reality: An experimental study. Frontiers in Psychology, 8, 2351. https://doi.org/10.3389/fpsyg.2017.02351 Chronaki, G., Hadwin, J. A., Garner, M., Maurage, P., & Sonuga-Barke, E. J. S. (2014). The development of emotion recognition from facial expressions and non-linguistic vocalizations during childhood. British Journal of Developmental Psychology, 33, 218–236. https://doi.org/10.1111/bjdp.12075 Corbeil, M., Trehub, S. E., & Peretz, I. (2013). Speech vs. singing: Infants choose happier sounds. Frontiers in Psychology, 4. https://doi.org/10.3389/fpsyg.2013.00372 Cordaro, D. T., Keltner, D., Tshering, S., Wangchuk, D., & Flynn, L. M. (2016). The voice conveys emotion in ten globalized cultures and one remote village in Bhutan. Emotion, 16, 117. https://doi.org/10.1037/emo0000100 Cosmides, L., & Tooby, J. (2000). Evolutionary psychology and the emotions. In Lewis, M. & Haviland-Jones, J. M. (Eds.), Handbook of emotions (2nd ed., pp. 91–115). New York, NY: Guilford Press. Costanzo, F. S., Markel, N. N., & Costanzo, P. R. (1969). Voice quality profile and perceived emotion. Journal of Counseling Psychology, 16, 267–270. https://doi.org/10.1037/h0027355 Cowie, R., & Douglas-Cowie, E. (1996). Automatic statistical analysis of the signal and prosidic signs of emotion in speech. Proceedings of the 4th International Conference on Spoken Language Processing (ICSLP-96), (Icslp 96), 1989–1992. https://doi.org/10.1109/ICSLP.1996.608027 Dai, K., Fell, H., & MacAuslan, J. (2009). Comparing emotions using acoustics and human perceptual dimensions. Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ‘09, 3341. https://doi.org/10.1145/1520340.1520483 Davila-Ross, M., Owren, M. J., & Zimmermann, E. (2009). Reconstructing the evolution of laughter in great apes and humans. Current Biology, 19, 1106–1111. https://doi.org/10.1016/j.cub.2009.05.028 Davitz, J. R. (1964a). Auditory correlates of vocal expressions of emotional meanings. In J. R. Davitz (Ed.), The communication of emotional meaning (pp. 101–112). New York, NY: McGraw-Hill. Davitz, J. R. (1964b). Personality, perceptual, and cognitive correlates of emotional sensitivity. In J. R. (Ed.), The communication of emotional meaning (pp. 57–68). New York, NY: McGraw-Hill. Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6, 169–200. https://doi.org/10.1080/02699939208411068 Ekman, P. E., & Davidson, R. J. (1994). The nature of emotion: Fundamental questions. Oxford, England: Oxford University Press. Erickson, D., Zhu, C., Kawahara, S., & Suemitsu, A. (2016). Articulation, acoustics and perception of Mandarin Chinese emotional speech. Open Linguistics, 2, 620–635. https://doi.org/10.1515/opli-2016-0034 Eyben, F., Scherer, K. R., Schuller, B. W., Sundberg, J., André, E., Busso, C., … Truong, K. P. (2016). The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for voice research and affective computing. IEEE Transactions on Affective Computing, 7, 190–202. https://doi.org/10.1109/TAFFC.2015.2457417 Fant, G. (1960). Acoustic theory of speech production. The Hague, The Netherlands: Mouton. Fernald, A. (1992). Human maternal vocalizations to infants as biologically relevant signals: An evolutionary perspective. In J. H. Barkow, L. Cosmides, & J. Tooby (Eds.), The adapted mind: Evolutionary psychology and the generation of culture (pp. 345–382). Oxford, England: Oxford University Press. Filippi, P., Congdon, J. V., Hoang, J., Bowling, D. L., Reber, S. A., Pašukonis, A., … Newen, A. (2017). Humans recognize emotional arousal in vocalizations across all classes of terrestrial vertebrates: Evidence for acoustic universals. Proceedings of the Royal Society B: Biological Sciences, 284(1859), 20170990. https://doi.org/10.1098/rspb.2017.0990 Fónagy, I. (1978). A new method of investigating the perception of prosodic features. Language and Speech, 21, 34–49. https://doi.org/10.1177/002383097802100102 Frank, M. G., Juslin, P. N., & Harrigan, J. A. (2005). Technical issues in recording nonverbal behavior. In J. A. Harrigan, R. Rosenthal, & K. R. Scherer (Eds.), The new handbook of methods in nonverbal behavior research (pp. 449–470). New York, NY: Oxford University Press. Fredrickson, B. L. (1998). What good are positive emotions?. Review of General Psychology, 2, 300. https://doi.org/10.1037/1089-2680.2.3.300 Friend, M., & Farrar, M. J. (1994). A comparison of content-masking procedures for obtaining judgments of discrete affective states. The Journal of the Acoustical Society of America, 96, 1283–1290. https://doi.org/10.1121/1.410276 Frijda, N. H., Ortony, A., Sonnemans, J., & Clore, G. L. (1992). The complexity of intensity. Issues concerning the structure of emotion intensity. In M. S. Clark (Ed.), Review of Personality and Social Psychology (Vol. 13, pp. 60–89). Newbury Park, CA: SAGE Publications. Gârding, E. (1986). Intonation och Sinnestämningar. Föredrag vid Humanistdagarna. Lund University Gårding, E., & Abramson, A. S. (1965). A study of the perception of some American English intonation contours. Studia Linguistica, 19, 61–79. https://doi.org/10.1111/j.1467-9582.1965.tb00527.x Gérard, C., & Clément, J. (1998). The structure and development of French prosodic representations. Language and Speech, 41, 117–142. https://doi.org/10.1177/002383099804100201 Gobl, C., & Chasaide, A. N. (2000). Testing affective correlates of voice quality through analysis and resynthesis. Proceedings of the ISCA Workshop on Speech and Emotion, (pp. 178–183). Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.385.1129&rep=rep1&type=pdf Goudbeek, M., & Scherer, K. (2010). Beyond arousal: Valence and potency/control cues in the vocal expression of emotion. The Journal of the Acoustical Society of America, 128, 1322. https://doi.org/10.1121/1.3466853 Hammerschmidt, K., & Jürgens, U. (2007). Acoustical correlates of affective prosody. Journal of Voice, 21, 531–540. https://doi.org/10.1016/j.jvoice.2006.03.002 Higuchi, N., Hirai, T., & Sagisaka, Y. (1997). Effect of speaking style on parameters of fundamental frequency contour. In J. P. H. van Santen, R. W. Sproat, J. P. Olive, & J. Hirschberg (Eds.), Progress in speech synthesis (pp. 417–428). New York, NY: Springer. https://doi.org/10.1007/978-1-4612-1894-4_33 Hirose, K., Minematsu, N., & Kawanami, H. (2000). Analytical and perceptual study on the role of acoustic features in realizing emotional speech. Proceedings of ICSLP 2000, 369–372. House, D. (1990). On the perception of mood in speech: Implications for the hearing impaired. In L. Eriksson & P. Touati (Eds.), Working papers (No. 36, 99–108). Lund, Sweden: Lund University, Department of Linguistics. Huttar, G. L. (1968). Relations between prosodic variables and emotions in normal American English utterances. Journal of Speech, Language, and Hearing Research, 11, 481–487. https://doi.org/10.1044/jshr.1103.481 Iida, A., Campbell, N., Iga, S., Higuchi, F., & Yasumura, M. (2000). A speech synthesis system with emotion for assisting communication. ISCA Tutorial and Research Workshop (ITRW) on Speech And Emotion. Retrieved from https://pdfs.semanticscholar.org/96f1/c563eb9a189911fc9a29569ae4bfb25241ea.pdf Iliou, T., & Anagnostopoulos, C. N. (2009, July). Statistical evaluation of speech features for emotion recognition. Fourth International Conference on Digital Telecommunications, 2009. ICDT’09. (pp. 121–126). https://doi.org/10.1109/ICDT.2009.30 Iriondo, I., Guaus, R., Rodríguez, A., Lázaro, P., Montoya, N., Blanco, J. M., … Longhi, L. (2000). Validation of an acoustical modelling of emotional expression in Spanish using speech synthesis techniques. Speech and Emotion: ISCA Tutorial and Research Workshop (pp. 161–166). Retrieved from http://www.isca-speech.org/archive_open/speech_emotion/spem_161.html Izard, C. E. (2011). Forms and functions of emotions: Matters of emotion–cognition interactions. Emotion Review, 3, 371–378. https://doi.org/10.1177/1754073911410737 Jiang, X., Paulmann, S., Robin, J., & Pell, M. D. (2015). More than accuracy: Nonverbal dialects modulate the time course of vocal emotion recognition across cultures. Journal of Experimental Psychology: Human Perception and Performance, 41, 597. https://doi.org/10.1037/xhp0000043 Jiang, X., & Pell, M. D. (2017). The sound of confidence and doubt. Speech Communication, 88, 106-126. https://doi.org/10.1016/j.specom.2017.01.011 Jo, C. W., Ferencz, A., & Kim, D. H. (1999). Experiments regarding the superposition of emotional features on neutral Korean speech. In V. Matousek, P. Mautner, J. Ocelíková, & P. Sojka (Eds.), Text, speech and dialogue (pp. 333–336). Berlin, Germany: Springer. https://doi.org/10.1007/3-540-48239-3_61 Johnstone, T., & Scherer, K. R. (1999). The effects of emotions on voice quality. Proceedings of the 14th International Conference of Phonetic Sciences (pp. 2029–2032). Retrieved from https://www.internationalphoneticassociation.org/icphs-proceedings/ICPhS1999/papers/p14_2029.pdf Jürgens, R., Grass, A., Drolet, M., & Fischer, J. (2015). Effect of acting experience on emotion expression and recognition in voice: Non-actors provide better stimuli than expected. Journal of Nonverbal Behavior, 39, 195–214. https://doi.org/10.1007/s10919-015-0209-5 Jürgens, R., Hammerschmidt, K., & Fischer, J. (2011). Authentic and play-acted vocal emotion expressions reveal acoustic differences. Frontiers in Psychology, 2, 1–11. https://doi.org/10.3389/fpsyg.2011.00180 Juslin, P. N., & Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion (Washington, D.C.), 1, 381–412. https://doi.org/10.1037/1528-3542.1.4.381 Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129, 770–814. https://doi.org/10.1037/0033-2909.129.5.770 Juslin, P. N., Laukka, P., & Bänziger, T. (2017). The mirror to our soul? Comparisons of spontaneous and posed vocal expression of emotion. Journal of Nonverbal Behavior, 42, 1–40. https://doi.org/10.1007/s10919-017-0268-x Kaiser, L. (1962). Communication of affects by single vowels. Synthese, 14, 300–319. https://doi.org/10.1007/BF00869311 Kao, Y. H., & Lee, L. S. (2006, September). Feature analysis for emotion recognition from Mandarin speech considering the special characteristics of Chinese language. Paper presented at the Ninth International Conference on Spoken Language Processing, Pittsburgh, PA. Keltner, D. (1995). Signs of appeasement: Evidence for the distinct displays of embarrassment, amusement, and shame. Journal of Personality and Social Psychology, 68, 441–454. https://doi.org/10.1037/0022-3514.68.3.441 Keltner, D., Haidt, J., & Shiota, M. N. (2006). Social functionalism and the evolution of emotions. In M. Schaller, J. A. Simpson, & D. T. Kenrick (Eds.), Evolution and social psychology (pp. 115-142). Madison, CT: Psychosocial Press. Kienast, M., & Sendlmeier, W. F. (2000, September). Acoustical analysis of spectral and temporal changes in emotional speech. Paper presented at the ITRW on Speech and Emotion Newcastle, Northern Ireland, UK. Kreiman, J., & Sidtis, D. (2011). Foundations of voice studies: An interdisciplinary approach to voice production and perception. New York, NY: John Wiley & Sons. Laukka, P. (2004). Vocal expression of emotion: discrete-emotions and dimensional accounts (Doctoral dissertation, Acta Universitatis Upsaliensis, Uppsala, Sweden). Laukka, P., Elfenbein, H. A., Söder, N., Nordström, H., Althoff, J., Iraki, F. K. E., … Thingujam, N. S. (2013). Cross-cultural decoding of positive and negative non-linguistic emotion vocalizations. Frontiers in Psychology, 4, 353. https://doi.org/10.3389/fpsyg.2013.00353 Laukka, P., Elfenbein, H. A., Thingujam, N. S., Rockstuhl, T., Frederick, K., Chui, W., …, Althoff, J. (2016). The expression and recognition of emotions in the voice across five nations. Journal of Personality and Social Psychology, 111, 686–705. https://doi.org/10.1037/pspi0000066 Laukka, P., Juslin, P., & Bresin, R. (2005). A dimensional approach to vocal expression of emotion. Cognition and Emotion, 19, 633–653. https://doi.org/10.1080/02699930441000445 Laukkanen, A.-M., Vilkman, E., Alku, P., & Oksanen, H. (1996). Physical variations related to stress and emotional state: A preliminary study. Journal of Phonetics, 24, 313–335. https://doi.org/10.1006/jpho.1996.0017 Laukkanen, A.-M., Vilkman, E., Alku, P., & Oksanen, H. (1997). On the perception of emotions in speech: the role of voice quality. Logopedics Phonatrics Vocology, 22, 157-168. https://doi.org/10.3109/14015439709075330 Lavan, N., Scott, S. K., & McGettigan, C. (2016). Laugh like you mean it: Authenticity modulates acoustic, physiological and perceptual properties of laughter. Journal of Nonverbal Behavior, 40, 133–149. https://doi.org/10.1007/s10919-015-0222-8 Leinonen, L., Hiltunen, T., Linnankoski, I., & Laakso, M.-L. (1997). Expression of emotional–motivational connotations with a one-word utterance. Journal of the Acoustic Society of America, 102, 1853–1863. https://doi.org/10.1121/1.420109 Levenson, R. W., Carstensen, L. L., & Gottman, J. M. (1993). Long-term marriage: Age, gender, and satisfaction. Psychology and Aging, 8, 301. https://doi.org/10.1037/0882-7974.8.2.301 Levitt, E. A. (1964). The relationship between abilities to express emotional meanings vocally and facially. In J. R. Davitz, (Ed.), The communication of emotional meaning (pp. 87–100). New York, NY: McGraw-Hill. Lieberman, P., & Michaels, S. B. (1962). Some aspects of fundamental frequency and envelope amplitude as related to the emotional content of speech. The Journal of the Acoustical Society of America, 34, 922–927. https://doi.org/10.1121/1.1918222 Lima, C. F., Alves, T., Scott, S. K., & Castro, S. L. (2014). In the ear of the beholder: How age shapes emotion processing in nonverbal vocalizations. Emotion, 14, 145–160. https://doi.org/10.1037/a0034287 Lima, C. F., Castro, S. L., & Scott, S. K. (2013). When voices get emotional: A corpus of nonverbal vocalizations for research on emotion processing. Behavior Research Methods, 45, 1234–1245. https://doi.org/10.3758/s13428-013-0324-3 Liscombe, J., Venditti, J., & Hirschberg, J. (2003, September). Classifying subject ratings of emotional speech using acoustic features. Paper presented at the 8th European Conference on Speech Communication and Technology, Geneva, Switzerland. Luengo, I., & Navas, E. (2005). Automatic emotion recognition using prosodic parameters department of electronics and telecommunication university of the Basque Country, Spain. Power, 493–496. Retrieved from https://pdfs.semanticscholar.org/4365/2c67ec12e9e79041dc2c862d2c26bd88b118.pdf Majid, A. (2012). Current emotion research in the language sciences. Emotion Review, 4, 432–443. https://doi.org/10.1177/1754073912445827 McConnell, P. B. (1991). Lessons from animal trainers: The effect of acoustic structure on an animal’s response. In P. Bateson & P. Klopfer (Eds.), Perspectives in ethology (pp. 165–187). New York, NY: Plenum Press. McGettigan, C., Walsh, E., Jessop, R., Agnew, Z. K., Sauter, D. A., Warren, J. E., & Scott, S. K. (2015). Individual differences in laughter perception reveal roles for mentalizing and sensorimotor systems in the evaluation of emotional authenticity. Cerebral Cortex, 25, 246–257. https://doi.org/10.1093/cercor/bht227 Moriyama, T., & Ozawa, S. (2001). Measurement of human vocal emotion using fuzzy control. Systems and Computers in Japan, 32, 59–68. https://doi.org/10.1002/scj.1019 Mortillaro, M., Mehu, M., & Scherer, K. R. (2011). Subtly different positive emotions can be distinguished by their facial expressions. Social Psychological and Personality Science, 2, 262–271. https://doi.org/10.1177/1948550610389080 Mozziconacci, S. J. L. (1998). Speech variability and emotion: Production and perception. Eindhoven, The Netherlands: Technische Universiteit Eindhoven. Murray, I. R., & Arnott, J. L. (1993). Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion. Journal of the Acoustical Society of America, 93, 1097–1108. https://doi.org/10.1121/1.405558 Nagasaki, Y., & Komatsu, T. (2004, March). Can people perceive different emotions from a non-emotional voice by modifying its F0 and duration?. Paper presented at the Speech Prosody 2004, International Conference, Nara, Japan. Neves, L., Cordeiro, C., Scott, S. K., Castro, S. L., & Lima, C. F. (2018). High emotional contagion and empathy are associated with enhanced detection of emotional authenticity in laughter. Quarterly Journal of Experimental Psychology, 71, 2355–2363. https://doi.org/10.1177/1747021817741800 Paeschke, A., Kienast, M., & Sendlmeier, W. F. (1999, August). F0-contours in emotional speech. Proceedings of the ICPhS (Vol. 99, pp. 929–933). Retrieved from https://icphs2019.org/icphs2019-fullpapers/pdf/full-paper_409.pdf Paeschke, A., & Sendlmeier, W. F. (2000). Prosodic characteristics of emotional speech: Measurements of fundamental frequency movements. Speech and Emotion. ISCA Tutorial and Research Workshop (pp. 75–80). Retrieved from http://www.isca-speech.org/archive_open/speech_emotion/spem_075.html Pajupuu, H., Pajupuu, J., Tamuri, K., & Altrov, R (2015). Influence of verbal content on acoustics of speech emotions. Proceedings of the 18th international Congress of Phonetic Sciences. Retrieved from https://www.internationalphoneticassociation.org/icphs-proceedings/ICPhS2015/Papers/ICPHS0654.pdf Panksepp, J., & Watt, D. (2011). What is basic about basic emotions? Lasting lessons from affective neuroscience. Emotion Review, 3, 387–396. https://doi.org/10.1177/1754073911410741 Patel, S., Scherer, K. R., Björkner, E., & Sundberg, J. (2011). Mapping emotions into acoustic space: The role of voice production. Biological Psychology, 87, 93–98. https://doi.org/10.1016/j.biopsycho.2011.02.010 Pell, M. D. (2001). Influence of emotion and focus location on prosody in matched statements and questions. The Journal of the Acoustical Society of America, 109, 1668–1680. https://doi.org/10.1121/1.1352088 Pell, M. D., Paulmann, S., Dara, C., Alasseri, A., & Kotz, S. A. (2009). Factors in the recognition of vocally expressed emotions: A comparison of four languages. Journal of Phonetics, 37, 417–435. https://doi.org/10.1016/j.wocn.2009.07.005 Pell, M. D., Rothermich, K., Liu, P., Paulmann, S., Sethi, S., & Rigoulot, S. (2015). Preferential decoding of emotion from human non-linguistic vocalizations versus speech prosody. Biological Psychology, 111, 14–25. https://doi.org/10.1016/j.biopsycho.2015.08.008 Pereira, C., & Watson, C. (1998, December). Some acoustic characteristics of emotion. Paper presented at the Fifth International Conference on Spoken Language Processing Sydney, Australia. Petrushin, V. (1999). Emotion in speech: Recognition and application to call centers. Proceedings of Artificial Neural Networks in Engineering (pp. 7–10). Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.42.3157&rep=rep1&type=pdf Pollermann, B. Z., & Archinard, M. (2002). Acoustic patterns of emotions. In E. Keller, G. Bailly, A. Monoghan, J. Terken, & M. Huckvale (Eds.), Improvements in speech synthesis (pp. 237–245). Chichester, England: John Wiley & Sons. Rachman, L., Liuni, M., Arias, P., Lind, A., Johansson, P., Hall, L., … Aucouturier, J. J. (2018). DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech. Behavior Research Methods, 50, 323–343. https://doi.org/10.3758/s13428-017-0873-y Rao, K. S., Koolagudi, S. G., & Vempada, R. R. (2013). Emotion recognition from speech using global and local prosodic features. International Journal of Speech Technology, 16, 143–160. https://doi.org/10.1007/s10772-012-9172-2 Rendall, D., Owren, M. J., & Ryan, M. J. (2009). What do animal signals mean? Animal Behaviour, 78, 233–240. https://doi.org/10.1016/j.anbehav.2009.06.007 Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161–1178. https://doi.org/10.1037/h0077714 Sauter, D. A. (2017). The nonverbal communication of positive emotions: An emotion family approach. Emotion Review, 9, 222–234. https://doi.org/10.1177/1754073916667236 Sauter, D. A., Eisner, F., Ekman, P., & Scott, S. K. (2010). Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. Proceedings of the National Academy of Sciences, 107, 2408–2412. https://doi.org/10.1073/pnas.0908239106 Sauter, D. A., & Fischer, A. H. (2018). Can perceivers recognise emotions from spontaneous expressions?. Cognition and Emotion, 32, 504–515. https://doi.org/10.1080/02699931.2017.1320978 Sauter, D. A., & Scott, S. K. (2007). More than one kind of happiness: Can we recognize vocal expressions of different positive states?. Motivation and Emotion, 31, 192–199. https://doi.org/10.1007/s11031-007-9065-x Scherer, K. R. (1972, April). Acoustic concomitants of emotional dimensions—Judging affect from synthesized tone sequences. Presented at the Eastern Psychological Association Meeting, Boston, MA. Scherer, K.R. (1981). Speech and emotional states. In J. Darby (Ed.), The evaluation of speech in psychiatry and medicine (pp. 189–220). New York, NY: Grune and Stratton. Scherer, K. R. (1986). Vocal affect expression: a review and a model for future research. Psychological Bulletin, 99, 143–165. https://doi.org/10.1037/0033-2909.99.2.143 Scherer, K. R. (1994). Affect bursts. In S. H. M. van Goozen, N. E. Van de Poll, & J. A. Sergeant (Eds.), Emotions: Essays on emotion theory (pp. 161–193). Hillsdale, NJ: Erlbaum. Scherer, K. R. (2003). Vocal communication of emotion: A review of research paradigms. Speech Communication, 40, 227–256. https://doi.org/10.1016/S0167-6393(02)00084-5 Scherer, K. R. (2013). Vocal markers of emotion: Comparing induction and acting elicitation. Computer Speech and Language, 27, 40–58. https://doi.org/10.1016/j.csl.2011.11.003 Scherer, K. R., Banse, R., Wallbott, H. G., & Goldbeck, T. (1991). Vocal cues in emotion encoding and decoding. Motivation and Emotion, 15, 123–148. https://doi.org/10.1007/BF00995674 Scherer, K. R., & Oshinsky, J. S. (1977). Cue utilization in emotion attribution from auditory stimuli. Motivation and Emotion, 1, 331–346. https://doi.org/10.1007/BF00992539 Scherer, K. R., Sundberg, J., Tamarit, L., & Salomão, G. L. (2015). Comparing the acoustic expression of emotion in the speaking and the singing voice. Computer Speech & Language, 29, 218–235. https://doi.org/10.1016/j.csl.2013.10.002 Schröder, M. (2001). Emotional speech synthesis: A review. Paper presented at the Seventh European Conference on Speech Communication and Technology. Retrieved from http://www1.cs.columbia.edu/~julia/papers/schroeder01.pdf Scott, S., Sauter, D., & McGettigan, C. (2009). Brain mechanisms for processing perceived emotional vocalizations in humans. In S. M. Brudzynski (Ed.), Handbook of mammalian vocalisation: An integrative neuroscience approach (pp. 187–197). San Diego, CA: Academic Press. Seppänen, T., Väyrynen, E., & Toivanen, J. (2003). Prosody-based classification of emotions in spoken Finnish. Eighth European Conference on Speech Communication and Technology. Retrieved from https://www.isca-speech.org/archive/eurospeech_2003/e03_0717.html Seyfarth, R. M., Cheney, D. L., Bergman, T., Fischer, J., Zuberbühler, K., & Hammerschmidt, K. (2010). The central importance of information in studies of animal communication. Animal Behaviour, 80, 3–8. https://doi.org/10.1016/j.anbehav.2010.04.012 Shiota, M. N., Campos, B., Oveis, C., Hertenstein, M. J., Simon-Thomas, E., & Keltner, D. (2017). Beyond happiness: Building a science of discrete positive emotions. American Psychologist, 72, 617. https://doi.org/10.1037/a0040456 Shiota, M. N., Neufeld, S. L., Danvers, A. F., Osborne, E. A., Sng, O., & Yee, C. I. (2014). Positive emotion differentiation: A functional approach. Social and Personality Psychology Compass, 8, 104–117. https://doi.org/10.1111/spc3.12092 Simon-Thomas, E. R., Keltner, D. J., Sauter, D., Sinicropi-Yao, L., & Abramson, A. (2009). The voice conveys specific emotions: Evidence from vocal burst displays. Emotion, 9, 838–846. https://doi.org/10.1037/a0017810 Skinner, E. R. (1935). A calibrated recording and analysis of the pitch, force and quality of vocal tones expressing happiness and sadness; and a determination of the pitch and force of the subjective concepts of ordinary, soft, and loud tones. Communications Monographs, 2, 81-137. https://doi.org/10.1080/03637753509374833 Sobin, C., & Alpert, M. (1999). Emotion in speech: The acoustic attributes of fear, anger, sadness, and joy. Journal of Psycholinguistic Research, 28, 347–365. https://doi.org/10.1023/A:1023237014909 Soderstrom, M., Reimchen, M., Sauter, D., & Morgan, J. L. (2017). Do infants discriminate non-linguistic vocal expressions of positive emotions? Cognition and Emotion, 31, 298–311. https://doi.org/10.1080/02699931.2015.1108904 Stibbard, R., (2001). Vocal expression of emotions in non-laboratory speech. Unpublished doctoral thesis, University of Reading, UK. Szameitat, D. P., Alter, K., Szameitat, A. J., Wildgruber, D., Sterr, A., & Darwin, C. J. (2009). Acoustic profiles of distinct emotional expressions in laughter. The Journal of the Acoustical Society of America, 126, 354–366. https://doi.org/10.1121/1.3139899 Sztahó, D., Imre, V., & Vicsi, K. (2011). Automatic classification of emotions in spontaneous speech. Lecture Notes in Computer Science, 229–239. https://doi.org/10.1007/978-3-642-25775-9_23 Tanaka, H., & Campbell, N. (2011, August). Acoustic features of four types of laughter in natural conversational speech. Proceedings of the 17th International Congress of Phonetic Sciences (ICPhS (pp. 1958–1961). Retrieved from https://www.internationalphoneticassociation.org/icphs-proceedings/ICPhS2011/OnlineProceedings/RegularSession/Tanaka/Tanaka.pdf Thompson, W. F., & Balkwill, L. L. (2006). Decoding speech prosody in five languages. Semiotica, 2006, 407–424. https://doi.org/10.1515/SEM.2006.017 Tischer, B. (1995, September). Acoustic correlates of perceived emotional stress. ESCA/NATO Tutorial and Research Workshop on Speech Under Stress (pp. 29–32). Retrieved from https://www.isca-speech.org/archive_open/sus_95/sus5_029.html Titze, I. R. (1994). Principles of voice production. Englewood Cliffs, NJ: Prentice Hall. Toivanen, J., Waaramaa, T., Alku, P., Laukkanen, A.-M., Seppänen, T., Väyrynen, E., & Airas, M. (2006). Emotions in [a]: A perceptual and acoustic study. Logopedics Phoniatrics Vocology, 31, 43–48. https://doi.org/10.1080/14015430500293926 Tooby, J., & Cosmides, L. (2008). The evolutionary psychology of the emotions and their relationship to internal regulatory variables. In M. Lewis, J. M. Haviland-Jones, & L. F. Barrett (Eds.), Handbook of emotions (pp. 114–137). New York, NY: Guilford Press. Tracy, J. L., & Robins, R. W. (2008). The nonverbal expression of pride: Evidence for cross-cultural recognition. Journal of Personality and Social Psychology, 94, 516. https://doi.org/10.1037/0022-3514.94.3.516 Trainor, L. J., Austin, C. M., & Desjardins, R. N. (2000). Is infant-directed speech prosody a result of the vocal expression of emotion? Psychological Science, 11, 188–195. https://doi.org/10.1111/1467-9280.00240 Trouvain, J., & Barry, W. J. (2000). The prosody of excitement in horse race commentaries. ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion. Retrieved from https://www.isca-speech.org/archive_open/speech_emotion/spem_086.html van Bezooijen, R. (1984). Characteristics and recognizability of vocal expressions of emotion (Vol. 5). Berlin, Germany: Walter de Gruyter. https://doi.org/10.1515/9783110850390 Viscovich, N., Borod, J., Pihan, H., Peery, S., Brickman, A. M., Tabert, M., … Spielman, J. (2003). Acoustical analysis of posed prosodic expressions: Effects of emotion and sex. Perceptual and Motor Skills, 96, 759–771. https://doi.org/10.2466/pms.2003.96.3.759 Von Bismarck, G. (1974). Sharpness as an attribute of the timbre of steady sounds. Acta Acustica United With Acustica, 30(3), 159–172. Waaramaa, T., Laukkanen, A. M., Airas, M., & Alku, P. (2010). Perception of emotional valences and activity levels from vowel segments of continuous speech. Journal of Voice, 24, 30–38. https://doi.org/10.1016/j.jvoice.2008.04.004 Wallbott, H. G., & Scherer, K. R. (1986). Cues and channels in emotion recognition. Journal of Personality and Social Psychology, 51, 690–699. https://doi.org/10.1037/0022-3514.51.4.690 Wang, Y., Du, S., & Zhan, Y. (2008, October). Adaptive and optimal classification of speech emotion recognition. Natural Computation, 2008. ICNC'08. Fourth International Conference on (Vol. 5, pp. 407-411). https://doi.org/10.1109/ICNC.2008.713 Weidman, A. C., Steckler, C. M., & Tracy, J. L. (2017). The jingle and jangle of emotion assessment: Imprecise measurement, casual scale usage, and conceptual fuzziness in emotion research. Emotion, 17, 267. https://doi.org/10.1037/emo0000226 Whiteside, S. P. (1999a). Acoustic characteristics of vocal emotions simulated by actors. Perceptual and Motor Skills, 89, 1195–1208. https://doi.org/10.2466/pms.1999.89.3f.1195 Whiteside, S. P. (1999b). Note on voice and perturbation measures in simulated vocal emotions. Perceptual and Motor Skills, 88, 1219–1222. https://doi.org/10.2466/pms.1999.88.3c.1219 Wiley, R. H. (1983). The evolution of communication: Information and manipulation. In T. R. Halliday & P. J. B. Slater (Eds.), Animal behaviour, Vol. 2: Communication (pp. 156–189). New York, NY: W. H. Freeman. Williams, C. E., & Stevens, K. N. (1981). Vocal correlates of emotional states. In J. K. Darby (Ed.), Speech evaluation in psychiatry (pp. 221–240). New York, NY: Grune and Stratton. Wood, A., Martin, J., & Niedenthal, P. (2017). Towards a social functional account of laughter: Acoustic features predict perceptions of reward, affiliation, and dominance. PLOS ONE, 12: e0183811. https://doi.org/10.1371/journal.pone.0183811 Yildirim, S., Bulut, M., & Lee, C. (2004, October). An acoustic study of emotions expressed in speech. Proceedings of InterSpeech, Jeju, Korea. Yuan, J., Shen, L., & Chen, F. (2002). The acoustic realization of anger, fear, joy and sadness in Chinese. Proceedings of ICSLP (pp. 2025–2028). Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.176.7275&rep=rep1&type=pdf Zhang, S. (2008). Emotion recognition in Chinese natural speech by combining prosody and voice quality features. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5264 LNCS (PART 2), 457–464. https://doi.org/10.1007/978-3-540-87734-9-52 Zuberbühler, K. (2009). Survivor signals: the biology and psychology of animal alarm calling. Advances in the Study of Behavior 40, 277–322. https://doi.org/10.1016/s0065-3454(09)40008-1