Abstract
We examined the features of cross-cultural recognition of four basic emotions “joy – neutral (calm state) - sadness - anger” in the spontaneous and acting speech of Indian and Russian children across Russian and Tamil languages. Cross-cultural studies point that although basic emotion recognition is universal; emotion recognition is more accurate when speakers and receivers come from the same culture than the other cultures. The results showed that Russian and Indian experts recognized correctly the emotional states of children by their speech, but with different accuracy. Both groups of experts agreed on the state of sadness via spontaneous and acting speech of Russian children and the neutral state in spontaneous speech and anger state in the acting speech of Indian children. The importance of cultural recognition are that Indian experts classify more speech samples of spontaneous and acting speech from Russian children as reflecting a state of anger, Russian experts - a state of joy and a neutral state in the acting speech of Tamil children. Differences were revealed in the acoustic characteristics of the speech of Russian and Indian children, reflecting the basic emotions. Experts, when recognizing emotions in spontaneous speech, rely on the pitch values, in acting speech - on the intensity. The novelty of our finding lies in the cross-cultural recognition of emotions from the speech of children and the comparison of two distant languages - Russian and Tamil.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Darwin, C.: The Expression of the Emotions in Man and Animals. John Murray, London (1872)
Ekman, P.: Universals and cultural differences in facial expressions of emotions. In: Cole, J. (ed.) Nebraska Symposium on Motivation, 1971, vol. 19, pp. 207–282. University of Nebraska Press, Lincoln (1972)
Ekman, P.: Basic emotions. In: Dalgleish, T., Power, M.J. (eds.) Handbook of Cognition and Emotion, pp. 45–60. John Wiley & Sons, Ltd, Hoboken (1999)
Izard, K.: Human Emotions. Plenum Press, New York (1977)
Elfenbein, H.A., Ambady, N.: On the universality and cultural specificity of emotion recognition: a meta-analysis. Psychol. Bull. 128(2), 203–235 (2002)
Sauter, D.A., Eisner, F., Ekman, P., Scott, S.K.: Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. Proceedings of the National Academy of Science of the United States of America 107(6), 2408–2412 (2010)
Nordström, H., Laukka, P., Thingujam, N.S., Schubert, E., Elfenbein, H.A.: Emotion appraisal dimensions inferred from vocal expressions are consistent across cultures: a comparison between Australia and India. R. Soc. Open Sci. 4(11), 170912 (2017)
Jiang, X., Paulmann, S., Robin, J., Pell, M.D.: More than accuracy: Nonverbal dialects modulate the time course of vocal emotion recognition across cultures. J. Exp. Psychol. Hum. Percept. Perform. 41, 597–612 (2015)
Goy, H., Pichora-Fuller, M.K., van Lieshout, P.: Effects of age on speech and voice quality ratings. J. Acoust. Soc. Am. 139(4), 1648–1659 (2016)
Lausen, A., Schacht, A.: Gender differences in the recognition of vocal emotions. Front. Psychol. 9, 882 (2018)
Laukka, P., Elfenbein, H.A.: Cross-cultural emotion recognition and in-group advantage in vocal expression: a meta-analysis. Emot. Rev. 13(1), 3–11 (2020)
Thompson, W.F., Balkwill, L.L.: Decoding speech prosody in five languages. Semiotica 158, 407–424 (2006)
Yoshie, M., Sauter, D.A.: Cultural norms influence nonverbal emotion communication: Japanese vocalizations of socially disengaging emotions. Emotion 20(3), 513–517 (2020)
Cordaro, D.T., Keltner, D., Tshering, S., Wangchuk, D., Flynn, L.M.: The voice conveys emotion in ten globalized cultures and one remote village in Bhutan. Emotion 16(1), 117–128 (2016)
Elfenbein, H.A.: Nonverbal dialects and accents in facial expressions of emotion. Emot. Rev. 5, 90–96 (2013)
Stein, B.: Circulation and the historical geography of Tamil country. J. Asian Stud. 37(1), 7–26 (1977)
Lyakso, E.E., Ruban, N., Frolova, O.V., Gorodnyi, V.A., Matveev, Y.N.: Approbation of a method for studying the reflection of emotional state in children’s speech and pilot psychophysiological experimental data. Int. J. Adv. Trends Comput. Sci. Eng. 9(1), 649–656 (2020)
Liu, P., Pell, M.D.: Recognizing vocal emotions in Mandarin Chinese: a validated database of Chinese vocal emotional stimuli. Behav. Res. Methods 44(4), 1042–1051 (2012). https://doi.org/10.3758/s13428-012-0203-3
Castro, S.L., Lima, C.: Recognizing emotions in spoken language: a validated set of Portuguese sentences and pseudo sentences for research on emotional prosody. Behav. Res. Methods 42(1), 74–81 (2010)
Schuller, B., et al.: Cross-corpus acoustic emotion recognition: variances and strategies. IEEE Trans. Affect. Comput. 1(2), 119–131 (2010)
Carrol, L.: Through the Looking-Glass and What Alice Found There. Macmillan and Co, London (1872)
Heyman, M., Satpathy, S., Ravishankar, A.: The Tenth Rasa: An Anthology of Indian Nonsense. Penguin Books India, New Delhi (2007)
Johnstone, T., Scherer, K.R.: Vocal communication of emotion. In: Lewis, M., Haviland, J. (eds.) Handbook of Emotions, 2nd edn., pp. 220–235. Guilford Press, New York (2000)
Breitenstein, C., Lancker, D.V., Daum, I.: The contribution of speech rate and pitch variation to the perception of vocal emotions in a German and an American sample. Cogn. Emot. 15(1), 57–79 (2001)
Lyakso, E., Frolova, O.: Emotion state manifestation in voice features: chimpanzees, human infants, children, adults. In: Ronzhin, A., Potapova, R., Fakotakis, N. (eds.) SPECOM 2015. LNCS (LNAI), vol. 9319, pp. 201–208. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-23132-7_25
Chronaki, G., Wigelsworth, M., Pell, M.D., Kotz, S.A.: The development of cross-cultural recognition of vocal emotion during childhood and adolescence. Sci. Rep. 8, 8659 (2018)
Paulmann, S., Uskul, A.K.: Cross-cultural emotional prosody recognition: evidence from Chinese and British listeners. Cogn. Emot. 28, 230–244 (2014)
Lausen, A., Hammerschmidt, K.: Emotion recognition and confidence ratings predicted by vocal stimulus type and prosodic parameters. Humanit. Soc. Sci. Commun. 7(2), 1–17 (2020)
Cowen, A.S., Elfenbein, H.A., Laukka, P., Keltner, D.: Mapping 24 emotions conveyed by brief human vocalization. Am. Psychol. 74(6), 698–712 (2019)
Baumeister, R.F., Bratslavsky, E., Finkenauer, C., Vohr, K.D.: Bad is stronger than good. Rev. Gen. Psychol. 5(4), 323–370 (2001)
Gilam, G., Hendler, T.: Deconstructing anger in the human brain. Curr. Top. Behav. Neurosci. 30, 257–273 (2017)
Kamiloğlu, R.G., Fischer, A.H., Sauter, D.A.: Good vibrations: a review of vocal expressions of positive emotions. Psychon. Bull. Rev. 27(2), 237–265 (2020). https://doi.org/10.3758/s13423-019-01701-x
Guo, D., Yu, H., Hu, A., Ding, Y.: Statistical analysis of acoustic characteristics of Tibetan Lhasa dialect speech emotion. In: SHS Web of Conferences. 25: 01017 (2016)
Acknowledgments
The research was financially supported by the Russian Foundation for Basic Research (project 19-57-45008–IND) – for Russian researchers, and Department of Science and Technology (DST) (INTRUSRFBR382) - for Indian researchers.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Lyakso, E., Frolova, O., Ruban, N., Mekala, A.M. (2021). Child’s Emotional Speech Classification by Human Across Two Languages: Russian & Tamil. In: Karpov, A., Potapova, R. (eds) Speech and Computer. SPECOM 2021. Lecture Notes in Computer Science(), vol 12997. Springer, Cham. https://doi.org/10.1007/978-3-030-87802-3_35
Download citation
DOI: https://doi.org/10.1007/978-3-030-87802-3_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87801-6
Online ISBN: 978-3-030-87802-3
eBook Packages: Computer ScienceComputer Science (R0)