RESONANCE IN EXPRESSIONS OF FACIAL AFFECT AND VOICE AFFECT IN “FROZEN” ANIMATION

Hoang Chau Vo1,
1 Quy Nhon University

Main Article Content

Abstract

In contemporary discourse analysis, understanding communication extends beyond written and spoken words to encompass a broader range of modes, including images, gestures, and sounds. Multimodal Discourse Analysis emerges to explore how meaning is constructed and communicated through these diverse modes within various contexts. This study addresses this fruitful field by examining the relationship between voice qualities and facial expressions in conveying emotions through a popular children’s animation called “Frozen”. The analysis is based on Ngo et al.’s (2022) framework to explore the interplay of the two systems of Facial Affect and Voice Affect from an interpersonal perspective. In analyzing Elsa, one of the two main characters in the animation, we found that she is largely portrayed as having low spirits, evident in the type of facial and vocal features she expresses. Although there are occasional disjunctions between these two systems of affect, likely stemming from contextual variables or production flaws, the majority of instances reveal resonance between Elsa’s expressed features of Facial Affect and Voice Affect. Theoretically, the findings involving a complete animation contribute to the literature on multimodal texts targeted at children. It also yields practical benefits in encouraging the utilization of multimodal resources to enhance children’s language and social development.

Article Details

References

Akmal, A., Latiffani, C., & Almeina, I. (2022). An analysis of multimodals on Grab advertisement. Jurnal Ilmu Pendidikan Nonformal, 8(1), 65-74. https://doi.org/10.37905/aksara.8.1.65-74.2022
Asseel, D. A. (2020). Seeing the unseen: Euphemism in animated films a multimodal and critical discourse study [Unpublished M.A. Thesis]. Lancaster University.
Bateman, J. (2008). Multimodality and genre: A foundation for the systematic analysis of multimodal documents. Springer, Hampshire.
Boersma, P., & van Heuven, V. (2001). Speak and unspeak with Praat. Glot International, 5(9), 341-347.
Brady, C. K. (2015). A multimodal discourse analysis of female K-pop music videos [Unpublished Ph.D. Thesis]. University of Birmingham.
Butt, D., Fahey, R., Feez, S., Spinks, S., & Yallop, C. (2003). Using functional grammar: An explorer’s guide (2nd ed.). NSW: Macquarie University.
Darwin, C. (1872). The expression of emotion in man and animals. London: Harper Collins Publishers.
Gioia, M. (2014, March 19). Disney’s Oscar-winning film “Frozen” will become highest-grossing animated film. Playbill. https://playbill.com/article/disneys-oscar-winning-film-frozen-will-become-highest-grossing-animated-film-com-216182
Halliday, M. A. K. (1985). Systemic background. In J. D. Benson, & W. S. Greaves (Eds.), Systemic perspectives on discourse: Selected theoretical papers from the 9th international systemic workshop. Ablex Publishing Corporation.
Halliday, M. A. K. (1994). An introduction to functional grammar (2nd ed.). Edward Arnold.
Hood, S (2011). Body language in face-to-face teaching: A focus on textual and interpersonal meaning. In S. Dreyfus, S. Hood & M. Stenglin (Eds.), Semiotic margins: Meaning in multimodalities. Continuum.
Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code?. Psychological Bulletin, 129(5), 770-814. https://doi.org/10.1037/0033-2909.129.5.770
Kress, G., & van Leeuwen, T. (2006). Reading images: The grammar of visual design (2nd ed.). London: Routledge.
Lisiecka, A. (2019). Comparing multimodal film texts: The case of the movie Fame (1980) and its remake Fame (2009). CROSSROADS A Journal of English Studies, 25(2), 52-65. https://doi.org/10.15290/cr.2019.25.2.03
Makram, N. M. (2021). A multimodal discourse analysis of American animated feature film (The Wizard of Oz) and Japanese anime (Spirited Away). Journal of Humanities, Social Sciences and Education, 8(3), 59-81. https://doi.org/10.21608/buhuth.2021.94743.1186
Martin, J. R., & Rose, D. (2007). Working with discourse: Meaning beyond the clause. Continuum, London.
Martin, J. R., & White, P (2005). The language of evaluation: Appraisal in English. Palgrave Macmillan, Basingstoke.
Mowafy, M. M. (2021). US foreign policy during the presidency of Trump: A multimodal discourse analysis of selected political cartoons in Al-Ahram weekly. BSU International Journal of Humanities and Social Science, 4(1), 172-203. https://doi.org/10.21608/buijhs.2022.225722
Mulroy, C. (2023, December 20). Highest grossing animated movie of all time: Why it’s a debate between two Disney hits. USA Today. https://www.usatoday.com/story/life/2023/05/12/highest-grossing-animated films/11729384002/
Nespor, M., & Vogel, I. (2007). Prosodic phonology: With a new foreword. Walter de Gruyter, Berlin.
Ngo, T., Hood, S., Martin, J. R., Painter, C., Smith, B. A., & Zappavigna, M. (2022). Modelling paralanguage using systemic function semiotics. Bloomsbury Publishing Plc.
Nurlina, N. (2023). A multimodal discourse analysis on the representation of racism in the film “Armageddon Time” [Unpublished M.A. Thesis]. Lancester University.
O’Halloran, K. L. (2004). Multimodal discourse analysis: Systemic-Functional perspectives. Continuum, London.
O’Toole, M. (1994). The language of displaced art. Leicester University Press.
Phan, T. K. H. (2020). A study of cartoon trailers in English from the perspective of multimodal discourse analysis [Unpublished M.A. Thesis]. Da Nang University.
Rady, R. M. A. (2023). A multimodal discourse analysis of the American animated feature Film (Pocahontas) by Walt Disney Production. Egyptian Journals, 6(44), 1-29. https://doi.org/10.21608/jfhsc.2023.302240
Rasheed, S., Fayyaz, A., & Danish, M. H. (2020). Acquirements of moralistic values through animation: A multimodal analysis of short film “Spell Bound”. European Academic Research, 6(6), 2917-2937.
Roach, P. (2009) English phonetics and phonology: A practical course (4th ed.). Cambridge University Press.
Ruswardiningsih, D., & Djohan, R. S. (2022). An Aqua advertisement’s multimodal discourse analysis. International Journal of Linguistics, Literature and Translation, 5(1), 230-237. https://doi.org/10.32996/ijllt.2022.5.1.27
Sánchez-Vizcaíno, M., Cancelas-Ouviña, L., & Fonseca-Mora, M. C. (2023). A multimodal analysis for an updated vision of women in music videos. Observatorio Journal, 17(3), 171-193. https://doi.org/10.15847/obsobs17320232229
Sauter, D. (2006). An investigation into vocal expressions of emotions: The roles of valence, culture, and acoustic factors [Unpublished Ph.D. Thesis]. University College London.
Scherer, K. R., & Banse, R. (1991). Vocal cues in emotion encoding and decoding. Motivation and Emotion, 15(2), 123-148. https://doi.org/10.1007/bf00995674
Shehatta, S. (2020). Breaking stereotypes: A multimodal analysis of the representation of the female lead in the animation movie Brave. Journal of English and Comparative Studies, 2(1), 170-194. https://doi.org/10.21608/ttaip.2020.133423
Silva, M. d. (2016). Accounting for multimodality in an EFL textbook: Analyzing activities and suggesting ways to approach multimodal texts. Diálogo das Letras, Pau dos Ferros, 5(2), 92-109.
Ton, N. M. N., & Nguyen, T. M. P. (2019). Exploring text-image relations in English comics for children: The case of “Little Red Riding Hood”. VNU Journal of Foreign Studies, 35(3), 128-138. https://doi.org/10.25073/2525-2445/vnufs.4372
Unsworth, L., & Ngo, T. T. B. (2015). The role of images in Vietnamese textbooks for the teaching of English as a foreign language. Language and Life, 1(231), 93-99.
Van Leeuwen, T. (1999). Speech, music, sound. Macmillan, London.
Vo, T. M. T. (2016). English nursery rhymes from a multimodal discourse analysis perspective [Unpublished M.A. Thesis]. Quy Nhon University.
Wu, A. (2023). The images of China in political cartoons of foreign media. Open Journal of Modern Linguistics, 13, 523-558. https://doi.org/10.4236/ojml.2023.134033
Zappavigna, M., & Martin, J. R. (2018). Discourse and diversionary justice: An analysis of Youth Justice Conferencing. Palgrave Macmillan, London.