MULTIMODAL METAPHORS OF SOCIAL ACTORS IN ENGLISH MENTAL HEALTH INFOGRAPHICS
Main Article Content
Abstract
This study investigates the multimodal metaphors utilized in conceptualizing social actors within English mental health infographics. Adopting the Metaphor Identification Procedure by the Pragglejaz Group (2007), combined with Bobrova’s (2015) model for identifying multimodal metaphors, the research analyzes ten selected infographics to uncover metaphorical patterns. The interpretation of metaphorical meanings follows Kövecses’s (2017) multi-level view framework, which examines metaphors across four levels: image schema, domain, frame, and mental space. At each level, the analysis unveils the intricate cognitive processes underlying the construction and interpretation of these metaphors. Two dominant metaphors were found: “AN INDIVIDUAL'S MENTAL HEALTH IS A TREE/GARDEN” and “AN INDIVIDUAL'S MENTAL HEALTH IS AN AUTOMOBILE”. These metaphors, recurrent across various infographics, offer distinct conceptualizations of mental health, emphasizing themes of nurturing and growth as well as control and navigation, respectively. This research contributes to the understanding of how metaphors shape discourse surrounding mental health and illustrates the value of the multi-level view in capturing the complexity of metaphorical thinking. Furthermore, the study demonstrates that the schematicity hierarchy framework can be effectively applied to multimodal metaphors, enabling a systematic interpretation of abstract meanings across visual and verbal elements and offering a more comprehensive understanding of metaphor use in contemporary discourse.
Keywords
multimodal metaphor, social actor, mental health infographics, multi-level view of conceptual metaphor
Article Details
References
Aristotle (2001). Poetics. In Leitch, Vincent B. (Gen. Ed.), The Norton Anthology of Theory and Criticism (pp. 90-117). Norton. (Original work published ca. 330 B.C.E)
Bilić, B. & Georgaca, E. (2007). Representations of “Mental Illness” in Serbian Newspapers: A Critical Discourse Analysis. Qualitative Research in Psychology, 4(1-2), 167-186. http://doi.org/10.1080/14780880701473573
Bobrova, L. (2015). A Procedure for Identifying Potential Multimodal Metaphors in TV Commercials. Multimodal Communication, 4(2), 113-131. http://doi.org/10.1515/mc-2015-0009
Chakravoti, D., Law, K., Gemmell, J. & Raicu, D. (2018). Detecting and characterizing trends in online mental health discussion. IEEE International Conference on Data Mining Workshops, 697-706. http://doi.org/10.1109/ICDMW.2018.00107
Coll-Florit, M. & Climent, S. (2022). Enemies or obstacles? Metaphors of war and journey in mental health discourse. Metaphor and the Social World, 12(2), 181-203. https://doi.org/10.1075/msw.21035.col
Coll-Florit, M., Climent, S., Sanfilippo, M., & Hernández-Encuentra, E. (2021). Metaphor of Depression. Studying first-person accounts of life with depression published in blogs. Metaphor and Symbol, 36(1), 1-19. https://doi.org/10.1080/10926488.2020.1845096
Coughlan, H., Quin, D., O’Brien, K., Healy, C., Deacon, J., Kavanagh, N., Humphries, N., Clarke, M. C. & Cannon, M. (2021). Online mental health animations for young people: Qualitative empirical thematic analysis and knowledge transfer. Journal of Medical Internet Research, 23(2), e21338. https://www.jmir.org/2021/2/e21338/
Croft, W. & Cruse, A. (2004). Cognitive linguistics. Cambridge University Press. http://doi.org/10.1017/CBO9780511803864
Darcy, R. (2019). Infographics, assessment and digital literacy: innovating learning and teaching through developing ethically responsible digital competencies in publich health. In Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (pp.112-120). Singapore. https://ascilite.org/wp-content/uploads/2019/12/ASCILITE-2019-Proceedings.pdf
de Castro Andrade, R. & Spinillo, C. G. (2018). Interaction and animation in health infographics: A study of graphic presentation and content comprehension. In A. Marcus & W. Wang (Eds.), Design, User Experience, and Usability: Designing Interactions (pp.187-199). Springer Nature. http://doi.org/10.1007/978-3-319-91803-7_14
Evans, V. & Green, M. (2006). Cognitive Linguistics – An introduction. Edinburgh University Press. https://doi.org/10.4324/9781315864327
Famelart, E. (2010). Multimodal metaphors and advertising: a trilingual comparison of the use of multimodal metaphor in Bank advertisements [Master’s thesis, Universidad Complutense de Madrid, Spain]. https://docta.ucm.es/entities/publication/b7882479-87d4-4336-9a19-9c629d0563fd
Farthing, A. & Priego, E. (2016). Graphic medicine as a mental health information resource: Insights from comics producers. The comics grid: Journal of comics scholarship, 6(1), 3-22. http://doi.org/10.16995/cg.74
Fauconnier, G. (1997). Mappings in Thought and Language. Cambridge University Press. http://dx.doi.org/10.1017/CBO9781139174220
Fauconnier, G., & Turner, M. (1998). Conceptual Integration Networks. Cognitive Science, 22, 133-187. https://doi.org/10.1207/s15516709cog2202_1
Fernandez, L. C. (2011). Metaphors, blends and cultural associations in advertising: A four-language comparison of culture and gender issues. [Master’s thesis, Universidad Complutense de Madrid]. Spain. https://docta.ucm.es/entities/publication/8be45451-43d6-4c13-ac43-3599211163a7
Fillmore, C. J. (1982). Frame Semantics. In the Linguistic Society of Korea (Eds.), Linguistics in the Morning Calm: Selected papers from SICOL-1981 (pp. 111-137). http://brenocon.com/Fillmore%201982_2up.pdf
Forceville, C. J. (1996). Pictorial metaphor in advertising. Routledge. https://shorturl.at/01Hf4
Forcevill, C. J. (2007). Multimodal metaphor in ten Dutch TV commercials. The Public Journal of Semiotics, 1(1), 15-34. http://doi.org/10.37693/pjos.2007.1.8812
Forceville, C. J. (2008). Pictorial and multimodal metaphor in commercials. In E. F. McQuarrie & B. J. Philips (Eds.), Go figure! New directions in advertising rhetoric (pp. 178-204). Armonk, NY: M.E. Sharpe. https://dare.uva.nl/search?field1=dai;value1=304343099;f1-fulltext=yes;docsPerPage=1;startDoc=17
Forceville, C. J. (2009). Non-verbal and multimodal metaphor in a cognitive framework: agendas for research. In C. J. Forceville & E. Urios-Aparisi (Eds.), Multimodal metaphor (pp. 19-44). Mouton de Gruyter. https://doi.org/10.1515/9783110215366
Gibbs, R. W. (2017). The embodied and discourse views of metaphor: why these are not so different and how they can be brought closer together. In B. Hampe (Ed.), Metaphor: Embodied Cognition and Discourse (pp.319-335). Cambridge University Press.
Hampe, B. (2005). Image schemas in Cognitive Linguistics: Introduction. In B. Hampe (Ed.), From Perception to Meaning: Image Schemas in Cognitive Linguistics (pp. 1-14). https://doi.org/10.1515/9783110197532.0.1
Hedblom, M. M., Kutz, O. & Neuhaus, F. (2015). Choosing the right path: Image schema theory as a foundation for concept invention. Journal of Artificial General Intelligence, 6(1), 21-54. https://doi.org/10.1515/jagi-2015-0003
Johnson, M. (1987). The body in the mind: The bodily basis of meaning, imagination, and reason. University of Chicago Press. https://press.uchicago.edu/ucp/books/book/chicago/B/bo3613865.html
Knapton, O. & Rundblad, G. (2018). Metaphor, discourse dynamics and register: applications to written descriptions of mental health problems. Text & Talk, 38(3), 389-410. https://doi.org/10.1515/text-2018-0005
Knoll, G. F. & Fuzer, C. (2019). Analysis of infographics of the advertising sphere: Multimodality and compositional metafunction. Revista de Linguística (São José Do Rio Preto), 63(3), 583-608. https://www.scielo.br/j/alfa/a/N9MfxM73zZZXw3RMjqPsDFD/?lang=en
Kövecses, Z. (2002). Metaphor: A practical introduction. Oxford University Press. https://global.oup.com/academic/product/metaphor-9780195374940?cc=vn&lang=en&
Kövecses, Z. (2015). Where Metaphors Come From: Reconsidering Context in Metaphor. Oxford University Press. https://academic.oup.com/book/9710
Kövecses, Z. (2017). Levels of metaphor. Cognitive Linguistics, 28(2), 321-347. https://doi.org/10.1515/cog-2016-0052
Kövecses, Z. (2020). Extended Conceptual Metaphor theory. Cambridge University Press. https://doi.org/10.1017/9781108859127
Lakoff, G. & Turner, M. (1989). More than cool reason: a field guide to poetic metaphor. University Chicago Press. https://press.uchicago.edu/ucp/books/book/chicago/M/bo3774967.html
Lakoff, G. & Johnson, M. (1980). Metaphors we live by. University of Chicago Press. https://press.uchicago.edu/ucp/books/book/chicago/M/bo3637992.html
Langacker, R. W. (1987). Foundation of Cognitive Grammar: Theoretical Prerequisites (Volume I). Standford University Press. https://www.sup.org/books/science/foundations-cognitive-grammar/desk-examination-copy-requests
Langacker, R. W. (2002). Concept, image and symbol. Walter de Gruyter. https://www.degruyterbrill.com/document/doi/10.1515/9783110857733/html
Lazard, A. J., Bamgbade, B. A., Sontag, J. M., & Brown, C. (2016). Using Visual Metaphors in Health Messages: A Strategy to Increase Effectiveness for Mental Illness Communication. Journal of Health Communication, 21(12), 1260–1268. https://doi.org/10.1080/10810730.2016.1245374
Lawn, S., Delany, T., Pulvirenti, M., Smith, A. & McMillan, J. (2016). Examining the use of metaphors to understand the experience of community treatment orders for patients and mental health workers. Psychiatry, 16. http://doi.org/10.1186/s12888-016-0791-z
Lee, E. J., & Kim, Y. W. (2016). Effects of infographics on news elaboration, acquisition, and evaluation: Prior knowledge and issue involvement as moderators. New Media & Society, 18(8), 1579-1598. https://doi.org/10.1177/1461444814567982
Levitt, H., Korman, Y., & Angus, L. (2000). A metaphor analysis in treatments of depression: Metaphor as a marker of change. Counselling Psychology Quarterly, 13(1), 23–35. https://doi.org/10.1080/09515070050011042
Magaña, D. (2019). Cultural competence and metaphor in mental healthcare interactions: A linguistic perspective. Patient Education and Counseling, 102(12), 2192-2198. https://doi.org/10.1016/j.pec.2019.06.010
Mould, T. J., Oades, L. G., & Crowe, T. P. (2010). The use of metaphor for understanding and managing psychotic experiences: A systematic review. Journal of Mental Health, 19(3), 282-293. https://doi.org/10.3109/09638231003728091
Neil, P. (2005). The metaphor of mental illness. In P. Neil (Ed.), The Metaphor of Mental Illness (pp. 61-78). Oxford University Press. https://doi.org/10.1093/med/9780198530886.003.0006
Nor, N. F. M., Jeffree, N. B. & Nor, H. A. M. (2021). Health is weath: A corpus-driven analysis of the portrayal of mental health in Malaysian English online newspapers. Journal of Language Studies, 21(2), 41-71. http://doi.org/10.17576/gema-2021-2102-03
Nunnally, J. (2007). The communication of mental health information: A comparison of the opinions of experts and the public with mass media presentations. Behavioral Science, 2(3), 222-230. https://doi.org/10.1002/bs.3830020305
Paterson, B. (2007). A discourse analysis of the construction of mental illness in two UK newspapers from 1985-2000. Issues in Mental Health Nursing, 28(10), 1087–1103. https://doi.org/10.1080/01612840701581206
Pavlova, A. & Berkers, P. (2020). Mental health discourse and social media: Which mechanisms of cultural power drive discourse on Twitter. Social Science and Medicine, 263. http://doi.org/10.1016/j.socscimed.2020.113250
Pragglejaz Group (2007). MIP: A method for identifying metaphorically used words in discourse, Metaphor and Symbol, 22(1), 1-39. https://www.tandfonline.com/doi/abs/10.1080/10926480709336752
Rieger, P. G. (2022). A framework for critical discourse studies on mental health. Ilha do Desterro, 75(3), 15-30. https://www.scielo.br/j/ides/a/HtWmgyLjT9ny4LhYm7DYbgw/?format=pdf&lang=en
Rofe, T. (2009). Metaphorical Stories for Education About Mental Health Challenges and Stigma. Schizophrenia Bulletin, 35(3), 473-475. https://doi.org/10.1093/schbul/sbp013
Saeed, J. I. (2003). Semantics (2nd ed). Blackwell. http://coursdelinguistique.free.fr/Ressources/Semantics.pdf
Tay, D. (2016). Using metaphor in healthcare: mental health. In E. Semino & Z. Dejien (Eds.), The Routledge handbook of Metaphor and Language (pp.371-384). Routledge. https://doi.org/10.4324/9781315672953
Urios-Aparisi, E. (2009). Interaction of multimodal metaphor and metonymy in TV commercials: four case studies. In C. J. Forceville & E. Urios-Aparisi (Eds.), Multimodal metaphor (pp. 95-117). Mouton de Gruyter. http://doi.org/10.1515/9783110215366.2.95
Wachowiak, L. & Gromann, D. (2022). Systematic analysis of Image Schema in natural language through explainable multilingual neural language processing. In Proceedings of the 29th International Conference on Computational Linguistics (pp. 5571-5581). https://aclanthology.org/2022.coling-1.493/
Warne, T., & Stark, S. (2004). Service users, metaphors and teamworking in mental health. Journal of Psychiatric and Mental Health Nursing, 11(6), 654–661. https://doi.org/10.1111/j.1365-2850.2004.00775.x
Yang, Y. (2015). Research of Multimodal metaphor: Review and Prospect. English Language Teaching, 2(2), 25-30. http://cscanada.net/index.php/sll/article/view/12202
Yu, N. (1995). Metaphorical Expressions of Anger and Happiness in English and Chinese. Metaphor and Symbolic Activity, 10(2), 59-92. https://doi.org/10.1207/s15327868ms1002_1
Zhong, Z., Wen, S. & Chen, S. (2023). Research trends in multimodal metaphor: a bibliometric analysis. Frontiers in Psychology, 14, 1-13. https://doi.org/10.3389/fpsyg.2023.1144725