CORPUS-BASED COMPARISON OF CHATGPT AND STUDENT WRITING ON SPEAKING PROMPTS IN VIETNAMESE EFL CONTEXTS

Thi Tuyet Mai Nguyen1,
1 Học viện Quân y

Main Article Content

Abstract

This study examines written texts produced by Vietnamese EFL students and ChatGPT in response to ten common speaking prompts. Although initially designed for oral practice, the prompts were adapted into short writing tasks, ensuring comparability with ChatGPT’s written outputs. A mixed-methods approach combined quantitative corpus profiling (type–token ratio, collocational range, discourse markers) with qualitative coding of syntax, lexis, and pragmatics. The analysis revealed that ChatGPT texts displayed greater lexical diversity (TTR 0.70 vs. 0.63), more natural collocations, and a wider range of cohesive devices. In contrast, student texts relied heavily on high-frequency verbs and basic connectors. Pragmatic contrasts also emerged: ChatGPT often employed hedges and polite expressions, while student writing tended to be abrupt or overly direct. These findings suggest that ChatGPT can enrich learners’ exposure to varied vocabulary, collocational accuracy, and pragmatic awareness. However, its use should remain pedagogically guided to avoid over-reliance. The study underscores the importance of teacher mediation and aligns its findings with second language acquisition (SLA) perspectives on input, noticing, and authenticity.

 

Article Details

References

Abbas, M., Jam, F. A., & Khan, T. I. (2024). Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students. International Journal of Educational Technology in Higher Education, 21(1), 1-22. https://doi.org/10.1186/s41239-024-00444-7
Anthony, L. (2023). AntConc (Version 4.2.4) [Computer software]. https://www.laurenceanthony.net/software/antconc/releases/AntConc424/help.pdf
Duong, T. L. (2023). Application of ChatGPT in promoting higher education teaching and learning in the era of Artificial Intelligence. Journal of Science and Technology – Binh Duong University, 6(2), 153–160.
https://doi.org/10.56097/binhduonguniversityjournalofscienceandtechnology.v6i2.160
Gilmore, A. (2007). Authentic materials and authenticity in foreign language learning. Language Teaching, 40(2), 97–118. https://doi.org/10.1017/S0261444807004144
Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2), ep421. https://doi.org/10.30935/cedtech/13036
Ishida, H. (2006). Learners’ perception and interpretation of contextualization cues in spontaneous Japanese conversation: Back-channel cue “uun.” Journal of Pragmatics, 38(11), 1943–1981. https://doi.org/10.1016/j.pragma.2005.08.004
Khlaif, Z. (2024). Rethinking educational assessment in the age of artificial intelligence: Insights from recent training workshops. In M. Sanmugam, B. Edwards, N. Mohd Barkhaya & Z. Khlaif (Eds.), Fostering Inclusive Education With AI and Emerging Technologies (pp. 131-144). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3693-7255-5.ch005
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 54(2), 537-550. https://doi.org/10.1177/00336882231162868.
Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon Press. http://www.sdkrashen.com/content/books/principles_and_practice.pdf
Long, M. H. (1996). The role of the linguistic environment in second language acquisition. In W. C. Ritchie & T. K. Bhatia (Eds.), Handbook of second language acquisition (pp. 413–468). Academic Press. https://www.scribd.com/document/253376703/Long-1996
Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: A mixed methods intervention study. Smart Learning Environments, 11(1), Article 9. https://doi.org/10.1186/s40561-024-00295-9
Nguyen, D. V., & Phan, T. T. (2023). Application of ChatGPT in teaching, research and management at the university level. Scientific Journal of Tan Trao University, Social Science and Humanities, 9(3), 170–182. https://doi.org/10.51453/2354-1431/2023/974.
Nguyen, P. Q. (2024). The impact of ChatGPT on science and education. Journal of Science - Hong Bang International University, 30, 149-158. https://doi.org/10.59294/HIUJS.30.2024.653
Nguyen, T. M. (2024). Conceptual metaphors of artificial intelligence and AI development in The Guardian newspaper. VNU Journal of Foreign Studies, 40(4), 128-141. https://doi.org/10.63023/2525-2445/jfs.ulis.5345
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 129–158. https://doi.org/10.1093/applin/11.2.129
Van Lier, L. (1996). Interaction in the language curriculum: Awareness, autonomy and authenticity. Longman. https://books.google.com.vn/books?id=cWq4AwAAQBAJ
Widdowson, H. G. (1998). Context, community, and authentic language. TESOL Quarterly, 32(4), 705–716. https://doi.org/10.2307/3588001
Xia, Q., Weng, X., Ouyang, F., & Chiu, T. K. F. (2024). A scoping review on how generative artificial intelligence transforms assessment in higher education. International Journal of Educational Technology in Higher Education, 20(68). https://doi.org/10.1186/s41239-024-00468-z
Yıldız, C. (2024). ChatGPT Integration in EFL Education: A Path to Enhanced Speaking Self-Efficacy. Novitas-ROYAL (Research on Youth and Language), 18(2), 167–182. https://files.eric.ed.gov/fulltext/EJ1446766.pdf
Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students' cognitive abilities: A systematic review. Smart Learning Environments, 11, 1-37. https://doi.org/10.1186/s40561-024-00316-7