USABILITY, EFFECTIVENESS AND ENGAGEMENT OF TARI AI TOOLS FOR LANGUAGE LEARNING
Main Article Content
Abstract
This study investigates user perceptions of AI-supported tools developed by the Training and Applied Research Institute (TARI) at Ho Chi Minh City University of Foreign Languages - Information Technology (HUFLIT), designed to enhance language education. As artificial intelligence continues to transform educational practices, the research evaluates the extent to which localized AI tools facilitate usability, effectiveness, and engagement in linguistics learning. The data were collected from 271 participants using a structured questionnaire comprising 18 Likert-scale items and 6 open-ended questions to capture both quantitative and qualitative insights. Data cleaning was conducted using Python, followed by Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) to validate the measurement scale. The EFA confirmed a three-factor structure aligned with the theoretical framework, while the CFA demonstrated good model fit (CFI = 0.969; RMSEA = 0.052). Reliability testing indicated strong internal consistency across all constructs of the measurement scale (overall α = 0.944). Composite Reliability (CR) and Average Variance Extracted (AVE) further supported convergent validity for most dimensions. The findings revealed predominantly positive user perceptions. The participants regarded the tools as accessible, interactive, and effective in supporting both conceptual understanding and practical application. The qualitative responses emphasized advantages such as personalization, efficient data processing, and enhanced motivation, while also acknowledging limitations in capturing humanistic dimensions of language learning. The study concludes that TARI AI tools hold significant potential to foster inclusive, engaging, and impactful language education. Continued refinement and user-centered development are recommended to ensure these tools remain responsive to diverse learner needs in dynamic educational contexts.
Keywords
AI tools, language education, usability, engagement, educational technology
Article Details
References
Albdrani, R., & Al-Shargabi, A. (2023). Investigating the effectiveness of ChatGPT for providing personalized learning experience: a case study. International Journal of Advanced Computer Science and Applications, 14(11), 1208-1213. https://doi.org/10.14569/ijacsa.2023.01411122
Alghabban, W., & Hendley, R. (2022). Perceived level of usability as an evaluation metric in adaptive e-learning. Sn Computer Science, 3(3), 238. https://doi.org/10.1007/s42979-022-01138-5
Anoir, L., Chelliq, I., Khaldi, M., & Khaldi, M. (2024). Design of an intelligent tutor system for the personalization of learning activities using case-based reasoning and multi-agent system. International Journal of Computing and Digital Systems, 15(1), 459–469. https://doi.org/10.12785/ijcds/160136
Asad, S. (2016). Instructional strategies to manage cognitive load in orthodontics. Annals of King Edward Medical University, 22(1), 35. https://doi.org/10.21649/akemu.v22i1.794
Atiomo, W., Ennab, F., Stanley, A., & Ezimokhai, M. (2024). Evaluating an obstetrics and gynecology teaching program for medical students incorporating simulation-based education underpinned by cognitive load theory. Frontiers in Medicine, 11. https://doi.org/10.3389/fmed.2024.1304417
Bai, L., Liu, X., & Su, J. (2023). ChatGPT: the cognitive effects on learning and memory. Brain-x, 1(3). https://doi.org/10.1002/brx2.30
Dahleez, K., El-Saleh, A., Alawi, A., & Abdelfattah, F. (2021). Higher education student engagement in times of pandemic: the role of e-learning system usability and teacher behavior. International Journal of Educational Management, 35(6), 1312–1329. https://doi.org/10.1108/ijem-04-2021-0120
Daulay, I. (2024). English teachers’ perceptions of technological pedagogical and content knowledge (TPACK) and its application in English language teaching: post-covid-19. JPP (Jurnal Pendidikan Dan Pembelajaran), 31(1), 1. https://doi.org/10.17977/jpp.v31i1.50794
Dong, L., Mohammed, S., Ibrahim, K., & Rezai, A. (2022). Fostering EFL learners’ motivation, anxiety, and self-efficacy through computer-assisted language learning- and mobile-assisted language learning-based instructions. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.899557
Douali, L., Selmaoui, S., & Bouab, W. (2022). Artificial intelligence in education: fears and faiths. International Journal of Information and Education Technology, 12(7), 650–657. https://doi.org/10.18178/ijiet.2022.12.7.1666
Gümüş, M., Kukul, V., & Düzenli̇, Ö. (2023). Mapping the research on educational technology: an overview through text mining. Kastamonu Eğitim Dergisi, 31(2), 202–217. https://doi.org/10.24106/kefdergi.1271474
Gwizdka, J. (2010). Distribution of cognitive load in web search. Journal of the American Society for Information Science and Technology, 61(11), 2167–2187. https://doi.org/10.1002/asi.21385
Hamari, J., Shernoff, D., Rowe, E., Coller, B., Asbell-Clarke, J., & Edwards, T. (2016). Challenging games help students learn: an empirical study on engagement, flow and immersion in game-based learning. Computers in Human Behavior, 54, 170–179. https://doi.org/10.1016/j.chb.2015.07.045
Huang, F., Peng, D., & Teo, T. (2025). AI affordances and EFL learners’ speaking engagement: the moderating roles of gender and learner type. European Journal of Education, 60(1). https://doi.org/10.1111/ejed.70041
Islam, A., Mok, M., Gu, X., Spector, J., & Hai-Leng, C. (2019). Ict in higher education: an exploration of practices in Malaysian universities. IEEE Access, 7, 16892–16908. https://doi.org/10.1109/access.2019.2895879
Kadaruddin, K. (2023). Empowering education through generative ai: innovative instructional strategies for tomorrow’s learners. International Journal of Business Law and Education, 4(2), 618–625. https://doi.org/10.56442/ijble.v4i2.215
Krejtz, K., Duchowski, A., Niedzielska, A., Biele, C., & Krejtz, I. (2018). Eye tracking cognitive load using pupil diameter and micro saccades with fixed gaze. Plos One, 13(9), e0203629. https://doi.org/10.1371/journal.pone.0203629
Kristiawan, D., Bashar, K., & Pradana, D. (2024). Artificial intelligence in English language learning: a systematic review of AI tools, applications, and pedagogical outcomes. The Art of Teaching English as a Foreign Language, 5(2), 207–218. https://doi.org/10.36663/tatefl.v5i2.912
Kusaini, E., Mahamod, Z., & Mohammad, W. (2022). Integration of technological pedagogical content knowledge components and inventive skills among Malay language teachers. International Journal of Academic Research in Business and Social Sciences, 12(9). https://doi.org/10.6007/ijarbss/v12-i9/14584
Lai, T. K. L., & Trinh, H. L. (2025). The effects of ChatGPT on academic writing proficiency among English-majored undergraduates at a university. VNU Journal of Foreign Studies, 41(3), 92-109. https://doi.org/10.63023/2525-2445/jfs.ulis.5514
Liu, G., Zou, M., Soyoof, A., & Chiu, M. (2024). Untangling the relationship between ai-mediated informal digital learning of English (ai-idle), foreign language enjoyment and the ideal l2 self: evidence from Chinese university EFL students. European Journal of Education, 60(1). https://doi.org/10.1111/ejed.12846
Luckin, R., & Cukurova, M. (2019). Designing educational technologies in the age of ai: a learning sciences-driven approach. British Journal of Educational Technology, 50(6), 2824–2838. https://doi.org/10.1111/bjet.12861
Nguyen, Q. H. (2025). The impact of Artificial Intelligence (AI) applications on students’ motivation, learning methods, and outcomes in foreign language acquisition. VNU Journal of Foreign Studies, 41(5), 102-116. https://doi.org/10.63023/2525-2445/jfs.ulis.5547
Padmavathi, M. (2017). Preparing teachers for technology-based teaching-learning using TPACK. I-Manager S Journal on School Educational Technology, 12(3), 1-9. https://doi.org/10.26634/jsch.12.3.10384
Rodríguez-Abitia, G., Pérez, S., Soledad, M., & López-Caudana, E. (2020). Digital gap in universities and challenges for quality education: a diagnostic study in Mexico and Spain. Sustainability, 12(21), 9069. https://doi.org/10.3390/su12219069
Shu, X. (2016). An action research on TPACK’s influence on teachers of national open university: exemplified with an English teacher of Zhejiang radio and tv university. Oalib, 3(1), 1–6. https://doi.org/10.4236/oalib.1102336
Teng, J., Wan, F., Kong, Y., & Kim, J. (2023). Machine learning-based cognitive load prediction model for AR-HUD to improve OSH of professional drivers. Frontiers in Public Health, 11. https://doi.org/10.3389/fpubh.2023.1195961
Tlili, A., Shehata, B., Adarkwah, M., Bozkurt, A., Hickey, D., Huang, R., others, & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1). https://doi.org/10.1186/s40561-023-00237-x
Vall, R., & Araya, F. (2023). Exploring the benefits and challenges of AI-language learning tools. The International Journal of Social Sciences and Humanities Invention, 10(1), 7569–7576. https://doi.org/10.18535/ijsshi/v10i01.02
Wang, X. (2022). Enhancing Chinese EFL students’ academic engagement: the impact of l2 enjoyment and academic motivation. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.914682
Willis, V. (2024). The role of artificial intelligence (AI) in personalizing online learning. Journal of Online and Distance Learning, 3(1), 1–13. https://doi.org/10.47941/jodl.1689
Yu, H., Guo, Y., Yang, H., Zhang, W., & Dong, Y. (2024). Can ChatGPT revolutionize language learning? Unveiling the power of AI in multilingual education through user insights and pedagogical impact. European Journal of Education, 60(1). https://doi.org/10.1111/ejed.12749
Zainuddin, M. (2024). Teachers’ perceptions of AI tools in enhancing student engagement for English language learning. RSELTL, 2(6), 367–380. https://doi.org/10.62583/rseltl.v2i6.64
Zhou, C., & Hou, F. (2024). Can AI empower L2 education? Exploring its influence on the behavioural, cognitive and emotional engagement of EFL teachers and language learners. European Journal of Education, 59(4). https://doi.org/10.1111/ejed.12750