AN EMPIRICAL STUDY ON THE EFFECT OF VOICE-BASED CONVERSATIONAL AI TOOLS ON ENGLISH SPEAKING PROFICIENCY
DOI:
https://doi.org/10.31851/tyt01g04Keywords:
Conversational AI, English speaking skills, AI-assisted learning, motivation, confidenceAbstract
This study explores the effect of a voice-based conversational AI tool on the English-speaking abilities of second-year students at SMPN 4 Banjarmasin. The research involved 150 students, divided into experimental and control groups. The objective was to assess how AI-assisted learning impacts students’ pronunciation, fluency, vocabulary, grammar, coherence, motivation, and speaking confidence. Utilizing a quasi-experimental design with pre- and post-assessments over six weeks, the results revealed substantial progress in the speaking performance of the experimental group, with an average score increase of 12.4 points, compared to 4.7 points in the control group. Factor analysis highlighted five key factors motivation, learning confidence, technology acceptance, language proficiency, and user experience that accounted for 72.8% of the total variance. These findings underscore the potential of conversational AI in enhancing English language instruction by promoting active learning and improving communication skills. The study concludes that AI-assisted speaking practice significantly boosts student performance and engagement, providing valuable insights for future EFL teaching strategies.
References
Al Ayub Ahmed, A., Hassan, I., Pallathadka, H., Keezhatta, M. S., Haryadi, R. N., Al Mashhadani, Z. I., Attwan, L. Y., & Rohi, A. (2022). MALL and EFL Learners’ speaking: Impacts of duolingo and whatsapp applications on speaking accuracy and fluency. Education Research International, 2022. https://doi.org/10.1155/2022/6716474
Alharbi, W. (2023). AI in the Foreign language Classroom: A pedagogical overview of automated writing assistance tools. Education Research International, 2023, 1–15. https://doi.org/10.1155/2023/4253331
Andriani, A., Abdullah, F., Hidayati, A. N., & Syafira, N. A. N. (2024). Teaching speaking in Kampung Inggris: the tutors’ challenges and solutions. Journal of Education and Learning, 18(1), 253–260. https://doi.org/10.11591/edulearn.v18i1.21175
Becerra-Posada, T., García-Montes, P., Sagre-Barbosa, A., Carcamo-Espitia, M. I., & Herazo-Rivera, J. D. (2022). Project-based learning: The Promotion of communicative competence and self-confidence at a state high school in Colombia. How, 29(2), 13–31. https://doi.org/10.19183/how.29.2.560
Bressane, A., Zwirn, D., Essiptchouk, A., Saraiva, A. C. V., Carvalho, F. L. de C., Formiga, J. K. S., Medeiros, L. C. de C., & Negri, R. G. (2024). Understanding the role of study strategies and learning disabilities on student academic performance to enhance educational approaches: A proposal using artificial intelligence. Computers and Education: Artificial Intelligence, 6(September 2023). https://doi.org/10.1016/j.caeai.2023.100196
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024). AI and English language teaching: Affordances and challenges. British Journal of Educational Technology, March, 2503–2529. https://doi.org/10.1111/bjet.13460
Day, S. (2023). Overcoming foreign language speaking anxiety : Practical Approaches in the classroom. Honor Projects, 928. https://scholarworks.bgsu.edu/honorsprojects/928
Ding, D., & Yusof, A. M. B. (2025). Investigating the role of AI-powered conversation bots in enhancing L2 speaking skills and reducing speaking anxiety: a mixed methods study. Humanities and Social Sciences Communications, 12(1223), 1–16. https://doi.org/0.1057/s41599-025-05550-z
Durrani, M. R. A. A., Ullah, A., & Zaman, H. (2024). Role of sports in the development self-confidence as main parameter of psychological health. Human Nature Journal of Social Sciences, 5(1), 83–89. https://doi.org/https://doi.org/10.71016/hnjss/x3dt2687
Eriana, E. S., & Zein, D. A. (2023). Artificial Intelligence. Angewandte Chemie International Edition, 6(11), 1.
Fattah, H. A., Vadivel, B., Shaban, A. A., & Shanmugam, K. (2023). Enhancing English Language education: the impact of AI integration in the classroom. Journal of Humanities and Education Development, 5(6), 116–123. https://doi.org/10.22161/jhed.5.6.15
Ida Royani, & Sihombing, M. R. (2024). Chatgpt in the academic writing classroom. Esteem Journal of English Education Study Programme, 7(2), 630–638. https://doi.org/10.31851/esteem.v7i2.15615
Javaid, Z. K., Ramzan, M., & Ijaz, S. (2024). A systematic review on cognitive and motivational impact on English language learning through artificial intelligence. International Journal of Literature, Linguistics and Translation Studies, 4(1), 44–71. https://doi.org/10.37605/ijllts.v4i1.4
Jaya, A., Hartono, R., Wahyuni, S., & Yulianto, H. J. (2024). The Impact of “gallery walks” project-based learning strategy on speaking achievement and self-confidence at Universitas PGRI Palembang. Evolutionary Studies in Imaginative Culture, 8(2), 219–233. https://doi.org/https://doi.org/10.70082/esiculture.vi.806
Jin, S. (2023). Speaking proficiency and affective effects in EFL: Vlogging as a social media-integrated activity. British Journal of Educational Technology, n/a(n/a). https://doi.org/10.1111/bjet.13381
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
Koraishi, O. (2023). Teaching English in the age of AI: Embracing chatgpt to optimize efl materials and assessment. Language Education & Technology Journal, 3(1), 55–72.
Larsari, V. N., Geng, H., & Vidal, J. (2024). Collaborative creation of digital storytelling-based task for efl grammar acquisition: using gamification and its effect on efl sixth-grade students’ learning in flipped, blended, and traditional classes. Technological Advancements and Innovations in Future of Education, 239–253. https://doi.org/10.1007/978-981-97-4931-7_20
Liu, L. (2025). Impact of AI gamification on EFL learning outcomes and nonlinear dynamic motivation: Comparing adaptive learning paths, conversational agents, and storytelling. Education and Information Technologies, 30, 11299–11338. https://doi.org/10.1007/s10639-024-13296-5
Madhavi, E., Sivapurapu, L., Koppula, V., Esther Rani, P. B., & Sreehari, V. (2023). Developing learners’ english speaking skills using ict and ai tools. Journal of Advanced Research in Applied Sciences and Engineering Technology, 32(2), 142–153. https://doi.org/10.37934/ARASET.32.2.142153
Na, M., Jill, L. S. S., Noor, H. M., Qi, F. J., & Ying, W. (2024). A Pre-service Art Teacher Digital Literacy Framework for Digital Literacy in Pre-Service Art Teacher Education in China. Asian Journal of University Education, 20(2), 235–247. https://doi.org/10.24191/ajue.v20i2.27007
Novak, E., McDaniel, K., & Li, J. (2023). Factors that impact student frustration in digital learning environments. Computers and Education Open, 5(October), 100153. https://doi.org/10.1016/j.caeo.2023.100153
Oktari, N. F. (2024). Investigating EFL students’ strategies to overcome barriers in improving speaking skills through english club [Universitas Islam Negeri Ar-Raniry Banda Aceh]. https://repository.ar-raniry.ac.id/id/eprint/34541/
Ouyang, Z., Jiang, Y., & Liu, H. (2024). The Effects of duolingo, an ai-integrated technology, on EFL learners’ willingness to communicate and engagement in online classes. International Review of Research in Open and Distributed Learning, 25(3 Special Issue), 97–115. https://doi.org/10.19173/irrodl.v25i3.7677
Paludo, G., & Montresor, A. (2024). Fostering metacognitive skills in programming: leveraging ai to reflect on code. CEUR Workshop Proceedings, 3879. https://www.researchgate.net/profile/Giulia-Paludo/publication/385620293_Fostering_Metacognitive_Skills_in_Programming_Leveraging_AI_to_Reflect_on_Code/links/672cc58577f274616d625fdc/Fostering-Metacognitive-Skills-in-Programming-Leveraging-AI-to-Reflect-o
Rahayu, Weda, S., Muliati, & De Vega, N. (2024). Artificial Intelligence in writing instruction: A self-determination theory perspective. XLinguae, 17(1), 234–244. https://doi.org/10.18355/XL.2024.17.01.16
Ramirez, M. G. (2021). The use of podcasts for language learning : A systematic review of literature. International Journal of English Language Studies, 47–53. https://doi.org/10.32996/ijels
Su, B.-C. (2025). AI-Driven Innovations for sustainable e-commerce returns management. SSRN Electronic Journal. file:///C:/Users/8/Downloads/ssrn-5126388.pdf
Tanduklangi, A., Lio, A., & Alberth. (2019). Classroom action research in teaching English for senior high school students through blended learning in Kendari of Indonesia. Journal of E-Learning and Knowledge Society, 15(1), 169–182. https://doi.org/10.20368/1971-8829/1579
Tran, N., Hoang, D. T. N., Gillespie, R., Yen, T. T. H., & Phung, H. (2024). Enhancing EFL learners’ speaking and listening skills through authentic online conversations with video conferencing tools. Innovation in Language Learning and Teaching, 1–11. https://doi.org/10.1080/17501229.2024.2334809
Ventaja-Cruz, J., Rincón, J. M. C., Tejada-Medina, V., Martín-Moya, R., & Sánchez, R. P. (2024). Impact of the motivation, perception and self-concept of girls soccer players in multicultural contexts: a study in Melilla. Retos: Nuevas Tendencias En Educación Física, Deporte y Recreación, 60, 632–642. https://doi.org/10.47197/retos.v60.108908
Wang, Y., & Su, C. (2000). Synchronous distance education: Enhancing speaking skills via Internet-based real time technology. Proceedings of the 1st International Conference on Web Information Systems Engineering, WISE 2000, 2(August), 168–172. https://doi.org/10.1109/WISE.2000.882876
Wei, L. (2023a). Artificial intelligence in language instruction: impact on English learning achievement, L2 motivation, and self-regulated learning. Frontiers in Psychology, 14, 1261955. https://doi.org/10.3389/fpsyg.2023.1261955
Wei, L. (2023b). Artificial intelligence in language instruction: impact on English learning achievement, L2 motivation, and self-regulated learning. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1261955
Xu, Z. (2024). AI in education: Enhancing learning experiences and student outcomes. Proceedings of the 4th International Conference on Signal Processing and Machine Learning, 51(1), 104–111. https://doi.org/10.54254/2755-2721/51/20241187
Zhou, A., & He, H. (2025). English curriculum reform in China and teachers’ preparedness to implement the latest curriculum standards. Oxford Research Encyclopedia of Education. https://doi.org/10.1093/acrefore/9780190264093.013.1935
Zou, B., Du, Y., Wang, Z., Chen, J., & Zhang, W. (2023). An Investigation into artificial intelligence speech evaluation programs with automatic feedback for developing EFL learners’ speaking skills. SAGE Open, 13(3), 21582440231193816. https://doi.org/10.1177/21582440231193818
Zou, B., Guan, X., Shao, Y., & Chen, P. (2023). Supporting speaking practice by social network-based interaction in artificial intelligence (ai)-assisted language learning. Sustainability (Switzerland), 15(4). https://doi.org/10.3390/su15042872
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Fathul Zannah
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright Notice
Authors who publish with this journal agree to the following terms:
In order to assure the highest standards for published articles, a peer review policy is applied. In pursue of the compliance with academic standards, all parties involved in the publishing process (the authors, the editors and the editorial board and the reviewers) agree to meet the responsibilities stated below in accordance to the Journal publication ethics and malpractice statement.
Duties of Authors:
- The author(s) warrant that the submitted article is an original work, which has not been previously published, and that they have obtained an agreement from any co-author(s) prior to the manuscript’s submission;
- The author(s) should not submit articles describing essentially the same research to more than one journal;
- The authors(s) make certain that the manuscript meets the terms of the Manuscript Submission Guideline regarding appropriate academic citation and that no copyright infringement occurs;
- The authors(s) should inform the editors about any conflict of interests and report any errors they subsequently, discover in their manuscript.
Duties of Editors and the Editorial Board:
- The editors, together with the editorial board, are responsible for deciding upon the publication or rejection of the submitted manuscripts based only on their originality, significance, and relevance to the domains of the journal;
- The editors evaluate the manuscripts compliance with academic criteria, the domains of the journal and the guidelines;
- The editors must at all times respect the confidentiality of any information pertaining to the submitted manuscripts;
- The editors assign the review of each manuscript to two reviewers chosen according to their domains of expertise. The editors must take into account any conflict of interest reported by the authors and the reviewers.
- The editors must ensure that the comments and recommendations of the reviewers are sent to the author(s) in due time and that the manuscripts are returned to the editors, who take the final decision to publish them or not.
Authors are permitted and encouraged to post online a pre-publication manuscript (but not the Publisher final formatted PDF version of the Work) in institutional repositories or on their Websites prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (see The Effect of Open Access). Any such posting made before acceptance and publication of the Work shall be updated upon publication to include a reference to the Publisher-assigned DOI (Digital Object Identifier) and a link to the online abstract for the final published Work in the Journal.
