The Effectiveness of AI-Based Evaluation Tools for English Language Learners

Abstract

Artificial intelligence (AI) is fast changing the way education is conducted, especially in the aspect of language acquisition. AI-based assessment tools offer automated real-time feedback and personalized feedback as an alternative to conventional assessment methods. Although they are increasingly used, their effectiveness in enhancing English language learning has not been fully explored.

The purpose of the study is to assess the effectiveness of AI-based evaluation tools in English language learners by assessing their level of awareness, usage patterns, learning improvement, engagement, challenges, and user perception. The survey-based research design was utilized with the assistance of a quantitative research design. The data were gathered during a six-month time span among students studying in different universities in Islamabad. Responses were collected using a structured questionnaire with a five-point Likert scale. Convenience sampling was used and the data obtained were subjected to descriptive statistics and reliability analysis.

The results demonstrate that AI-based evaluation tools are highly aware and used by the respondents (M = 3.84), which means that they are more familiar and accessible. These tools were highly rated in effectiveness (M = 4.12), especially in giving quick and correct feedback, improving grammar, developing writing skills, and uncovering weaknesses in language. Also, AI tools showed a large positive effect on the improvement of learning and engagement (M = 4.05) with learners stating that they were more motivated, confident, and had better interactive learning experiences. The reliability analysis showed that the internal consistency of all the constructs was high with a Cronbach alpha of between 0.821 and 0.911. Nonetheless, answers to the issue of challenges and general acceptance were moderate (M = 3.41), and the reasons were related to the reliability of the feedback, technical issues, and the compatibility with the traditional methods of teaching.

The research concludes that AI-based assessment tools can greatly improve English language learning by offering effective, customized, and interactive learning experiences. They should however be applied as supplementary resources to the conventional instructional strategies to tackle current constraints and guarantee balanced educational results.

References

Afzal, M., Arshad, N., & Shaheen, A. (2025). ChatGPT and the future of academic writing: enhancing productivity and creativity. Journal of Engineering and Computational Intelligence Review, 3(1), 1-11. 

Akhter, E. (2024). Ai-Based Language Education Platforms: A Systematic Analysis Of Edtech Tools For English Proficiency. Journal of Sustainable Development and Policy, 3(04), 01-31. 

Aronno, M. S. R., Zumma, M. T., Prodhan, R., Zohora, F. T., Sakib, N., & Tahmiduzzaman, K. B. M. (2023, July). A study of cyber bullying classification using Social Media and Texual analysis based on Machine Learning Approches. In 2023 14th International Conference on Computing Communication and Networking Technologies (ICCCNT) (pp. 1-8). IEEE.

Arshad, N., Baber, M. U., & Ullah, A. (2024). Assessing the transformative influence of ChatGPT on research practices among scholars in Pakistan. Mesopotamian Journal of Big Data, 4(1), 1-10. 

Chandra, K. R., Muthumanikandan, M., Kathyayini, S., Akhila, H. G., Pathak, P., & Shivaprakash, S. (2024). The impact of artificial intelligence tools and techniques for effective English language education. Nanotechnology Perceptions, 20(S7), 897. 

Chen, A., Zhang, Y., Jia, J., Liang, M., Cha, Y., & Lim, C. P. (2025). A systematic review and meta‐analysis of AI‐enabled assessment in language learning: Design, implementation, and effectiveness. Journal of Computer Assisted Learning, 41(1), e13064. 

Fattah, H. A., Vadivel, B., Shaban, A. A., & Shanmugam, K. (2023). Enhancing English language education: The impact of AI integration in the classroom. Journal of Humanities and Education Development, 5(6), 116-123. 

Gayed, J. M., Carlon, M. K. J., Oriola, A. M., & Cross, J. S. (2022). Exploring an AI-based writing Assistant's impact on English language learners. Computers and Education: Artificial Intelligence, 3, 100055. 

Jia, F., Sun, D., Ma, Q., & Looi, C. K. (2022). Developing an AI-based learning system for L2 learners’ authentic and ubiquitous learning in English language. Sustainability, 14(23), 15527. 

Lee, D., Kim, H. H., & Sung, S. H. (2023). Development research on an AI English learning support system to facilitate learner-generated-context-based learning. Educational technology research and development, 71(2), 629-666. 

Liu, X. J., Wang, J., & Zou, B. (2025). Evaluating an AI speaking assessment tool: Score accuracy, perceived validity, and oral peer feedback as feedback enhancement. Journal of English for Academic Purposes, 75, 101505. 

Luo, J., Zheng, C., Yin, J., & Teo, H. H. (2025). Design and assessment of AI-based learning tools in higher education: A systematic review. International Journal of Educational Technology in Higher Education, 22(1), 42. 

Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring the potential of artificial intelligence tools in educational measurement and assessment. Eurasia journal of mathematics, science and technology education, 19(8), em2307.

Tareque, T., Tousif, F., Billah, M., Jabir, A. and Mirmotalebi, S. (2023) Comprehensive Analysis of the Effects of Superplasticizer Variation on the Workability and Strength of Ready-Mix Concrete. Open Journal of Civil Engineering, 13, 756-770. https://doi.org/10.4236/ojce.2023.134050  

Usman, M., Asif, M., Ullah, A., & Ullah, W. (2024). User’s Habits and Attitudes towards Chinese Books Reading in Pakistan. Inverge Journal of Social Sciences, 3(2), 11-28. 

Wang, Y., Wu, J., Chen, F., Wang, Z., Li, J., & Wang, L. (2024). Empirical assessment of AI-powered tools for vocabulary acquisition in EFL instruction. IEEE Access, 12, 131892-131905. 

Woo, J. H., & Choi, H. (2021). Systematic review for AI-based language learning tools. arXiv preprint arXiv:2111.04455. 

Yiling, J., Omar, M., & Kamaruzaman, F. M. (2025). Exploring the AI-Enhanced Project-Based Learning for English Language Acquisition: A Systematic Review of the Key Elements and Emerging Technology Trends. International Journal of Learning, Teaching and Educational Research, 24(2), 636-652. 

Yuan, Y. (2024). An empirical study of the efficacy of AI chatbots for English as a foreign language learning in primary education. Interactive Learning Environments, 32(10), 6774-6789. 

Zhao, J. (2025). Advancing english language education: A mixed-methods analysis of AI-driven tools' impact on engagement, personalization, and learning outcomes. Education and Information Technologies, 30(15), 21773-21813.