Exploring the Impact of Artificial Intelligence in Advancing Smart Learning in Education: A Meta-Analysis with Statistical Evidence
References
- Al Hakim, V. G., Yang, S. H., Liyanawatta, M., Wang, J. H., & Chen, G. D. (2022). Robots in situated learning classrooms with immediate feedback mechanisms to improve students’ learning performance. Computers & Education, 182,
104483 . 10.1016/j.compedu.2022.104483 - Azamatova, A., Bekeyeva, N., Zhaxylikova, K., Sarbassova, A., & Ilyassova, N. (2023). The effect of using artificial intelligence and digital learning tools based on project-based learning approach in foreign language teaching on students’ success and motivation. International Journal of Education in Mathematics, Science, and Technology (IJEMST), 11(6), 1458–1475. 10.46328/ijemst.3712
- Bachiri, Y. A., Mouncif, H., & Bouikhalene, B. (2023). Artificial intelligence empowers gamification: Optimizing student engagement and learning outcomes in e-learning and moocs. International Journal of Engineering Pedagogy, 13(8). 10.3991/ijep.v13i8.40853
- Bashir, A., Aziz, A., Imran, M., & Almusharraf, N. (2025). Effect of CALL-based multimodal pedagogy on learner motivation and willingness to communicate in English: A study from university students’ perspective. Contemporary Educational Technology, 17(2). 10.30935/cedtech/15961
- Bäuerle, A., Albus, P., & Störk, R., Seufert, T., & Ropinski, T. (2023). exploRNN: teaching recurrent neural networks through visual exploration. Vis Comput, 39, 4323–4338. 10.1007/s00371-022-02593-0
- Bergeler, E., & Read, M. F. (2021). Comparing Learning Outcomes and Satisfaction of an Online Algebra-Based Physics Course with a Face-to-Face Course. J Sci Educ Technol, 30, 97–111. 10.1007/s10956-020-09878-w
- Bhatt, P., & Muduli, A. (2023). Artificial intelligence in learning and development: A systematic literature review. European Journal of Training and Development, 47(7–8), 677–694. 10.1108/EJTD-09-2021-0143
- Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Wiley. 10.1002/9780470743386
- Chen, C.-H. (2020), AR videos as scaffolding to foster students’ learning achievements and motivation in EFL learning. Br J Educ Technol, 51, 657–672. 10.1111/bjet.12902
- Chen, C.-M., Li, M.-C., & Chen, T.-C. (2020). A web-based collaborative reading annotation system with gamification mechanisms to improve reading performance. Computers & Education, 144,
103697 . ISSN 0360–1315. 10.1016/j.compedu.2019.103697 - Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264–75278. 10.1109/ACCESS.2020.2988510
- Chen, Y.-T., Li, M., Huang, C.-Q., Han, Z.-M., Hwang, G.-J., & Yang, G. (2022). Promoting deep writing with immersive technologies: An SVVR-supported Chinese composition writing approach for primary schools. British Journal of Educational Technology, 53, 2071–2091. 10.1111/bjet.13247
- Chiu, M. C., Hwang, G. J., Hsia, L. H., & Shyu, F. M. (2022). Artificial intelligence-supported art education: a deep learning-based system for promoting university students’ artwork appreciation and painting outcomes. Interactive Learning Environments, 32(3), 824–842. 10.1080/10494820.2022.2100426
- Cohen, J. (2013). Statistical power analysis for the behavioral sciences. Routledge. 10.4324/9780203771587
- Cukurova, M., Luckin, R., & Kent, C. (2020). Impact of an artificial intelligence research frame on the perceived credibility of educational research evidence. International Journal of Artificial Intelligence in Education, 30(2), 205–235. 10.1007/s40593-019-00188-w
- Chang, Y. S., Chou, C. H., Chuang, M. J., Li, W. H., & Tsai, I. F. (2020). Effects of virtual reality on creative design performance and creative experiential learning. Interactive Learning Environments, 31(2), 1142–1157. 10.1080/10494820.2020.1821717
- Di, X., & Zheng, X. (2022). A meta-analysis of the impact of virtual technologies on students’ spatial ability. Educational Technology Research and Development, 70(1), 73–98. 10.1007/s11423-022-10082-3
- Dimitriadou, E., & Lanitis, A. (2023). A critical evaluation, challenges, and future perspectives of using artificial intelligence and emerging technologies in smart classrooms. Smart Learning Environments, 10(1),
12 . 10.1186/s40561-023-00231-3 - Doughty, J., Wan, Z., Bompelli, A., Qayum, J., Wang, T., Zhang, J., … & Sakr, M. (2024, January). A comparative study of AI-generated (GPT-4) and human-crafted MCQs in programming education. Proceedings of the 26th Australasian Computing Education Conference (pp. 114–123). 10.1145/3636243.3636256
- Drissi, S., Chefrour, A., Boussaha, K., & Zarzour, H. (2024). Exploring the effects of personalized recommendations on student’s motivation and learning achievement in gamified mobile learning framework. Educ Inf Technol, 29, 15463–15500. 10.1007/s10639-024-12477
- Duval, S., & Tweedie, R. (2000). A nonparametric, “trim and fill” method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95(449), 89–98. 10.1080/01621459.2000.10473905
- Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: Insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20(1),
57 . 10.1186/s41239-023-00425-2 - Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3, 275–285. 10.1016/j.susoc.2022.05.004
- Hanshaw, G., Vance, J., & Brewer, C. (2024). Exploring the effectiveness of AI course assistants on the student learning experience. Open Praxis, 16(4), 627–644. 10.55982/openpraxis.16.4.719
- Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. journal of Educational Statistics, 6(2), 107–128. 10.3102/10769986006002107
- Hedges, L. V., & Olkin, I. (2014). Statistical methods for meta-analysis. Academic press.
- Herodotou, C., Muirhead, D. K., Aristeidou, M., Hole, M. J., Kelley, S., Scanlon, E., & Duffy, M. (2018). Blended and online learning: a comparative study of virtual microscopy in Higher Education. Interactive Learning Environments, 28(6), 713–728. 10.1080/10494820.2018.1552874
- Hodges, G. W., Flanagan, K, Lee, J., Cohen, A., Krishnan, S., & Ward, C. (2020). A quasi-experimental study comparing learning gains associated with serious educational gameplay and hands-on science in elementary classrooms. J Res Sci Teach, 57, 1460–1489. 10.1002/tea.21661
- Hoke, T. (2024). AI with a heart: Integrating emotional intelligence and sustainability in smart education for 21st-century learners. In Proceedings of the International Conference on Sustainability: Developments and Innovations (pp. 458–465).
Springer Nature Singapore , Singapore. 10.1007/978-981-97-8348-9_56 - Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.
- Hsu, T.-C., Huang, H.-L., Hwang, G.-J., & Chen, M.-S. (2023). Effects of Incorporating an Expert Decision-making Mechanism into Chatbots on Students’ Achievement, Enjoyment, and Anxiety. Educational Technology & Society, 26(1), 218–231.
https://www.jstor.org/stable/48707978 - Huang, A. Y. Q., Lu, O. H. T., & Yang, S. J. H. (2023). Effects of artificial Intelligence–Enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroom. Computers & Education, 194,
104684 . ISSN 0360-1315. 10.1016/j.compedu.2022.104684 - Huang, H.-L., Hwang, G.-J., & Chen, P.-Y. (2022). An integrated concept mapping and image recognition approach to improving students’ scientific inquiry course performance. British Journal of Educational Technology, 53, 706–727. 10.1111/bjet.13177
- Hu, Y. H. (2022). Effects and acceptance of precision education in an AI-supported smart learning environment. Education and Information Technologies, 27(2), 2013–2037. 10.1007/s10639-021-10664-3
- Huang, R., Ritzhaupt, A. D., Sommer, M., Zhu, J., Stephen, A., Valle, N., … & Li, J. (2020). The impact of gamification in educational settings on student learning outcomes: A meta-analysis. Educational Technology Research and Development, 68, 1875–1901. 10.1007/s11423-020-09807-z
- Hwang, S. (2016). Meta-analysis using R. Hakjisa.
- Imran, M., Almusharraf, N., & Abbasova, M. Y. (2025). Digital learning transformation: A study of teachers’ post-COVID-19 experiences. Social Sciences & Humanities Open, 11,
101228 . 10.1016/j.ssaho.2024.101228 - Javaid, M., Haleem, A., & Pratap, R. (2023). ChatGPT’s role in automating educational tasks. Journal of AI and Learning, 18, 72–84. 10.1016/j.ject.2023.08.001
- Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of intelligent tutoring systems: A meta-analytic review. Review of Educational Research, 86(1), 42–78. 10.3102/0034654315581420
- Lai, Y. H., Chen, S. Y., Lai, C. F., Chang, Y. C., & Su, Y. S. (2019). Study on enhancing AIoT computational thinking skills by plot image-based VR. Interactive Learning Environments, 29(3), 482–495. 10.1080/10494820.2019.1580750
- Lampropoulos, G. (2024).
Extended reality and the metaverse in education: Towards immersive collaborative learning . In Augmented and virtual reality in the metaverse (pp. 101–111). Springer Nature Switzerland. 10.1007/978-3-031-57746-8_6 - Lee, D., & Kwon, H. (2024). Meta-analysis on effects of artificial intelligence education in K-12 South Korean classrooms. Education and Information Technologies, 1–36. 10.1007/s10639-024-12738-4
- Lee, Y. F., Hwang, G. J., & Chen, P. Y. (2022). Impacts of an AI-based chabot on college students’ after-class review, academic performance, self-efficacy, learning attitude, and motivation. Education Tech Research Dev, 70, 1843–1865. 10.1007/s11423-022-10142-8
- Liew, T. W., Pang, W. M., Leow, M. C., & Tan, S. M. (2022). Anthropomorphizing malware, bots, and servers with human-like images and dialogues: The emotional design effects in a multimedia learning environment. Smart Learning Environments, 9(1),
5 . 10.1186/s40561-022-00187-w - Lin, C. J., Wang, W. S., Lee, H. Y., Huang, Y.-M., & Wu, T.-T. (2024). Recognitions of image and speech to improve learning diagnosis on STEM collaborative activity for precision education. Educ Inf Technol, 29, 13859-13884. 10.1007/s10639-023-12426-9
- Lin, Y.-T. (2023). Learning Performances towards the BookRoll E-Book System for Flipped Classrooms in Software Engineering Education. Educational Technology & Society, 26(3), 190–202.
https://www.jstor.org/stable/48734330 - Lipsey, M. W., & Wilson, D. B. (2017). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. In Quantitative methods in criminology (pp. 65–93). 10.4324/9781315089256-4
- Lin, X.-F., Wang, Z., Zhou, W., Luo, G., Hwang, G.-J., Zhou, Y., Wang, J., Hu, Q., Li, W., Liang, Z.-M. (2023). Technological support to foster students’ artificial intelligence ethics: An augmented reality-based contextualized dilemma discussion approach. Computers & Education, 201,
104813 . ISSN 0360–1315. 10.1016/j.compedu.2023.104813 - Liu W. I., Liu, C. H., Liao, C. Y., Chao, P. R., & Chu, K. C. (2020). Mobile community learning programme’s effectiveness in case management for psychiatric nurses: A preliminary randomised controlled trial. Nurse Educ Today, 85,
104259 . 10.1016/j.nedt.2019.104259 - Liu, Z-M, Fan, X., Liu, Y., & Ye, X.-d. (2022). Effects of immersive virtual reality cardiopulmonary resuscitation training on prospective kindergarten teachers’ learning achievements, attitudes and self-efficacy. British Journal of Educational Technology, 53, 2050–2070. 10.1111/bjet.13237
- Li, W., Wang, F., Mayer, R. E., & Liu, T. (2022). Animated pedagogical agents enhance learning outcomes and brain activity during learning. Journal of Computer Assisted Learning, 38(3), 621–637. 10.1111/jcal.12634
- Liyanawatta, M., Yang, S. H., Liu, Y. T., Zhuang, Y., & Chen, G. D. (2022). Audience participation digital drama-based learning activities for situational learning in the classroom. British Journal of Educational Technology, 53(1), 189–206. 10.1111/bjet.13160
- Lo, C.-M., Han, J., Wong, E. S. W., & Tang, C.-C. (2021). Flexible learning with multicomponent blended learning mode for undergraduate chemistry courses in the pandemic of COVID-19. Interactive Technology and Smart Education, 18(2), 175–188. 10.1108/ITSE-05-2020-0061
- Luckin, R., & Holmes, W. (2016). Intelligence unleashed: An argument for AI in education.
- Ma, Y., Zhang, L., & Wu, M. (2022). Research on the influence of virtual reality on the learning effect of technical skills of science and engineering college students: Meta-analysis based on 32 empirical studies. International Journal of Digital Multimedia Broadcasting, 2022,
e6202370 . 10.1155/2022/6202370 - Mhlanga, D. (2023).
Open AI in education: The responsible and ethical use of ChatGPT towards lifelong learning . In FinTech and artificial intelligence for sustainable development: The role of smart technologies in achieving development goals (pp. 387–409). Springer Nature Switzerland. 10.1007/978-3-031-37776-1_17 - Morocco-Clarke, A., Sodangi, F. A., & Momodu, F. (2024). The implications and effects of ChatGPT on academic scholarship and authorship: A death knell for original academic publications? Information & Communications Technology Law, 33(1), 21–41. 10.1080/13600834.2023.2239623
- Nabulsi, L., Nguyen, A., & Odeleye, O. A. (2021). Comparison of the Effects of Two Different Online Homework Systems on Levels of Knowledge Retention in General Chemistry Students. J Sci Educ Technol, 30, 31–39. 10.1007/s10956-020-09872-2
- Ng, D. T. K., Su, J., & Chu, S. K. W. (2024). Fostering Secondary School Students’ AI Literacy through Making AI-Driven Recycling Bins. Educ Inf Technol, 29, 9715–9746. 10.1007/s10639-023-12183-9
- Noor, U., Younas, M., Saleh Aldayel, H., Menhas, R., & Qingyu, X. (2022). Learning behavior, digital platforms for learning, and its impact on university students’ motivations and knowledge development. Frontiers in Psychology, 13,
933974 . 10.3389/fpsyg.2022.933974 - Oh, S. S. (2002). Meta-analysis: Theory and practice. Konkuk University.
- Ouyang, F., Zheng, L., & Jiao, P. (2022). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 27(6), 7893–7925. 10.1007/s10639-022-10925-9
- Özer, M. (2024). Potential benefits and risks of artificial intelligence in education. Bartın University Journal of Faculty of Education, 13(2), 232–244. 10.14686/buefad.1416087
- Pham, S. T., & Sampson, P. M. (2022). The development of artificial intelligence in education: A review in context. Journal of Computer Assisted Learning, 38(5), 1408–1421. 10.1111/jcal.12687
- Roose, K. (2022). The brilliance and weirdness of ChatGPT. The New York Times,
5 . - Serpil, H., & Kesim, E. (2024). Understanding the application of AI in higher education systems: Global perspectives from a local AI ecosystem. Open Praxis, 16(4), 645–662. 10.55982/openpraxis.16.4.725
- Schmidgall, S. P., Scheiter, K., & Eitel, A. (2020). Can we further improve tablet-based drawing to enhance learning? An empirical test of two types of support. Instr Sci, 48, 453–474. 10.1007/s11251-020-09513-6
- Schoeb, D. S., Schwarz, J., Hein, S., Schlager, D., Pohlmann, P. F., Frankenschmidt, A., Gratzke, C., & Miernik, A. (2020). Mixed reality for teaching catheter placement to medical students: a randomized single-blinded, prospective trial. BMC Med Educ, 20,
510 . 10.1186/s12909-020-02450-5 - Shih, W. L., & Tsai, C. Y. (2020). Effect of Flipped Classroom with BOPPPS Model on Learners’ Learning Outcomes and Perceptions in a Business Etiquette Course. Asia-Pacific Edu Res, 29, 257–268. 10.1007/s40299-019-00475-z
- Shrivastava, R. (2023). Role of artificial intelligence in the future of education. International Journal of Professional Business Review, 8(1),
2 . 10.26668/businessreview/2023.v8i1.840 - Sichterman, B., van Ginkel, S., van Halteren, M., van Tilborg, R., & Noroozi, O. (2023). The Effects of a Constructively Aligned Virtual Reality Setting on Professionals’ Knowledge, Motivation and Perceptions. International Journal of Technology in Education, 6(4), 561–582. 10.46328/ijte.462
- Song, D., & Kim, D. (2020). Effects of self-regulation scaffolding on online participation and learning outcomes. Journal of Research on Technology in Education, 53(3), 249–263. 10.1080/15391523.2020.1767525
- Tang, K. Y., Chang, C. Y., & Hwang, G. J. (2021). Trends in artificial intelligence-supported e-learning: A systematic review and co-citation network analysis (1998–2019). Interactive Learning Environments, 1–19. 10.1080/10494820.2021.1875001
- Taskıran, A., & Goksel, N. (2022). Automated feedback and teacher feedback: Writing achievement in learning English as a foreign language at a distance. Turkish Online Journal of Distance Education, 23(2), 120–139. 10.17718/tojde.1096260
- Timms, M. J. (2016). Letting artificial intelligence in education out of the box: Educational cobots and smart classrooms. International Journal of Artificial Intelligence in Education, 26, 701–712. 10.1007/s40593-016-0095-y
- Tlili, A., Garzón, J., Salha, S., Huang, R., Xu, L., Burgos, D., … & Wiley, D. (2023). Are open educational resources (OER) and practices (OEP) effective in improving learning achievement? A meta-analysis and research synthesis. International Journal of Educational Technology in Higher Education, 20(1),
54 . 10.1186/s41239-023-00424-3 - van Alten, D. C. D., Phielix, C., Janssen, J., & Kester, L. (2020). Self-regulated learning support in flipped learning videos enhances learning outcomes. Computers & Education, 158,
104000 . ISSN 0360–1315. 10.1016/j.compedu.2020.104000 - van den Berg, G. (2024). Generative AI and educators: Partnering in using open digital content for transforming education. Open Praxis, 16(2), 130–141. 10.55982/openpraxis.16.2.640
- van der Meij, H., Veldkamp, S., & Leemkuil, H. (2020). Effects of scripting on dialogues, motivation and learning outcomes in serious games. Br J Educ Technol, 51, 459–472. 10.1111/bjet.12851
- Wang, X., Huang, R. “Tammy”, Sommer, M., Pei, B., Shidfar, P., Rehman, M. S., Ritzhaupt, A. D., & Martin, F. (2024). The efficacy of artificial intelligence-enabled adaptive learning systems from 2010 to 2022 on learner outcomes: A meta-analysis. Journal of Educational Computing Research, 62(6). 10.1177/07356331241240459
- Wang, X., Younas, M., Jiang, Y., Imran, M., & Almusharraf, N. (2025). A systematic review on blockchain in education: Solutions and challenges. IEEE Access.
https://ieeexplore.ieee.org/document/10804766 - Williamson, B., & Eynon, R. (2020). Historical threads, missing links, and future directions in AI in education. Learning, Media and Technology, 45, 223–235. 10.1080/17439884.2020.1798995
- Wu, L. J., & Chang, K. E. (2020). Effect of embedding a cognitive diagnosis into the adaptive dynamic assessment of spatial geometry learning. Interactive Learning Environments, 31(2), 890–907. 10.1080/10494820.2020.1815216
- Wu, R., & Yu, Z. (2024). Do AI chatbots improve students’ learning outcomes? Evidence from a meta-analysis. British Journal of Educational Technology, 55(1), 10–33. 10.1111/bjet.13334
- Yang, C., Zhang, J., Hu, Y., Yang, X., Chen, M., Shan, M., & Li, L. (2024). The impact of virtual reality on practical skills for students in science and engineering education: A meta-analysis. International Journal of STEM Education, 11(1),
28 . 10.1186/s40594-024-00487-2 - Yang, F.-C. O., Lai, H.-M., Wang, Y.-W. (2023). Effect of augmented reality-based virtual educational robotics on programming students’ enjoyment of learning, computational thinking skills, and academic achievement. Computers & Education, 195,
104721 . ISSN 0360–1315. 10.1016/j.compedu.2022.104721 - Yang, Q. F., Lian, L. W., & Zhao, J. H. (2023). Developing a gamified artificial intelligence educational robot to promote learning effectiveness and behavior in laboratory safety courses for undergraduate students. Int J Educ Technol High Educ, 20,
18 . 10.1186/s41239-023-00391-9 - Yang, Y. T. C., Chen, Y. C., & Hung, H. T. (2020). Digital storytelling as an interdisciplinary project to improve students’ English speaking and creative thinking. Computer Assisted Language Learning, 35(4), 840–862. 10.1080/09588221.2020.1750431
- Younas, M., El-Dakhs, D. A. S., & Jiang, Y. (2025). A comprehensive systematic review of AI-driven approaches to self-directed learning. IEEE Access. 10.1109/ACCESS.2025.3546319
- Younas, M., Noor, U., Zhou, X., Menhas, R., & Qingyu, X. (2022). COVID-19, students’ satisfaction about e-learning, and academic achievement: Mediating analysis of online influencing factors. Frontiers in Psychology, 13,
948061 . 10.3389/fpsyg.2022.948061 - Yousef, A. M. F. (2021). Augmented reality assisted learning achievement, motivation, and creativity for children of low-grade in primary school. J Comput Assist Learn, 37, 966–977. 10.1111/jcal.12536
- Zhang, L., & Ma, Y. (2023). A study of the impact of project-based learning on student learning effects: A meta-analysis study. Frontiers in Psychology, 14,
1202728 . 10.3389/fpsyg.2023.1202728 - Zhan, Z., Tong, Y., Lan, X., & Zhong, B. (2024). A systematic literature review of game-based learning in artificial intelligence education. Interactive Learning Environments, 32(3), 1137–1158. 10.1080/10494820.2022.2115077
- Zhou, X., Younas, M., Omar, A., & Guan, L. (2022). Can second language metaphorical competence be taught through instructional intervention? A meta-analysis. Frontiers in Psychology, 13,
1065803 . 10.3389/fpsyg.2022.1065803 - Zulnaidi, H., Oktavika, E., & Hidayat, R. (2020). Effect of use of GeoGebra on achievement of high school mathematics students. Educ Inf Technol, 25, 51–72. 10.1007/s10639-019-09899-y
DOI: https://doi.org/10.55982/openpraxis.17.3.842 | Journal eISSN: 2304-070X
Language: English
Page range: 594 - 610
Submitted on: Feb 6, 2025
Accepted on: Mar 6, 2025
Published on: Aug 11, 2025
Published by: International Council for Open and Distance Education (ICDE)
In partnership with: Paradigm Publishing Services
Keywords:
© 2025 Muhammad Younas, Iskander Ismayil, Dina Abdel Salam El-Dakhs, Behzad Anwar, published by International Council for Open and Distance Education (ICDE)
This work is licensed under the Creative Commons Attribution 4.0 License.