An Experimental Study of the Effect of AI Course Assistants on Student Grade Outcomes
By: George Hanshaw, Ethan Wicker and Kristen Denlinger
References
- Anderson, M. J. (2001). Permutation tests for univariate or multivariate analysis of variance and regression. Canadian Journal of Fisheries and Aquatic Sciences, 58(3), 626–639. 10.1139/f01-004
- Baker, T., & Smith, L. (2019). Educ-AI-tion rebooted? Exploring the future of artificial intelligence in schools and colleges. Nesta.
https://www.nesta.org.uk/report/education-rebooted/ - Bozkurt, A. (2024). GenAI et al.: Cocreation, authorship, ownership, academic ethics and integrity in a time of generative AI. Open Praxis, 16(1), 1–10. 10.55982/openpraxis.16.1.654
- Chen, X., Xie, H., Zou, D., & Hwang, G. J. (2020). Application and theory gaps during the rise of artificial intelligence in education. Computers & Education, 146,
103751 . 10.1016/j.caeai.2020.100002 - Edgington, E. S., & Onghena, P. (2007). Randomization tests (4th ed.). CRC Press. 10.1201/9781420011814
- Good, P. I. (2005). Permutation, parametric, and bootstrap tests of hypotheses (3rd ed.). Springer.
- Hanshaw, G., Vance, J., & Brewer, C. (2024). Exploring the effectiveness of AI course assistants on the student learning experience. Open Praxis, 16(4), 627–644. 10.55982/openpraxis.16.4.719
- Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.
- Holstein, K., McLaren, B. M., & Aleven, V. (2019). Co-designing a real-time classroom orchestration tool to support teacher–AI complementarity. Journal of Learning Analytics, 6(2), 27–52. 10.18608/jla.2019.62.3
- Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023). Supporting students’ self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education, 20,
37 . 10.1186/s41239-023-00406-5 - Jung, I. (2024). Personalized education for all: The future of open universities. Open Praxis, 16(1), 24–36. 10.55982/openpraxis.16.1.612
- Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson Education.
- Maphoto, K. B., Sevnarayan, K., Mohale, N. E., Suliman, Z., Ntsopi, T. J., & Mokoena, D. (2024). Advancing students’ academic excellence in distance education: Exploring the potential of generative AI integration to improve academic writing skills. Open Praxis, 16(2), 142–159. 10.55982/openpraxis.16.2.649
- van den Berg, G. (2024). Generative AI and Educators: Partnering in Using Open Digital Content for Transforming Education. Open Praxis, 16(2), 130–141. 10.55982/openpraxis.16.2.640
- Wang, L., & Zhao, M. (2024). Can artificial intelligence technology promote the improvement of student learning outcomes? A meta-analysis based on 50 experimental and quasi-experimental studies. Proceedings of the 3rd International Conference on Educational Innovation and Multimedia Technology (EIMT 2024), 29–31. 10.4108/eai.29-3-2024.2347685
- Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – Where are the educators? International Journal of Educational Technology in Higher Education, 16, Article
39 . 10.1186/s41239-019-0171-0
DOI: https://doi.org/10.55982/openpraxis.17.2.772 | Journal eISSN: 2304-070X
Language: English
Page range: 270 - 285
Submitted on: Oct 4, 2024
Accepted on: Mar 5, 2025
Published on: Jul 10, 2025
Published by: International Council for Open and Distance Education (ICDE)
In partnership with: Paradigm Publishing Services
Keywords:
© 2025 George Hanshaw, Ethan Wicker, Kristen Denlinger, published by International Council for Open and Distance Education (ICDE)
This work is licensed under the Creative Commons Attribution 4.0 License.