Have a personal or library account? Click to login
Exploring the Efficacy of GenAI in Grading SQL Query Tasks: A Case Study Cover

Exploring the Efficacy of GenAI in Grading SQL Query Tasks: A Case Study

Open Access
|Sep 2024

Abstract

Numerous techniques, including problem-solving, seeking clarification, and creating questions, have been employed to utilize generative Artificial Intelligence (AI) in education. This study investigates the possibility of using Generate AI (GenAI) to grade Structured Query Language (SQL) queries automatically. Three models were used which are ChatGPT, Gemini, and Copilot. The study uses an experimental approach to assess how well the models perform in evaluating student responses by comparing the models’ accuracy with those of human experts. The results showed that despite some inconsistencies, GenAI holds great promise for streamlining. Thus, further research is required in light of inconsistent GenAI performance. If these issues were resolved, GenAI can be utilized in education. However, human oversight and ethical issues must always come first.

DOI: https://doi.org/10.2478/cait-2024-0027 | Journal eISSN: 1314-4081 | Journal ISSN: 1311-9702
Language: English
Page range: 102 - 111
Submitted on: Aug 7, 2024
|
Accepted on: Aug 21, 2024
|
Published on: Sep 19, 2024
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2024 Thair Hamtini, Abdelbaset J. Assaf, published by Bulgarian Academy of Sciences, Institute of Information and Communication Technologies
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.