Figure 1
Correlation Matrix for Students Who Used Spark.
Note. Cells display Pearson correlation coefficients among four course-experience items: Q9 (advisement), Q10 (course organization), Q11 (relevance), and Q12 (clarity of instructions). Higher values indicate stronger positive associations between items. Scores are based on a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree). The full wording and descriptive statistics for these items are provided in Appendix A; together they demonstrated good internal consistency (Cronbach’s α = 0.88).
Figure 2
Correlation Matrix for Students Who Did Not Use Spark.
Note. Cells display Pearson correlation coefficients among four course-experience items: Q9 (advisement), Q10 (course organization), Q11 (relevance), and Q12 (clarity of instructions). Higher values indicate stronger positive associations between items. Scores are based on a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree). The full wording and descriptive statistics for these items are provided in Appendix A; together they demonstrated good internal consistency (Cronbach’s α = 0.88).
Figure 3
Average GPA by Spark Engagement Tier.
Note. Low, Medium, and High Spark-usage tiers are based on tertiles of Spark message counts; bars display mean course GPA on a 4.0 scale, and error bars represent standard errors. A one-way ANOVA indicated no statistically significant differences in GPA across tiers, F(2, 409) = 1.41, p = .24, η2 = .01, although mean GPAs increased from the Low (M = 3.15, n = 137) and Medium (M = 3.18, n = 138) tiers to the High tier (M = 3.36, n = 137). These tier-based results are interpreted as exploratory and descriptive rather than as evidence of a strong categorical effect of Spark usage on performance.
Figure 4
Average Engagement Scores (Q1, Q3, Q5) by Term and Spark Use.
Note. Scores are based on a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree). Spark usage is self-reported (Q46 > 0). The data show a growing divergence over time, with Spark users reporting consistently higher engagement starting in Fall 2024.
| COLUMN | QUESTION |
|---|---|
| Question 1 | I felt encouraged throughout the course. |
| Question 2 | I felt encouraged throughout the course. - <b>What made you feel encouraged or a lack of encouragement?</b> |
| Question 3 | I felt engaged throughout the course. |
| Question 4 | I felt engaged throughout the course. - <b>What made you feel engaged or a lack of engagement?</b> |
| Question 5 | I felt supported throughout the course. |
| Question 6 | I felt supported throughout the course. - <b>What made you feel supported or a lack of support? </b> |
| Question 7 | Student support services enabled me to successfully complete the course. |
| Question 8 | Student support services enabled me to successfully complete the course. - Comments: |
| Question 9 | I received an adequate level of academic advisement from my success coach. |
| Question 10 | The organization of the course content is intuitive. |
| Question 11 | I learned relevant information in this class that I can apply to my life. |
| Question 12 | Instructions for this course were clearly stated and easily understood. |
| Question 13 | Instructions for this course were clearly stated and easily understood. - Comments: |
| Question 14 | This course helped me better understand the relationship of a Christian Worldview to the content area of the course. |
| Question 15 | This course helped me better understand the relationship of a Christian Worldview to the content area of the course. - Comments: |
| Question 16 | This course helped me better understand the relationship of a Christian Worldview to my life and work in the world. |
| Question 17 | This course helped me better understand the relationship of a Christian Worldview to my life and work in the world. - Comments: |
| Question 18 | The learning activities and assignments promoted the achievement of the stated learning objectives. |
| Question 19 | The learning activities and assignments promoted the achievement of the stated learning objectives. - Comments: |
| Question 20 | On average, how many hours did you spend on this course (online and offline) per week? |
| Question 21 | Did you adopt an eTextbook for this course? |
| Question 22 | The tools and media supported the course learning objectives. |
| Question 23 | The tools and media supported the course learning objectives. - Comments: |
| Question 24 | My instructor used the grading criteria (rubrics) as a basis for evaluating my work. |
| Question 25 | My instructor used the grading criteria (rubrics) as a basis for evaluating my work. - Comments: |
| Question 26 | My instructor’s interactions made the course material interesting and relevant. |
| Question 27 | My instructor’s interactions made the course material interesting and relevant. - Comments: |
| Question 28 | My instructor’s feedback helped promote active learning. |
| Question 29 | My instructor’s feedback helped promote active learning. - Comments: |
| Question 30 | My instructor responded to my requests for assistance within one business day. |
| Question 31 | My instructor provided feedback on assignments within 5 business days. |
| Question 32 | My instructor demonstrated respect for the students. |
| Question 33 | My instructor demonstrated respect for the students. - Comments: |
| Question 34 | I was able to use the course communication tools effectively to communicate with my instructor. |
| Question 35 | Having the ability to schedule office hours with my instructor made me feel more supported. |
| Question 36 | How likely are you to take advantage of LAPU’s Inspire 10% tuition discount by referring a friend to study at LAPU? |
| Question 37 | Pay it forward. What advice would you give a future student to help them succeed in this course? (optional) |
| Question 38 | Pay it forward. If you found resources that particularly helped you, share them here so we can pass them along. (optional) |
| Question 39 | Additional comments you would like to provide. (optional) |
| Question 40 | Did you use Spark, the AI Course Assistant, while participating in your course? |
| Question 41 | What is the primary reason(s) you did not use Spark within your course? |
| Question 42 | Effectiveness of AI Assistant: The AI course assistant helped me understand course material and concepts. |
| Question 43 | Availability and Responsiveness: I am satisfied with the availability and responsiveness of the AI course assistant within the course. |
| Question 44 | Support and Clarification: The AI course assistant supported me in clarifying doubts and answering questions related to the coursework. |
| Question 45 | Integration with Learning Experience: The AI course assistant enhanced my overall learning experience in my course. |
| Question 46 | Approximately how many times did you utilize the AI course assistant within your course. |
| Question 47 | How many times did you connect with your Success Coach? |
| Question 48 | What is your expected grade outcome for the course? |
| Question 49 | Suggestions for Improvement: What improvements or additional features would you suggest for the AI assistant to support your learning experience better? (optional) |