A Pilot Test to Assess the Effectiveness of AI-Generated Practice Quizzes on University Student Examination Scores

This pilot study evaluated the effectiveness of AI-generated practice quizzes on student examination performance in an undergraduate business course. Two sections of the same Operations and Production Management course (N=64) were taught by the same professor using identical content and materials. The experimental section (n=32) completed AI-generated True/False and Multiple Choice practice quizzes before Exam 1, while the control section (n=32) received no practice quizzes. A pre-test administered to both sections on prior content showed no significant difference in baseline performance. Results showed the experimental section scored significantly higher on Exam 1 (M=85.94%) compared to the control section (M=82.22%), t(61)=2.21, p=0.031. All students in the experimental section completed all practice quizzes with no reported technical difficulties. Following the study, students in the experimental section requested continued access to the practice quizzes, while students in the control section requested access. These findings suggest AI-generated formative assessments may improve student learning outcomes and engagement.