Pilot introduction of AI enhanced Chat Bot for academic support in large sections of the core curriculum.
Georgia State University was one of the 1st institutions in the country to use an AI-Enhanced Chatbot to address issues of summer melt for new students and continuous enrollment for continuing students. .[1] This project expands the use of this technology to the classroom to increase successful completion of the class.
[1] For more information please see: Page, Lindsay C. , Katharine Meyer, Jeonghyun Lee, and Hunter Gehlbach. (2022). Conditions under which college students can be responsive to nudging. (EdWorkingPaper: 20-242). Retrieved from Annenberg Institute at Brown University: https://doi.org/10.26300/vjfs-kv29
Evaluation Plan and measures: % of students who earn passing grades and higher grades with utilization of chatbot
Baseline measure: DFW rates in pilot courses
Goal or targets: Decrease of 15% in DFW grades
Time period/duration: Spring 2023-Spring 2024
Previous randomized control trial (RCT) indicated improved academic performance, improved assignment completion and better student satisfaction based on usage of the Bot. American Government treatment group students 8 points more likely to earn B or higher than control group. Pell students 29% less likely to earn D or F than control group. In Macroeconomic students using chatbot 38% less likely to drop course than control group.
Expand pilot and randomized control trials planned to further understand course-based nudging and its effects on student outcomes. Currently, AI support is only available in American Government and Macroeconomics. We will launch AI support for Introductory Chemistry in Spring 2024 with additional courses planned for Fall 2024.
Collaboration with faculty remains a critical element of this project as we hope to maintain the positive momentum of impact in this area. Graduate student support, integrating intelligent agents and understanding how to communicate effectively is work that must be sustained to build on the successes of this initiative.
