Date
AI Overview
Why it matters
Traditional teachable agents cannot sustain natural language dialogue, limiting engagement. Generative AI enables flexible conversations, but its actual impact as a teachable agent on programming education and self-regulated learning remains largely unexamined.
Study at a glance
- Question: How does teaching a ChatGPT agent affect students' programming knowledge, coding skills, and self-regulated learning abilities?
- Setting and data: Online experiment with 41 computer science university students (34 males, 7 females, average age 21.2) from two universities.
- Method: Randomized controlled trial (online experiment with ANCOVA analysis).
- AI tools: ChatGPT, GPT-4
Key findings
- Students teaching the ChatGPT agent achieved significantly higher programming knowledge scores than those learning from online videos alone (adjusted mean 11.86 versus 10.53).
- Students who taught ChatGPT wrote significantly clearer and more readable pseudocode, though code correctness did not significantly differ between the two groups.
- Interacting with the teachable agent significantly increased students' self-regulated learning abilities, specifically their self-efficacy and use of cognitive strategies.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
This study investigates the potential of using ChatGPT as a teachable agent to support students learning by teaching process, specifically in programming education. While learning by teaching is an effective pedagogical strategy for promoting active learning, traditional teachable agents have limitations, particularly in facilitating natural language dialogue. Our research explored whether ChatGPT, with its ability to engage learners in natural conversations, can support this process. The findings reveal that interacting with ChatGPT improves students knowledge gains and programming abilities, particularly in writing readable and logically sound code. However, it had limited impact on developing learners error-correction skills, likely because ChatGPT tends to generate correct code, reducing opportunities for students to practice debugging. Additionally, students self-regulated learning (SRL) abilities improved, suggesting that teaching ChatGPT fosters learnerï higher self-efficacy and better implementation of SRL strategies. This study discussed the role of natural dialogue in fostering socialized learning by teaching, and explored ChatGPT specific contributions in supporting students SRL through the learning by teaching process. Overall, the study highlights ChatGP potential as a teachable agent, offering insights for future research on ChatGPT-supported education.
Research Categories
What is the application?
Who is the user?
Who age?
Study design
AI tools
Publication Source
Publisher
arXiv
