Date
Publisher
arXiv
AI-assisted learning has seen a remarkable uptick over the last few years,
mainly due to the rise in popularity of Large Language Models (LLMs). Their
ability to hold long-form, natural language interactions with users makes them
excellent resources for exploring school- and university-level topics in a
dynamic, active manner. We compare students' experiences when interacting with
an LLM companion in two capacities: tutored learning and learning-by-teaching.
We do this using Chrysalis, an LLM-based system that we have designed to
support both AI tutors and AI teachable agents for any topic. Through a
within-subject exploratory study with 36 participants, we present insights into
student preferences between the two strategies and how constructs such as
intellectual humility vary between these two interaction modes. To our
knowledge, we are the first to conduct a direct comparison study on the effects
of using an LLM as a tutor versus as a teachable agent on multiple topics. We
hope that our work opens up new avenues for future research in this area.
Study at a glance
- Question: How do students experience, engage with, and learn from an AI tutor compared to teaching an AI agent?
- Setting and data: 36 fourth-year undergraduate and graduate computer science students enrolled in machine learning and artificial intelligence courses at an anonymized university.
- Method: Within-subject exploratory study counterbalancing topics across both learning modes, analyzing surveys, chat linguistics, and quiz scores (Wilcoxon signed-rank tests).
Why it matters
Although AI tutors and teachable agents are widely studied, comparative research is lacking on how students respond to learning from an AI tutor versus learning by teaching an AI agent.
Key findings
- Students showed no significant overall preference or quiz score difference between learning from an AI tutor and teaching an AI agent.
- Participants demonstrated significantly higher levels of intellectual humility when tutored by the AI (mean score 0.242) compared to teaching the AI agent (0.101).
- Students sent longer messages and more total words when teaching the AI agent, while AI tutor chats featured more formal, information-dense language.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Study design
