Date
Publisher
arXiv
This paper explores role engineering as an effective paradigm for customizing
Large Language Models (LLMs) into specialized AI tutors for physics education.
We demonstrate this methodology by designing a Socratic physics problem-solving
tutor using Google's Gemini Gems feature, defining its pedagogical behavior
through a detailed 'script' that specifies its role and persona. We present two
illustrative use cases: the first demonstrates the Gem's multimodal ability to
analyze a student's hand-drawn force diagram and apply notational rules from a
'Knowledge' file; the second showcases its capacity to guide conceptual
reasoning in electromagnetism using its pre-trained knowledge without using
specific documents provided by the instructor. Our findings show that the
'role-engineered' Gem successfully facilitates a Socratic dialogue, in stark
contrast to a standard Gemini model, which tends to immediately provide direct
solutions. We conclude that role engineering is a pivotal and accessible method
for educators to transform a general-purpose 'solution provider' into a
reliable pedagogical tutor capable of engaging students in an active reflection
process. This approach offers a powerful tool for both instructors and
students, while also highlighting the importance of addressing the technology's
inherent limitations, such as the potential for occasional inaccuracies.
Study at a glance
- Question: Can customizing an AI model's role create an effective physics tutor that guides student reasoning?
- Setting and data: Two illustrative physics problem-solving use cases, including a student's hand-drawn force diagram.
- Method: Design demonstration using two illustrative use cases comparing a customized AI tutor to a standard model.
Why it matters
Standard large language models tend to act as direct solution providers rather than pedagogical tutors. Educators need accessible ways to customize general-purpose models into specialized Socratic tutors that engage students in an active reflection process.
Key findings
- In physics education, a customized AI tutor guided Socratic dialogue rather than immediately providing direct solutions like a standard AI model.
- The AI tutor analyzed students' hand-drawn force diagrams and applied specific instructor-provided notation rules.
- The tutor guided conceptual reasoning in electromagnetism using its existing knowledge without requiring additional documents from instructors.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who age?
Why use AI?

