Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Creating a customisable freely-accessible Socratic AI physics tutor

Authors
Eugenio Tufino,
Bor Gregorcic
Date
Publisher
arXiv
This paper explores role engineering as an effective paradigm for customizing Large Language Models (LLMs) into specialized AI tutors for physics education. We demonstrate this methodology by designing a Socratic physics problem-solving tutor using Google's Gemini Gems feature, defining its pedagogical behavior through a detailed 'script' that specifies its role and persona. We present two illustrative use cases: the first demonstrates the Gem's multimodal ability to analyze a student's hand-drawn force diagram and apply notational rules from a 'Knowledge' file; the second showcases its capacity to guide conceptual reasoning in electromagnetism using its pre-trained knowledge without using specific documents provided by the instructor. Our findings show that the 'role-engineered' Gem successfully facilitates a Socratic dialogue, in stark contrast to a standard Gemini model, which tends to immediately provide direct solutions. We conclude that role engineering is a pivotal and accessible method for educators to transform a general-purpose 'solution provider' into a reliable pedagogical tutor capable of engaging students in an active reflection process. This approach offers a powerful tool for both instructors and students, while also highlighting the importance of addressing the technology's inherent limitations, such as the potential for occasional inaccuracies.
Study at a glance
  • Question: Can customizing an AI model's role create an effective physics tutor that guides student reasoning?
  • Setting and data: Two illustrative physics problem-solving use cases, including a student's hand-drawn force diagram.
  • Method: Design demonstration using two illustrative use cases comparing a customized AI tutor to a standard model.
Why it matters

Standard large language models tend to act as direct solution providers rather than pedagogical tutors. Educators need accessible ways to customize general-purpose models into specialized Socratic tutors that engage students in an active reflection process.

Key findings
  • In physics education, a customized AI tutor guided Socratic dialogue rather than immediately providing direct solutions like a standard AI model.
  • The AI tutor analyzed students' hand-drawn force diagrams and applied specific instructor-provided notation rules.
  • The tutor guided conceptual reasoning in electromagnetism using its existing knowledge without requiring additional documents from instructors.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

What is the application?
Who is the user?
Who age?