Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Personalizing Student-Agent Interactions Using Log-Contextualized Retrieval Augmented Generation (RAG)

Authors
Clayton Cohn,
Surya Rayala,
Caitlin Snyder,
Joyce Horn Fonteles,
Shruti Jain,
Naveeduddin Mohammed,
Umesh Timalsina,
Sarah K. Burriss,
Ashwin T,
Namrata Srivastava,
Menton Deweese,
Angela Eeds,
Gautam Biswas
Date
Publisher
arXiv
Collaborative dialogue offers rich insights into students' learning and critical thinking. This is essential for adapting pedagogical agents to students' learning and problem-solving skills in STEM+C settings. While large language models (LLMs) facilitate dynamic pedagogical interactions, potential hallucinations can undermine confidence, trust, and instructional value. Retrieval-augmented generation (RAG) grounds LLM outputs in curated knowledge, but its effectiveness depends on clear semantic links between user input and a knowledge base, which are often weak in student dialogue. We propose log-contextualized RAG (LC-RAG), which enhances RAG retrieval by incorporating environment logs to contextualize collaborative discourse. Our findings show that LC-RAG improves retrieval over a discourse-only baseline and allows our collaborative peer agent, Copa, to deliver relevant, personalized guidance that supports students' critical thinking and epistemic decision-making in a collaborative computational modeling environment, XYZ.
Study at a glance
  • Question: Can incorporating activity logs help an AI agent provide more accurate, personalized guidance during collaborative student learning?
  • Setting and data: Students in a collaborative computational modeling environment named XYZ.
  • Method: Compares an AI system using environment logs (LC-RAG) against a discourse-only baseline.
Why it matters

While large language models facilitate dynamic pedagogical interactions, hallucinations can undermine trust and instructional value. Retrieval-augmented generation can ground outputs, but its effectiveness is limited because student dialogue often lacks clear semantic links to curated knowledge.

Key findings
  • In a collaborative computational modeling environment, an AI peer agent supported students' critical thinking and decision-making.
  • The AI peer agent successfully delivered relevant, personalized guidance to students during collaborative problem-solving.
  • Incorporating platform activity logs helped the AI retrieve relevant reference information better than relying on student dialogue alone.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

Who is the user?