Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Personalizing Student-Agent Interactions Using Log-Contextualized Retrieval-Augmented Generation (RAG)

Authors
Clayton Cohn,
Surya Rayala,
Caitlin Snyder,
Joyce Horn Fonteles,
Shruti Jain,
Naveeduddin Mohammed,
Umesh Timalsina,
Sarah K. Burriss,
Ashwin T S,
Namrata Srivastava,
Menton Deweese,
Angela Eeds,
Gautam Biswas
Date
Publisher
arXiv
Collaborative dialogue offers rich insights into students' learning and critical thinking, which is essential for personalizing pedagogical agent interactions in STEM+C settings. While large language models (LLMs) facilitate dynamic pedagogical interactions, hallucinations undermine confidence, trust, and instructional value. Retrieval-augmented generation (RAG) grounds LLM outputs in curated knowledge, but requires a clear semantic link between user input and a knowledge base, which is often weak in student dialogue. We propose log-contextualized RAG (LC-RAG), which enhances RAG retrieval by using environment logs to contextualize collaborative discourse. Our findings show that LC-RAG improves retrieval over a discourse-only baseline and enables our collaborative peer agent, Copa, to deliver relevant, personalized guidance that supports students' critical thinking and epistemic decision-making in the collaborative computational modeling environment C2STEM.
Study at a glance
  • Question: Can tracking student activity help an AI partner provide more personalized guidance during collaborative learning?
  • Setting and data: Student dialogue and activity logs from the collaborative computational modeling environment C2STEM.
  • Method: Compares an AI model using activity logs against a baseline model using only dialogue.
Why it matters

Large language model hallucinations undermine confidence, trust, and instructional value in pedagogical interactions. While retrieval-augmented generation grounds outputs, the semantic link between student dialogue and curated knowledge is often weak.

Key findings
  • In a collaborative computational modeling environment, adding activity logs to student conversations improved an AI tool's information retrieval over using student dialogue alone.
  • The AI peer agent successfully delivered relevant, personalized guidance to students during collaborative learning activities.
  • The AI agent's personalized guidance supported students' critical thinking and decision-making.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

What is the application?
Who is the user?