Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented Generation

Authors
Prakhar Dixit,
Tim Oates
Date
Publisher
arXiv
Many students struggle with math word problems (MWPs), often finding it difficult to identify key information and select the appropriate mathematical operations. Schema-based instruction (SBI) is an evidence-based strategy that helps students categorize problems based on their structure, improving problem-solving accuracy. Building on this, we propose a Schema-Based Instruction Retrieval-Augmented Generation (SBI-RAG) framework that incorporates a large language model (LLM). Our approach emphasizes step-by-step reasoning by leveraging schemas to guide solution generation. We evaluate its performance on the GSM8K dataset, comparing it with GPT-4 and GPT-3.5 Turbo, and introduce a "reasoning score" metric to assess solution quality. Our findings suggest that SBI-RAG enhances reasoning clarity and facilitates a more structured problem-solving process potentially providing educational benefits for students.
Study at a glance
  • Question: Can a structured problem-solving strategy help AI generate clearer step-by-step solutions for math word problems?
  • Setting and data: The GSM8K dataset.
  • Method: Compares the new AI model's problem-solving performance and reasoning quality against GPT-4 and GPT-3.5 Turbo.
Why it matters

Many students struggle with math word problems, often finding it difficult to identify key information and select the appropriate mathematical operations. Schema-based instruction is an evidence-based strategy that helps students categorize problems based on their structure to improve accuracy.

Key findings
  • In math word problem solving, an AI tool using problem-structure strategies suggested enhanced reasoning clarity compared to standard language models.
  • The structure-guided AI tool facilitated a more organized, step-by-step problem-solving process.
  • Categorizing math word problems by their underlying structure improves students' problem-solving accuracy.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

What is the application?
Who is the user?