Date
Publisher
arXiv
Many students struggle with math word problems (MWPs), often finding it
difficult to identify key information and select the appropriate mathematical
operations. Schema-based instruction (SBI) is an evidence-based strategy that
helps students categorize problems based on their structure, improving
problem-solving accuracy. Building on this, we propose a Schema-Based
Instruction Retrieval-Augmented Generation (SBI-RAG) framework that
incorporates a large language model (LLM). Our approach emphasizes step-by-step
reasoning by leveraging schemas to guide solution generation. We evaluate its
performance on the GSM8K dataset, comparing it with GPT-4 and GPT-3.5 Turbo,
and introduce a "reasoning score" metric to assess solution quality. Our
findings suggest that SBI-RAG enhances reasoning clarity and facilitates a more
structured problem-solving process potentially providing educational benefits
for students.
Study at a glance
- Question: Can a structured problem-solving strategy help AI generate clearer step-by-step solutions for math word problems?
- Setting and data: The GSM8K dataset.
- Method: Compares the new AI model's problem-solving performance and reasoning quality against GPT-4 and GPT-3.5 Turbo.
Why it matters
Many students struggle with math word problems, often finding it difficult to identify key information and select the appropriate mathematical operations. Schema-based instruction is an evidence-based strategy that helps students categorize problems based on their structure to improve accuracy.
Key findings
- In math word problem solving, an AI tool using problem-structure strategies suggested enhanced reasoning clarity compared to standard language models.
- The structure-guided AI tool facilitated a more organized, step-by-step problem-solving process.
- Categorizing math word problems by their underlying structure improves students' problem-solving accuracy.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
Study design

