Date
Publisher
arXiv
Personalized mathematics education is growing rapidly, creating a strong demand for large sets of similar practice problems. Yet existing studies on mathematics problem generation have focused on data augmentation for training neural language models rather than on direct educational deployment. To bridge this gap, we define a new task, Isomorphic Math Problem Generation (IMPG), designed to produce structurally consistent variants of source problems. Subsequently, we explored LLM-based frameworks for automatic IMPG through successive refinements, and established Computational Blueprints for Isomorphic Twins (CBIT). With meta-level generation and template-based selective variation, CBIT achieves high mathematical correctness and structural consistency while reducing the cost of generation. Empirical results across refinements demonstrate that CBIT is superior on generation accuracy and cost-effectiveness at scale. Most importantly, CBIT-generated problems exhibited an error rate 17.8% lower than expert-authored items, with deployment to 6,732 learners on a commercial education platform yielding 186,870 interactions.
Study at a glance
- Question: Can large language models reliably generate structurally consistent and mathematically correct practice problems for educational use at low cost?
- Setting and data: Commercial online educational platform, 5-month deployment with 6,732 students; benchmark of 195 Korean curriculum math problems (grades 4–12).
- Method: Benchmark evaluation and field deployment comparing system-generated items against expert-authored items.
Why it matters
Personalized math education requires large sets of practice problems, but manual creation by experts is time-consuming and costly, while prior automated generation methods focused on model training data rather than deployment.
Key findings
- During real-world deployment, CBIT-generated problems exhibited a user-reported content error rate of 0.1867%, which was 17.8% lower than expert-authored items.
- CBIT achieved high generation success rates across request sizes and difficulty levels, reaching an 83% success rate at 100 requested problems.
- CBIT reduced generation costs to $0.71 per 1,000 successful problems at scale, decoupling production expenses from token consumption.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Why use AI?
Study design
