Date
Publisher
arXiv
Generating high-quality geometry problems is both an important and
challenging task in education. Compared to math word problems, geometry
problems further emphasize multi-modal formats and the translation between
informal and formal languages. In this paper, we introduce a novel task for
geometry problem generation and propose a new pipeline method: the Symbolic
Deduction Engine-based Geometry Problem Generation framework (SDE-GPG). The
framework leverages a symbolic deduction engine and contains four main steps:
(1) searching a predefined mapping table from knowledge points to extended
definitions, (2) sampling extended definitions and performing symbolic
deduction, (3) filtering out unqualified problems, and (4) generating textual
problems and diagrams. Specifically, our method supports to avoid inherent
biases in translating natural language into formal language by designing the
mapping table, and guarantees to control the generated problems in terms of
knowledge points and difficulties by an elaborate checking function. With
obtained formal problems, they are translated to natural language and the
accompanying diagrams are automatically drew by rule-based methods. We conduct
experiments using real-world combinations of knowledge points from two public
datasets. The results demonstrate that the SDE-GPG can effectively generate
readable, solvable and controllable geometry problems.
Study at a glance
- Question: Can a symbolic deduction engine generate readable, solvable, and controllable geometry problems with diagrams?
- Setting and data: Geometry problems sampled from two public benchmarks: 231 problems from JGEX-AG-231 and 100 plane geometry problems from Chinese middle school exams (GeoQA).
- Method: System development and expert evaluation (Symbolic Deduction Engine-based Geometry Problem Generation framework).
Why it matters
Automatic problem generation can save teachers time and help students practice with personalized problems. However, generating geometry problems remains less studied because they require step-by-step theorem reasoning, multimodal text and diagrams, and precise mathematical language.
Key findings
- The proposed framework with qualification checking generated solvable problems on 100% of tested cases on JGEX-AG-231 and 96% on GeoQA, outperforming GPT-4o.
- Expert evaluations showed the framework with checking achieved higher grammatical fluency (4.25 to 4.53 out of 5) and logical clarity than baseline methods.
- The checking mechanism improved the completeness of required knowledge points and difficulty consistency compared to generating problems without checking or using GPT-4o alone.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who age?
Why use AI?
