Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Towards Generating Controllable and Solvable Geometry Problem by Leveraging Symbolic Deduction Engine

Date
Publisher
arXiv
Generating high-quality geometry problems is both an important and challenging task in education. Compared to math word problems, geometry problems further emphasize multi-modal formats and the translation between informal and formal languages. In this paper, we introduce a novel task for geometry problem generation and propose a new pipeline method: the Symbolic Deduction Engine-based Geometry Problem Generation framework (SDE-GPG). The framework leverages a symbolic deduction engine and contains four main steps: (1) searching a predefined mapping table from knowledge points to extended definitions, (2) sampling extended definitions and performing symbolic deduction, (3) filtering out unqualified problems, and (4) generating textual problems and diagrams. Specifically, our method supports to avoid inherent biases in translating natural language into formal language by designing the mapping table, and guarantees to control the generated problems in terms of knowledge points and difficulties by an elaborate checking function. With obtained formal problems, they are translated to natural language and the accompanying diagrams are automatically drew by rule-based methods. We conduct experiments using real-world combinations of knowledge points from two public datasets. The results demonstrate that the SDE-GPG can effectively generate readable, solvable and controllable geometry problems.
Study at a glance
  • Question: Can a symbolic deduction engine generate readable, solvable, and controllable geometry problems with diagrams?
  • Setting and data: Geometry problems sampled from two public benchmarks: 231 problems from JGEX-AG-231 and 100 plane geometry problems from Chinese middle school exams (GeoQA).
  • Method: System development and expert evaluation (Symbolic Deduction Engine-based Geometry Problem Generation framework).
Why it matters

Automatic problem generation can save teachers time and help students practice with personalized problems. However, generating geometry problems remains less studied because they require step-by-step theorem reasoning, multimodal text and diagrams, and precise mathematical language.

Key findings
  • The proposed framework with qualification checking generated solvable problems on 100% of tested cases on JGEX-AG-231 and 96% on GeoQA, outperforming GPT-4o.
  • Expert evaluations showed the framework with checking achieved higher grammatical fluency (4.25 to 4.53 out of 5) and logical clarity than baseline methods.
  • The checking mechanism improved the completeness of required knowledge points and difficulty consistency compared to generating problems without checking or using GPT-4o alone.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

What is the application?