Date
Publisher
arXiv
While foundation models (FMs), such as diffusion models and large
vision-language models (LVLMs), have been widely applied in educational
contexts, their ability to generate pedagogically effective visual explanations
remains limited. Most existing approaches focus primarily on textual reasoning,
overlooking the critical role of structured and interpretable visualizations in
supporting conceptual understanding. To better assess the visual reasoning
capabilities of FMs in educational settings, we introduce EduVisBench, a
multi-domain, multi-level benchmark. EduVisBench features diverse STEM problem
sets requiring visually grounded solutions, along with a fine-grained
evaluation rubric informed by pedagogical theory. Our empirical analysis
reveals that existing models frequently struggle with the inherent challenge of
decomposing complex reasoning and translating it into visual representations
aligned with human cognitive processes. To address these limitations, we
propose EduVisAgent, a multi-agent collaborative framework that coordinates
specialized agents for instructional planning, reasoning decomposition,
metacognitive prompting, and visualization design. Experimental results show
that EduVisAgent substantially outperforms all baselines, achieving a 40.2%
improvement and delivering more educationally aligned visualizations.
EduVisBench and EduVisAgent are available at
https://github.com/aiming-lab/EduVisBench and
https://github.com/aiming-lab/EduVisAgent.
Study at a glance
- Question: How can AI models be designed to generate effective visual explanations for teaching STEM concepts?
- Setting and data: Diverse STEM problem sets requiring visually grounded solutions.
- Method: Evaluates AI models using a teaching-informed rubric and tests a new multi-agent framework.
Why it matters
Foundation models are widely applied in education, yet their ability to generate pedagogically effective visual explanations remains limited. Most approaches focus on textual reasoning, overlooking the critical role structured visualizations play in supporting conceptual understanding.
Key findings
- Across diverse STEM problems, a specialized multi-agent AI system achieved a 40.2% improvement over standard models in generating educationally aligned visual explanations.
- Existing AI models frequently struggle to break down complex reasoning into visual representations that align with human learning processes.
- Most current AI models focus primarily on text reasoning, overlooking structured visual explanations that support conceptual understanding.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Study design
