Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

LEARN: A Story-Driven Layout-to-Image Generation Framework for STEM Instruction

Authors
Maoquan Zhang,
Bisser Raytchev,
Xiujuan Sun
Date
Publisher
arXiv
LEARN is a layout-aware diffusion framework designed to generate pedagogically aligned illustrations for STEM education. It leverages a curated BookCover dataset that provides narrative layouts and structured visual cues, enabling the model to depict abstract and sequential scientific concepts with strong semantic alignment. Through layout-conditioned generation, contrastive visual-semantic training, and prompt modulation, LEARN produces coherent visual sequences that support mid-to-high-level reasoning in line with Bloom's taxonomy while reducing extraneous cognitive load as emphasized by Cognitive Load Theory. By fostering spatially organized and story-driven narratives, the framework counters fragmented attention often induced by short-form media and promotes sustained conceptual focus. Beyond static diagrams, LEARN demonstrates potential for integration with multimodal systems and curriculum-linked knowledge graphs to create adaptive, exploratory educational content. As the first generative approach to unify layout-based storytelling, semantic structure learning, and cognitive scaffolding, LEARN represents a novel direction for generative AI in education. The code and dataset will be released to facilitate future research and practical deployment.
Study at a glance
  • Question: How can AI generate story-driven illustrations to support STEM learning?
  • Setting and data: A curated BookCover dataset containing narrative layouts and structured visual cues.
  • Method: Development and training of an AI image-generation model (layout-aware diffusion framework).
Why it matters

Short-form media often induces fragmented attention, challenging sustained conceptual focus. Additionally, teaching abstract and sequential STEM concepts requires visual narratives that support higher-level reasoning while reducing extraneous cognitive load.

Key findings
  • In STEM education, a new image-generation framework produces coherent visual sequences that support higher-level thinking and reduce unnecessary mental effort.
  • The tool's story-driven visual sequences help counter fragmented attention and encourage sustained focus on abstract, step-by-step scientific concepts.
  • The framework demonstrates potential to integrate with existing curriculum systems to generate adaptive and exploratory instructional content.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

What is the application?
Who is the user?