Date
Publisher
arXiv
To prevent the adoption of aesthetically polished but pedagogically flawed AI content, we study a video authoring pipeline featuring two layers of structured refusal. The first layer empowers educators to iteratively reshape AI scripts based on multimedia learning theory, while the second employs automated metrics to flag violations in instructional coherence and narrative-visual synchronization. While neither layer is exhaustive, their synergy ensures that principled resistance--the act of deferring AI output until it meets rigorous standards--becomes a catalyst for higher quality. Evaluation combining a study with 23 educators across 3 topics and automated metrics across 7 topics drawn from established science and philosophy curricula shows that both layers independently improve the same instructional dimensions, suggesting that thoughtful resistance and generative AI are not opposites but partners.
Study at a glance
- Question: Can structured human and automated checkpoints improve the pedagogical quality of AI-generated educational videos?
- Setting and data: 23 educators across 3 topics; 14 AI-generated videos across 7 science and philosophy curriculum topics.
- Method: User study with educators (within-subject design) and automated evaluation comparing videos across conditions.
Why it matters
AI-generated educational videos often prioritize visual appeal over instructional essentials. Pressuring educators toward seamless, friction-free adoption risks reducing their role from professional decision-makers to passive consumers of pedagogically flawed materials.
Key findings
- Educator review based on multimedia learning principles increased ratings across all 12 principles, raising mean ratings from 3.07 to 3.86 on a 5-point scale.
- Automated metrics independently confirmed significant gains in temporal contiguity and instructional coherence in videos produced with the structured pipeline.
- Educators did not view the iterative review as slowing them down, rating production efficiency at 4.26 out of 5 and requesting further review features.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Why use AI?
Study design
