Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

When Saying No Makes Better Videos: Designing Dual Gatekeeping For Pedagogically Grounded AI Content Creation

Date
Publisher
arXiv
To prevent the adoption of aesthetically polished but pedagogically flawed AI content, we study a video authoring pipeline featuring two layers of structured refusal. The first layer empowers educators to iteratively reshape AI scripts based on multimedia learning theory, while the second employs automated metrics to flag violations in instructional coherence and narrative-visual synchronization. While neither layer is exhaustive, their synergy ensures that principled resistance--the act of deferring AI output until it meets rigorous standards--becomes a catalyst for higher quality. Evaluation combining a study with 23 educators across 3 topics and automated metrics across 7 topics drawn from established science and philosophy curricula shows that both layers independently improve the same instructional dimensions, suggesting that thoughtful resistance and generative AI are not opposites but partners.
Study at a glance
  • Question: Can structured human and automated checkpoints improve the pedagogical quality of AI-generated educational videos?
  • Setting and data: 23 educators across 3 topics; 14 AI-generated videos across 7 science and philosophy curriculum topics.
  • Method: User study with educators (within-subject design) and automated evaluation comparing videos across conditions.
Why it matters

AI-generated educational videos often prioritize visual appeal over instructional essentials. Pressuring educators toward seamless, friction-free adoption risks reducing their role from professional decision-makers to passive consumers of pedagogically flawed materials.

Key findings
  • Educator review based on multimedia learning principles increased ratings across all 12 principles, raising mean ratings from 3.07 to 3.86 on a 5-point scale.
  • Automated metrics independently confirmed significant gains in temporal contiguity and instructional coherence in videos produced with the structured pipeline.
  • Educators did not view the iterative review as slowing them down, rating production efficiency at 4.26 out of 5 and requesting further review features.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

What is the application?
Who is the user?
Why use AI?