Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

The Art of Storytelling: Multi-Agent Generative AI for Dynamic Multimodal Narratives

Authors
Samee Arif,
Taimoor Arif,
Muhammad Saad Haroon,
Aamina Jamal Khan,
Agha Ali Raza,
Awais Athar
Date
Publisher
arXiv
This paper introduces the concept of an education tool that utilizes Generative Artificial Intelligence (GenAI) to enhance storytelling for children. The system combines GenAI-driven narrative co-creation, text-to-speech conversion, and text-to-video generation to produce an engaging experience for learners. We describe the co-creation process, the adaptation of narratives into spoken words using text-to-speech models, and the transformation of these narratives into contextually relevant visuals through text-to-video technology. Our evaluation covers the linguistics of the generated stories, the text-to-speech conversion quality, and the accuracy of the generated visuals.
Study at a glance
  • Question: How can generative AI be used to create dynamic stories with speech and video for children?
  • Setting and data: Not stated in the abstract
  • Method: Technical evaluation of the tool's generated story language, speech quality, and visual accuracy
Why it matters

Enhancing storytelling for children can produce engaging experiences for learners. Combining generative AI narrative co-creation, text-to-speech, and text-to-video technologies offers a way to transform narratives into spoken words and contextually relevant visuals.

Key findings
  • For children, a generative AI system produces engaging learning experiences by combining collaborative story writing, speech conversion, and video generation.
  • The system's text-to-video technology transforms written story narratives into contextually relevant visuals.
  • Integrated text-to-speech models adapt the co-created written stories into spoken narration.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

What is the application?
Who is the user?