Date
Publisher
arXiv
This paper introduces the concept of an education tool that utilizes
Generative Artificial Intelligence (GenAI) to enhance storytelling for
children. The system combines GenAI-driven narrative co-creation,
text-to-speech conversion, and text-to-video generation to produce an engaging
experience for learners. We describe the co-creation process, the adaptation of
narratives into spoken words using text-to-speech models, and the
transformation of these narratives into contextually relevant visuals through
text-to-video technology. Our evaluation covers the linguistics of the
generated stories, the text-to-speech conversion quality, and the accuracy of
the generated visuals.
Study at a glance
- Question: How can generative AI be used to create dynamic stories with speech and video for children?
- Setting and data: Not stated in the abstract
- Method: Technical evaluation of the tool's generated story language, speech quality, and visual accuracy
Why it matters
Enhancing storytelling for children can produce engaging experiences for learners. Combining generative AI narrative co-creation, text-to-speech, and text-to-video technologies offers a way to transform narratives into spoken words and contextually relevant visuals.
Key findings
- For children, a generative AI system produces engaging learning experiences by combining collaborative story writing, speech conversion, and video generation.
- The system's text-to-video technology transforms written story narratives into contextually relevant visuals.
- Integrated text-to-speech models adapt the co-created written stories into spoken narration.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Study design
