The Art of Storytelling: Multi-Agent Generative AI for Dynamic Multimodal Narratives

View a PDF of the paper titled The Art of Storytelling: Multi-Agent Generative AI for Dynamic Multimodal Narratives, by Samee Arif and 5 other authors

View PDF
HTML (experimental)

Abstract:This paper introduces the concept of an education tool that utilizes Generative Artificial Intelligence (GenAI) to enhance storytelling for children. The system combines GenAI-driven narrative co-creation, text-to-speech conversion, and text-to-video generation to produce an engaging experience for learners. We describe the co-creation process, the adaptation of narratives into spoken words using text-to-speech models, and the transformation of these narratives into contextually relevant visuals through text-to-video technology. Our evaluation covers the linguistics of the generated stories, the text-to-speech conversion quality, and the accuracy of the generated visuals.