Generation of story videos corresponding to user input using generative models

A method for video generation corresponding to a user input, the method comprising:

• receiving the user input;
• generating a story text based on the user input, wherein the story text comprises a plurality of sentences generated by:
• generating a sentence based on the user input;
• and
• iteratively generating successive sentences using one or more of previously generated sentences and the user input;
• generating a plurality of story images based on the story text, each of the plurality of story images corresponding to one of the plurality of sentences;
• and
• outputting a story including the story text and a story video, wherein the story video comprises a plurality of animated videos, each animated video corresponding to a respective story image of the plurality of story images.

A computing system for video generation corresponding to a user input, the computing system comprising:

• a processor and memory, the processor configured to execute a program using portions of the memory to:
• receive the user input, wherein the user input includes one or more words;
• generate a story text based on the user input, wherein the story text includes a plurality of sentences having contextual coherence, and wherein the plurality of sentences is generated by:
• generating a sentence based on the user input;
• and
• iteratively generating successive sentences using one or more of previously generated sentences and the user input;
• generate a plurality of story images, wherein each of the plurality of story images corresponds to a sentence in the plurality of sentences;
• select audio data based on the story text;
• and
• output a story including the story text, the selected audio data, and a story video having content corresponding to the story text, wherein the story video comprises a plurality of animated videos, each animated video corresponding to a respective story image of the plurality of story images.