# US 2026/0101081 A1 · Systems and methods for automated movie generation and editing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0101081 A1
- Document ID: US20260101081A1
- Status: Published application
- Kind: A1
- Application number: 19/348,747
- Filed: 2025-10-02
- Published: 2026-04-09
- Earliest claimed: 2024-10-03
- Assignees: Meta Platforms, Inc.
- Applicants: Meta Platforms, Inc.
- Inventors: Zecheng He; Samaneh Azadi; Bowen Shi; Apoorv Vyas; Ann Lee; Ishan Satish Misra; Peizhao Zhang; Roshan Rajesh Sumbaly; Yaniv Nechemia Taigman; Peter Vajda; Yi-Chiao Wu; Andros Tjandra; Wei-Ning Hsu; Amit Zohar; Animesh Sinha; Yuval Kirstain; Shelly Sheynin; Adam Polyak; Matthew Le; Juefei Xu; Haoyu Ma; Tingbo Hou
- Web page: https://patentgrep.com/patent/US20260101081A1

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06V 10/82: using neural networks
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- H04N 21/43072: {of multiple content streams on the same device}
- H04N 21/8113: {comprising music, e.g. song in MP3 format}
- H04N 21/816: {involving special video data, e.g 3D video}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system and method to generate a video is provided. The method may include generating, based on a user input including a description of a desired video, a structured script including one or more of scene descriptions, dialogue, or explicit shot-level information. The method also includes generating, based on the structured script, a sequence of video frames representing one or more scenes. The method further includes generating, based on the structured script and the sequence of video frames, an audio track including one or more of ambient sounds, sound effects, or music. The generated audio track being temporally synchronized with the sequence of video frames. The method also includes combining the sequence of video frames with the audio track to generate a synchronized video output representing the desired video.

## Claims

### Claim 1

A method to generate a video, comprising:
receiving a user input comprising a description of a desired video;
generating, based on the user input prompt, a structured script comprising one or more of scene descriptions, dialogue, or explicit shot-level information;
generating, based on the structured script, a sequence of video frames representing one or more scenes;
generating, based on the structured script and the sequence of video frames, an audio track comprising one or more of ambient sounds, sound effects, or music, the generated audio track being temporally synchronized with the sequence of video frames; and
combining the sequence of video frames with the audio track to generate a synchronized video output representing the desired video.

### Claim 2 (depends on 1)

The method of claim 1, wherein generating the structured script comprises generating a multi-scene screenplay comprising scene-by-scene breakdowns of one or more of characters, environments, or actions.

### Claim 3 (depends on 1)

The method of claim 1, wherein the sequence of video frames is generated via a video foundation model trained jointly on text-to-image and text-to-video tasks.

### Claim 4 (depends on 1)

The method of claim 1, wherein generating the sequence of video frames comprises encoding temporal dynamics including object motion, camera motion, and/or subject-object interactions.

### Claim 5 (depends on 1)

The method of claim 1, wherein the audio track is generated via an audio generative model conditioned on both textual and visual input to align generated sound events with corresponding visual events.

### Claim 6 (depends on 1)

The method of claim 1, wherein combining the sequence of video frames with the audio track comprises synchronizing onset times of sound effects with detected actions in the video frames.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
editing the structured script in response to a second user prompt prior to generating the sequence of video frames.

### Claim 8 (depends on 1)

The method of claim 1, wherein the desired video is generated at a base resolution, and the method further comprises:
applying a spatial upsampler to the video to generate a high-definition video output.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the first generative model comprises a large language model trained on screenplay data; and
the first generative model is configured to output the structured script in a machine-readable format comprising one or more of scene headers, action descriptions, dialogue lines, or camera directives.

### Claim 10

An apparatus to generate a video, comprising:
one or more processors; and
one or more memories coupled with the one or more processors and storing instructions that, when executed by the one or more processors, cause the apparatus to:
receive a user input comprising a description of a desired video;
generate, based on the user input prompt, a structured script comprising one or more of scene descriptions, dialogue, or explicit shot-level information;
generate, based on the structured script, a sequence of video frames representing one or more scenes;
generate, based on the structured script and the sequence of video frames, an audio track comprising one or more of ambient sounds, sound effects, or music, the generated audio track being temporally synchronized with the sequence of video frames; and
combine the sequence of video frames with the audio track to generate a synchronized video output representing the desired video.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein when the one or more processors further execute the instructions, the apparatus is configured to:
generate the structured script by generating a multi-scene screenplay comprising scene-by-scene breakdowns of one or more of characters, environments, or actions.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the sequence of video frames is generated via a video foundation model trained jointly on text-to-image and text-to-video tasks.

### Claim 13 (depends on 10)

The apparatus of claim 10, wherein when the one or more processors further execute the instructions, the apparatus is further configured to:
generate the sequence of video frames further causes the apparatus to encode temporal dynamics including object motion, camera motion, and/or subject-object interactions.

### Claim 14 (depends on 10)

The apparatus of claim 10, wherein the audio track is generated via an audio generative model conditioned on both textual and visual input to align generated sound events with corresponding visual events.

### Claim 15 (depends on 10)

The apparatus of claim 10, wherein when the one or more processors further execute the instructions, the apparatus is further configured to:
combine the sequence of video frames with the audio track; and
synchronize onset times of sound effects with detected actions in the video frames.

### Claim 16 (depends on 10)

The apparatus of claim 10, wherein when the one or more processors further execute the instructions, the apparatus is configured to:
edit the structured script in response to a second user prompt prior to the generate the sequence of video frames.

### Claim 17 (depends on 10)

The apparatus of claim 10, wherein the desired video is generated at a base resolution, and wherein when the one or more processors further execute the instructions, the apparatus is configured to:
apply a spatial upsampler to the video to generate a high-definition video output.

### Claim 18 (depends on 10)

The apparatus of claim 10, wherein:
the first generative model comprises a large language model trained on screenplay data; and
the first generative model is configured to output the structured script in a machine-readable format comprising one or more of scene headers, action descriptions, dialogue lines, or camera directives.

### Claim 19

A non-transitory computer-readable medium storing instructions that, when executed, cause:
receiving a user input comprising a description of a desired video;
generating, based on the user input prompt, a structured script comprising one or more of scene descriptions, dialogue, or explicit shot-level information;
generating, based on the structured script, a sequence of video frames representing one or more scenes;
generating, based on the structured script and the sequence of video frames, an audio track comprising one or more of ambient sounds, sound effects, or music, the generated audio track being temporally synchronized with the sequence of video frames; and
combining the sequence of video frames with the audio track to generate a synchronized video output representing the desired video.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein the instructions, when executed, further cause:
generating the structured script to generate a multi-scene screenplay comprising scene-by-scene breakdowns of one or more of characters, environments, or actions.
