# US 2026/0100203 A1 · Systems and methods for automated movie generation and editing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2026/0100203 A1 - Document ID: US20260100203A1 - Status: Published application - Kind: A1 - Application number: 19/348,769 - Filed: 2025-10-02 - Published: 2026-04-09 - Earliest claimed: 2024-10-03 - Assignees: Meta Platforms, Inc. - Applicants: Meta Platforms, Inc. - Inventors: Zecheng He; Samaneh Azadi; Bowen Shi; Apoorv Vyas; Ann Lee; Ishan Satish Misra; Peizhao Zhang; Roshan Rajesh Sumbaly; Yaniv Nechemia Taigman; Peter Vajda; Yi-Chiao Wu; Andros Tjandra; Wei-Ning Hsu; Amit Zohar; Animesh Sinha; Yuval Kirstain; Shelly Sheynin; Adam Polyak; Matthew Le; Juefei Xu; Haoyu Ma; Tingbo Hou - Web page: https://patentgrep.com/patent/US20260100203A1 ## CPC - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G06T 11/60: Creating or editing images; Combining images with text - G06T 13/40: of characters, e.g. humans, animals or virtual beings - G06V 10/82: using neural networks - G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - H04N 21/43072: {of multiple content streams on the same device} - H04N 21/8113: {comprising music, e.g. song in MP3 format} - H04N 21/816: {involving special video data, e.g 3D video} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method to edit a video includes receiving an input video including a sequence of frames and receiving an editing instruction expressed in natural language. The method also includes generating a multimodal condition based on the textual editing instruction and the input video. The multimodal condition may include an embedding of the input video concatenated with an embedding of the textual editing instruction. The method also includes applying, via a video editing model, the multimodal condition to modify visual content of the input video. The method further includes generating an edited video including visual modifications corresponding to the textual editing instruction. The edited video preserves temporal coherence and overall visual fidelity of the input video. ## Claims ### Claim 1 A method to edit a video, the method comprising: receiving an input video comprising a sequence of frames; receiving an editing instruction expressed in natural language; generating a multimodal condition based on the textual editing instruction and the input video, the multimodal condition comprising an embedding of the input video concatenated with an embedding of the textual editing instruction; applying, via a video editing model, the multimodal condition to modify visual content of the input video; and generating an edited video comprising visual modifications corresponding to the textual editing instruction, the edited video preserving temporal coherence and overall visual fidelity of the input video. ### Claim 2 (depends on 1) The method of claim 1, wherein generating the multimodal condition comprises applying cross-attention between the embedding of the input video and the embedding of the textual editing instruction. ### Claim 3 (depends on 1) The method of claim 1, further comprising: generating the embedding of the input video based on encoding the sequence of frames via a temporal autoencoder. ### Claim 4 (depends on 1) The method of claim 1, further comprising: generating the embedding of the textual editing instruction based on encoding the instruction with a transformer-based language model. ### Claim 5 (depends on 1) The method of claim 1, wherein the video editing model is conditioned on a task embedding corresponding to a type of editing operation comprising one or more of object addition, object removal, background replacement, or attribute modification. ### Claim 6 (depends on 1) The method of claim 1, wherein generating the edited video further comprises animating newly generated content such that spatial and temporal consistency across multiple frames is preserved. ### Claim 7 (depends on 1) The method of claim 1, wherein preserving temporal coherence comprises aligning positional embeddings of the sequence of frames such that edits applied to a first frame are propagated to subsequent frames. ### Claim 8 (depends on 1) The method of claim 1, wherein the visual fidelity is preserved by applying a filtering stage configured to discard edited outputs that are leased than a predetermined quality threshold determined by automated image editing metrics. ### Claim 9 An apparatus to edit a video, comprising: one or more processors; and one or more memories coupled with the one or more processors and storing processor-executable code that, when executed by the one or more processors, is configured to cause the apparatus to: receive an input video comprising a sequence of frames; receive an editing instruction expressed in natural language; generate a multimodal condition based on the textual editing instruction and the input video, the multimodal condition comprising an embedding of the input video concatenated with an embedding of the textual editing instruction; apply, via a video editing model, the multimodal condition to modify visual content of the input video; and generate an edited video comprising visual modifications corresponding to the textual editing instruction, the edited video preserving temporal coherence and overall visual fidelity of the input video. ### Claim 10 (depends on 9) The apparatus of claim 9, wherein execution of the processor-executable code that causes the apparatus to generate the multimodal condition further causes the apparatus to apply cross-attention between the embedding of the input video and the embedding of the textual editing instruction. ### Claim 11 (depends on 9) The apparatus of claim 9, wherein execution of the processor-executable code further causes the apparatus to generate the embedding of the input video based on encoding the sequence of frames via a temporal autoencoder. ### Claim 12 (depends on 9) The apparatus of claim 9, wherein execution of the processor-executable code further causes the apparatus to generate the embedding of the textual editing instruction based on encoding the instruction with a transformer-based language model. ### Claim 13 (depends on 9) The apparatus of claim 9, wherein the video editing model is conditioned on a task embedding corresponding to a type of editing operation comprising one or more of object addition, object removal, background replacement, or attribute modification. ### Claim 14 (depends on 9) The apparatus of claim 9, wherein execution of the processor-executable code further that causes the apparatus to generate the edited video further causes the apparatus to animate newly generated content such that spatial and temporal consistency across multiple frames is preserved. ### Claim 15 (depends on 9) The apparatus of claim 9, wherein preserving temporal coherence comprises aligning positional embeddings of the sequence of frames such that edits applied to a first frame are propagated to subsequent frames. ### Claim 16 (depends on 9) The apparatus of claim 9, wherein the visual fidelity is preserved by applying a filtering stage configured to discard edited outputs that are leased than a predetermined quality threshold determined by automated image editing metrics. ### Claim 17 A non-transitory computer-readable medium having program code recorded thereon for editing a video, the program code executed by one or more processors and comprising: program code to receive an input video comprising a sequence of frames; program code to receive an editing instruction expressed in natural language; program code to generate a multimodal condition based on the textual editing instruction and the input video, the multimodal condition comprising an embedding of the input video concatenated with an embedding of the textual editing instruction; program code to apply, via a video editing model, the multimodal condition to modify visual content of the input video; and generate an edited video comprising visual modifications corresponding to the textual editing instruction, the edited video preserving temporal coherence and overall visual fidelity of the input video. ### Claim 18 (depends on 17) The non-transitory computer-readable medium of claim 17, wherein the program code to generate the multimodal condition further comprises program code to apply cross-attention between the embedding of the input video and the embedding of the textual editing instruction. ### Claim 19 (depends on 17) The non-transitory computer-readable medium of claim 17, wherein the program code further comprises program code to generate the embedding of the input video based on encoding the sequence of frames via a temporal autoencoder. ### Claim 20 (depends on 17) The non-transitory computer-readable medium of claim 17, wherein the program code further comprises program code to generate the embedding of the textual editing instruction based on encoding the instruction with a transformer-based language model.