# US 2026/0065560 A1 · Digitization for ai filmmaking in collaborative networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065560 A1
- Document ID: US20260065560A1
- Status: Published application
- Kind: A1
- Application number: 18/961,455
- Filed: 2024-11-27
- Published: 2026-03-05
- Earliest claimed: 2024-09-03
- Assignees: Tcl Research America Inc.
- Applicants: TCL Research America Inc.
- Inventors: Haohong Wang
- Web page: https://patentgrep.com/patent/US20260065560A1

## CPC

- G06T 13/20: Three-dimensional [3D] animation
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 13/00: Animation
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2211/441: AI-based methods, deep learning or artificial neural networks
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

This disclosure provides an AI filmmaking workflow including AI-assisted storyboarding, AI animation, and post-production processes for creating films. The workflow provides techniques for reconstructing 3D digital environments and characters, and for virtual camera control. The workflow also provides techniques for capturing 2D live-action performances and extracting visual cues. The AI animation process generates synthetic images and video using prompts that are based on virtual camera control in case of 3D digitization and/or visual cues in case of 2D camera capturing. Further, the workflow provides techniques for compositing with AI assistance, to generate a composited video based on the AI-animated video and inputs resulting from 3D digitization and/or 2D video processing. Advanced post-processing techniques are also provided for generating a complete film based on the composited video. This framework is designed to facilitate creative collaborative networks by using a hybrid digitization approach to enhance consistency, directability, and scalability in AI filmmaking.

## Claims

### Claim 1

A computer-implemented system for artificial intelligence (AI) assisted filmmaking, the System comprising:
an AI-assisted storyboarding module configured to generate one or more images of a storyboard, one or more prompts associated with the storyboard, and a guide based on a script;
a 3D digitization module configured to generate a 3D model for a scene based on the script and the guide;
a virtual camera controller configured to generate a prompt associated with the 3D model for the scene for controlling virtual camera settings;
an AI animation module configured to generate a first video based on the one or more images of the storyboard and the one or more prompts associated with the storyboard, as well as the prompt associated with the 3D model for the scene for controlling the virtual camera settings; and
an AI-assisted compositing module configured to generate a composited video based on the first video generated by the AI animation module and a low-rank adaptation (LoRA) model.

### Claim 2 (depends on 1)

The system of claim 1, wherein the 3D digitization module is further configured to generate the LoRA model based on the script and the guide,
wherein the 3D model for the scene represents a digitized 3D environment and the LoRA model represents a digitized character.

### Claim 3 (depends on 1)

The system of claim 1, further comprising:
a 2D camera capturing module configured to generate a second video based on the script and the guide; and
a visual cue extraction module configured to generate a prompt associated with the second video.

### Claim 4 (depends on 3)

The system of claim 3, wherein the AI animation module is configured to generate the first video based on the one or more images of the storyboard and the one or more prompts associated with the storyboard, as well as the prompt associated with the second video.

### Claim 5 (depends on 4)

The system of claim 4, wherein the visual cue extraction module is further configured to generate one or more visual cues based on the second video, the system further comprising:
a video processing module configured to generate a third video based on the second video and the one or more visual cues.

### Claim 6 (depends on 5)

The system of claim 5, wherein the AI-assisted compositing module is further configured to generate the composited video based on the first video generated by the AI animation module and the third video generated by the video processing module.

### Claim 7 (depends on 1)

The system of claim 1, wherein the AI-assisted compositing module is further configured to add visual effects, sound effects, or a combination thereof in the composited video.

### Claim 8 (depends on 1)

The system of claim 1, further comprising:
a post-production module configured to generate and output a complete film based on the composited video generated by the AI-assisted compositing module.

### Claim 9 (depends on 8)

The system of claim 8, wherein the post-production module is configured to perform one or more post-processing operations with respect to the composited video generated by the AI-assisted compositing module to generate the complete film.

### Claim 10

A computer-implemented method for artificial intelligence (AI) assisted filmmaking, the method comprising:
generating, via an AI-assisted storyboarding module, one or more images of a storyboard, one or more prompts associated with the storyboard, and a guide based on a script;
generating, via a 3D digitization module, a 3D model for a scene based on the script and the guide;
generating, via a virtual camera controller, a prompt associated with the 3D model for the scene for controlling virtual camera settings;
generating, via an AI animation module, a first video based on the one or more images of the storyboard and the one or more prompts associated with the storyboard, as well as the prompt associated with the 3D model for the scene for controlling the virtual camera settings; and
generating, via an AI-assisted compositing module, a composited video based on the first video and a low-rank adaptation (LoRA) model.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
generating, via the 3D digitization module, the LoRA model based on the script and the guide,
wherein the 3D model for the scene represents a digitized 3D environment and the LoRA model represents a digitized character.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
generating, via a 2D camera capturing module, a second video based on the script and the guide; and
generating, via a visual cue extraction module, a prompt associated with the second video.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
generating, via the AI animation module, the first video based on the one or more images of the storyboard and the one or more prompts associated with the storyboard, as well as the prompt associated with the second video.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
generating, via the visual cue extraction module, one or more visual cues based on the second video; and
generating, via a video processing module, a third video based on the second video and the one or more visual cues.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
generating, via the AI-assisted compositing module, the composited video based on the first video and the third video.

### Claim 16 (depends on 10)

The method of claim 10, further comprising:
adding, via the AI-assisted compositing module, visual effects, sound effects, or a combination thereof in the composited video.

### Claim 17 (depends on 10)

The method of claim 10, further comprising:
generating, via a post-production module, a complete film based on the composited video; and
outputting the complete film for review.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
performing, via the post-production module, one or more post-processing operations with respect to the composited video to generate the complete film.
