# US 2026/0228990 A1 · Previsualization devices and systems for the film industry

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0228990 A1
- Document ID: US20260228990A1
- Status: Published application
- Kind: A1
- Application number: 19/459,557
- Filed: 2026-01-26
- Published: 2026-08-06
- Earliest claimed: 2020-08-24
- Assignees: Fd IP & Licensing LLC
- Applicants: Fd IP & Licensing LLC
- Inventors: Brandon FAYETTE; Gene REDDICK
- Web page: https://patentgrep.com/patent/US20260228990A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- H04N 5/2224: {related to virtual studio applications}
- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 21/854: Content authoring
- H04N 23/63: by using electronic viewfinders
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure relates to systems that capture a combination of image data and environmental data of the environment. The system uses the environmental data to create a detailed virtual scan of the environment. Computer generated models and images (“assets”) are inserted into the detailed virtual environment from the scan. These assets are scaled and placed within the virtual environment at specific locations and having a specific orientation. The scaled and positioned asset is then composited with the real-time video signal allowing a user to view the asset in real-time on a display.

## Claims

### Claim at position 1

1-12. (canceled)

### Claim 13

A previsualization system for film production comprising:
a first digital previsualization device comprising a first environmental sensor, a first image sensor, a first display, and a first processor, the first digital previsualization device configured to scan a real environment and display a first state of a computer-generated imagery (CGI) asset within the real environment; and
a second digital previsualization device comprising a second display, and a second processor, the second digital previsualization device configured to display a second state of the CGI asset within the real environment,
wherein the first digital previsualization device provides environmental data to generate a three-dimensional model of the real environment, and the first state and the second state of the CGI asset are different visual representations of the CGI asset.

### Claim 14 (depends on 13)

The previsualization system of claim 13, wherein the first state of the CGI asset is an intact version of a building and the second state of the CGI asset is a destroyed version of the building.

### Claim 15 (depends on 13)

The previsualization system of claim 13, further comprising a server configured to store the three-dimensional model of the real environment and provide access to the three-dimensional model to both the first digital previsualization device and the second digital previsualization device.

### Claim 16 (depends on 15)

The previsualization system of claim 15, wherein the first digital previsualization device is configured for use by a first crew member for location scouting of a first scene and the second digital previsualization device is configured for use by a second crew member to scan another real environment for location scouting of a second scene using a second environmental sensor and second image sensor.

### Claim 17 (depends on 13)

The previsualization system of claim 13, wherein the second previsualization device includes a second environmental sensor and second image sensor, and the first digital previsualization device and the second digital previsualization device are configured to contemporaneously scan the real environment and provide environmental data for creation of the three-dimensional model.

### Claim 18 (depends on 17)

The previsualization system of claim 17, wherein the first processor and the second processor are configured to track a position and orientation of the first image sensor and the second image sensor respectively based on motion sensor data, and the position and orientation data is used to determine a perspective of each digital previsualization device relative to the three-dimensional model of the real environment.

### Claim 19 (depends on 13)

The previsualization system of claim 13, wherein the first digital previsualization device displays the first state of the CGI asset in a first virtual room based on the three-dimensional model and the second digital previsualization device displays the second state of the CGI asset in a second virtual room based on the three-dimensional model, both virtual rooms corresponding to the same real environment.

### Claim 20

A method for generating a video signal during a previsualization of a scene comprising:
receiving environmental data from a plurality of environmental sensors positioned at different perspectives of a real environment;
generating a three-dimensional model of the real environment based on the environmental data;
creating a first virtual room and a second virtual room, both virtual rooms corresponding to the same real environment and based on the three-dimensional model;
inserting a computer-generated imagery (CGI) asset at a given location within the three-dimensional model, wherein the CGI asset has a first state in the first virtual room and a second state in the second virtual room;
generating a first augmented video signal comprising images of the real environment with the CGI asset in the first state for display in the first virtual room; and
generating a second augmented video signal comprising images of the real environment with the CGI asset in the second state for display in the second virtual room.

### Claim 21 (depends on 20)

The method of claim 20, further comprising providing the first augmented video signal to a first display device and the second augmented video signal to a second display device to allow simultaneous previsualization of different states of the CGI asset within the same real environment.

### Claim 22 (depends on 21)

The method of claim 21, further comprising storing the three-dimensional model of the real environment on a server and providing access to the three-dimensional model to multiple previsualization devices.

### Claim 23 (depends on 22)

The method of claim 22, wherein the first virtual room is used by a first crew member for location scouting of a first scene and the second virtual room is used by a second crew member for location scouting of a second scene.

### Claim 24 (depends on 23)

The method of claim 23, further comprising tracking position and orientation of image sensors associated with the first display device and the second display device based on motion sensor data to determine perspective of each display device relative to the three-dimensional model.

### Claim 25 (depends on 24)

The method of claim 24, wherein the environmental sensors comprise at least one of an infrared system, a light detection and ranging (LIDAR) system, a thermal imaging system, an ultrasound system, a stereoscopic system, and an optical system.

### Claim 26 (depends on 25)

The method of claim 25, wherein the first and second augmented video signal are provided simultaneously.

### Claim 27 (depends on 26)

The method of claim 26, further comprising receiving real-time motion capture data from a motion capture system for simultaneously animating the CGI asset in the first augmented video signal and the second augmented video signal based on the motion capture data.

### Claim 28

A method for generating a video signal during a previsualization of a scene comprising:
receiving, by a video module, a raw video signal comprising one or more images representative of an environment captured by an image sensor;
generating, by an environmental module, a virtual environment model of the environment based on environmental data characterizing the environment and captured by at least one environmental sensor;
inserting, by an asset module, a computer-generated imagery (CGI) asset at a given location in the virtual environment model, wherein the CGI asset has multiple states and different states of the CGI asset are displayable to two or more previsualization devices viewing the same environment; and
generating an augmented video signal comprising the raw video signal with the CGI asset based on the given location of the CGI asset in the virtual environment, wherein the CGI asset is displayed in one of the multiple states.

### Claim 29 (depends on 28)

The method of claim 28, wherein the environmental sensor is a first environmental sensor, the environmental module is configured to receive a first set of environmental data corresponding to the environmental data from a first previsualization device having the first environmental sensor, and a second set of environmental data from a second previsualization device having a second environmental sensor characterizing the environment, wherein each of the first previsualization device and second previsualization device capture the environment at different perspectives.

### Claim 30 (depends on 29)

The method of claim 29, further comprising determining, by a camera tracking module, a position and an orientation of the image sensor with respect to the virtual environment based on motion sensor data provided by a motion sensor, wherein the CGI asset is displayed based on the position and orientation of the image sensor.

### Claim 31 (depends on 30)

The method of claim 30, further comprising receiving, by a puppeteer module, motion capture data characterizing a human motion captured by a motion capture system, the CGI asset being animated in the augmented video signal based on the motion capture data.

### Claim 32 (depends on 31)

The method of claim 31, further comprising modifying a state of the CGI asset in the augmented video signal from a first state to a second state during the previsualization based on user input received through a user interface of one of the previsualization devices.
