# US 2024/0193823 A1 · Systems and methods for creating a 2d film from immersive content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0193823 A1
- Document ID: US20240193823A1
- Status: Published application
- Kind: A1
- Application number: 18/584,906
- Filed: 2024-02-22
- Published: 2024-06-13
- Earliest claimed: 2019-10-24
- Assignees: Baobab Studios Inc.
- Applicants: Baobab Studios Inc.
- Inventors: Mikhail Stanislavovich Solovykh; Wei Wang; Nathaniel Christopher Dirksen; Lawrence David Cutler; Apostolos Lerios
- Web page: https://patentgrep.com/patent/US20240193823A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06T 13/20: Three-dimensional [3D] animation
- G06T 3/067: Reshaping or unfolding three-dimensional [3D] tree structures onto two-dimensional [2D] planes
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 5/2224: {related to virtual studio applications}
- H04N 21/234336: {by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text}
- H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics}
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 21/854: Content authoring
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2213/08: Animation software package
- G11B 27/02: Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, methods, and non-transitory computer-readable media can obtain data associated with a computer-based experience. The computer-based experience can be based on interactive real-time technology. At least one virtual camera can be configured within the computer-based experience in a real-time engine. Data associated with an edit cut of the computer-based experience can be obtained based on content captured by the at least one virtual camera. A plurality of shots that correspond to two-dimensional content can be generated from the edit cut of the computer-based experience in the real-time engine. Data associated with a two-dimensional version of the computer-based experience can be generated with the real-time engine based on the plurality of shots. The two-dimensional version can be rendered based on the generated data.

## Claims

### Claim 1

A computer-implemented method comprising:
generating, by a computing system, a set of shots for non-interactive content of a computer-based experience based on a content path associated with an interactive version of the computer-based experience;
providing, by the computing system, a set of options for modification of the set of shots; and
generating, by the computing system, rendered frames for the non-interactive content of the computer-based experience based on the set of shots modified based on the set of options.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the set of options for modification includes at least one of an option for lights, an option for shadows, an option for contact shadows, an option for FX elements, an option for post-processing effects, an option for set dressing, an option for layouts, an option for animation fixes, an option for camera adjustments, an option for background matte painting adjustments, an option for on-screen two dimensional graphics and overlay adjustments, an option for arbitrary output variables (AOVs), an option for render parameters adjustments, an option for object and character modeling an surfacing adjustments, and an option for matte passes and layer adjustments.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising:
providing, by the computing system, a set of timelines associated with the set of options for modification, wherein a first timeline corresponds with a first option for modification; and
providing, by the computing system, a representation of a modification to the set of shots based on the first option for modification in the first timeline.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
importing, by the computing system, the set of shots into a real-time engine; and
applying, by the computing system, a modification to the set of shots in the real-time engine based on the set of options for modification.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
providing, by the computing system, a list associated with the set of shots;
determining, by the computing system, a shot from the set of shots based on a selection from the list; and
providing, by the computing system, access to objects included in the shot for modification based on the set of options for modification.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
splitting, by the computing system, a shot of the set of shots into a set of overlapping shots, wherein the set of overlapping shots are used for the non-interactive content and not used for the interactive version of the computer-based experience.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein modifications to the set of shots are made additively based on a data layer overlaid on the set of shots.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, further comprising:
identifying, by the computing system, regions for render based on a timeline associated with the set of shots, wherein the rendered frames are generated based on the regions for render.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein generating the rendered frames comprises:
generating, by the computing system, render layer passes for a compositor.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the rendered frames are generated based on at least one of an animation creation tool, a real-time engine, a game engine, an offline renderer, and a compositor.

### Claim 11

A system comprising:
at least one processor; and
a memory storing instructions that, when executed, cause the system to perform operations comprising:
generating a set of shots for non-interactive content of a computer-based experience based on a content path associated with an interactive version of the computer-based experience;
providing a set of options for modification of the set of shots; and
generating rendered frames for the non-interactive content of the computer-based experience based on the set of shots modified based on the set of options.

### Claim 12 (depends on 11)

The system of claim 11, wherein the set of options for modification includes at least one of an option for lights, an option for shadows, an option for contact shadows, an option for FX elements, an option for post-processing effects, an option for set dressing, an option for layouts, an option for animation fixes, an option for camera adjustments, an option for background matte painting adjustments, an option for on-screen two dimensional graphics and overlay adjustments, an option for arbitrary output variables (AOVs), an option for render parameters adjustments, an option for object and character modeling an surfacing adjustments, and an option for matte passes and layer adjustments.

### Claim 13 (depends on 11)

The system of claim 11, the operations further comprising:
providing a set of timelines associated with the set of options for modification, wherein a first timeline corresponds with a first option for modification; and
providing a representation of a modification to the set of shots based on the first option for modification in the first timeline.

### Claim 14 (depends on 11)

The system of claim 11, the operations further comprising:
importing the set of shots into a real-time engine; and
applying a modification to the set of shots in the real-time engine based on the set of options for modification.

### Claim 15 (depends on 11)

The system of claim 11, the operations further comprising:
providing a list associated with the set of shots;
determining a shot from the set of shots based on a selection from the list; and
providing access to objects included in the shot for modification based on set of options for modification.

### Claim 16

A non-transitory computer-readable storage medium including instructions that, when executed, cause a computing system to perform operations comprising:
generating a set of shots for non-interactive content of a computer-based experience based on a content path associated with an interactive version of the computer-based experience;
providing a set of options for modification of the set of shots; and
generating rendered frames for the non-interactive content of the computer-based experience based on the set of shots modified based on the set of options.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the set of options for modification includes at least one of an option for lights, an option for shadows, an option for contact shadows, an option for FX elements, an option for post-processing effects, an option for set dressing, an option for layouts, an option for animation fixes, an option for camera adjustments, an option for background matte painting adjustments, an option for on-screen two dimensional graphics and overlay adjustments, an option for arbitrary output variables (AOVs), an option for render parameters adjustments, an option for object and character modeling an surfacing adjustments, and an option for matte passes and layer adjustments.

### Claim 18 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, the operations further comprising:
providing a set of timelines associated with the set of options for modification, wherein a first timeline corresponds with a first option for modification; and
providing a representation of a modification to the set of shots based on the first option for modification in the first timeline.

### Claim 19 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, the operations further comprising:
importing the set of shots into a real-time engine; and
applying a modification to the set of shots in the real-time engine based on the set of options for modification.

### Claim 20 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, the operations further comprising:
providing a list associated with the set of shots;
determining a shot from the set of shots based on a selection from the list; and providing access to objects included in the shot for modification based on set of options for modification.
