# US 2021/0243507 A1 · Cinematic mastering for virtual reality and augmented reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243507 A1
- Document ID: US20210243507A1
- Status: Published application
- Kind: A1
- Application number: 17/176,936
- Filed: 2021-02-16
- Published: 2021-08-05
- Earliest claimed: 2015-10-09
- Assignees: Warner Bros. Entertainment Inc.
- Applicants: Warner Bros. Entertainment Inc.
- Inventors: Christopher DeFaria; Gregory I. Gewickey; Michael Smith; Lewis S. Ostrover
- Web page: https://patentgrep.com/patent/US20210243507A1

## CPC

- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 21/214: Specialised server platform, e.g. server located in an airplane, hotel, hospital {(arrangements specially adapted for local area broadcast systems H04H20/61)}
- H04N 21/2143: {located in a single building, e.g. hotel, hospital or museum (arrangements specially adapted for plural spots in a confined site in broadcast systems H04H20/63; adaptations for transmission by electric cable for domestic distribution in television systems H04N7/106)}
- H04N 21/2225: Local VOD servers
- H04N 21/422: Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)}
- H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)}
- H04N 21/43074: {of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme}
- H04N 21/4334: {Recording operations (recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27)}
- H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)}
- H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics}
- H04N 21/8186: {specially adapted to be executed by a peripheral of the client device, e.g. by a reprogrammable remote control}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An entertainment system provides data to a common screen (e.g., cinema screen) and personal immersive reality devices. For example, a cinematic data distribution server communicates with multiple immersive output devices each configured for providing immersive output (e.g., a virtual reality output) based on a data signal. Each of the multiple immersive output devices is present within eyesight of a common display screen. The server configures the data signal based on digital cinematic master data that includes immersive reality data. The server transmits the data signal to the multiple immersive output devices contemporaneously with each other, and optionally contemporaneously with providing a coordinated audio-video signal for output via the common display screen and shared audio system.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method comprising:
configuring, by at least one processor in response to user input, digital cinematic master data that includes at least one of augmented reality (AR) data or virtual reality (VR) data for providing one of an AR output or a VR output comprising a cinematic presentation contemporaneously with output for display on a 2D screen; wherein the digital cinematic master data enables locating off-screen objects coordinated with a cinematic presentation on a display screen shared by multiple viewers, so that one of the off-screen objects appears in subjective viewpoints each relative to a different one of the multiple immersive output devices and another of the off-screen objects appears in an objective viewpoint relative to the shared display screen; and
recording, by the at least one processor, the digital cinematic master data in a non-transitory computer-readable medium.

### Claim 22 (depends on 21)

The method of claim 21, wherein the configuring comprises preparing the AR data for augmenting video data configured for projection or output on the 2D display screen arranged for viewing by multiple individuals.

### Claim 23 (depends on 22)

The method of claim 22, wherein the configuring comprises preparing the AR data for continuously extending images on the display screen to areas beyond an outer limit of the display screen.

### Claim 24 (depends on 21)

The method of claim 21, wherein the configuring comprises preparing the AR data for causing images that do not appear on the display screen to appear as if located in or around a non-screen display volume to any one of the multiple individuals wearing an AR output device.

### Claim 25 (depends on 24)

The method of claim 24, wherein the configuring comprises preparing the AR data so that at least one of the images appears in a coordinate system defined relative to each of the multiple individuals wearing an AR output device.

### Claim 26 (depends on 24)

The method of claim 24, wherein the configuring comprises preparing the AR data so that at least one of the images appears in a coordinate system defined relative to the display screen.

### Claim 27 (depends on 24)

The method of claim 24, further comprising including in the AR data code for enabling a user to interact with at least one of the images, causing the AR output to change in response to user input.

### Claim 28 (depends on 27)

The method of claim 27, further comprising configuring the code so that a user's interaction with at least one of the images causes the video output shown on the display screen to change.

### Claim 29 (depends on 27)

The method of claim 27, further comprising configuring the code so that a user's interaction with at least one of the images causes an electronic record of a license right to digital content to be provided to a user account data store associated with the user.

### Claim 30 (depends on 29)

The method of claim 29, where the data store comprises a computer memory in an AR output device worn by the user.

### Claim 31 (depends on 22)

The method of claim 22, further comprising including in the AR data code for managing a transition between AR output produced from the AR data by an AR output device and video output shown on the display screen, based at least in part on a geometry of the display screen and a relative position of a user wearing the AR output device.

### Claim 32 (depends on 21)

The method of claim 21, wherein the configuring comprises preparing the VR data for augmenting video data configured for projection or output on a display screen arranged for viewing by multiple individuals.

### Claim 33 (depends on 32)

The method of claim 32, wherein the video data and the VR data are configured to play at different, non-overlapping times, such that ones of the multiple individuals wearing a VR output device view content on the display screen and on a VR output device at different times.

### Claim 34 (depends on 32)

The method of claim 32, wherein the video data and the VR data are configured to play contemporaneously.

### Claim 35 (depends on 21)

The method of claim 21, wherein the video data comprises one of two-dimensional non-stereoscopic or stereoscopic frame data.

### Claim 36 (depends on 21)

The method of claim 21, further comprising including haptic control data in the digital cinematic master data, where the haptic control data activates a haptic device in coordination with the at least one of AR data or VR data.

### Claim 37

An apparatus for configuring digital cinematic master data for virtual reality (VR) or augmented reality (AR) output, comprising:
a processor, a memory coupled to the processor, and user interface device coupled to the processor, wherein the memory holds instructions that when executed by the processor, cause the apparatus to perform:
configuring, by at least one processor in response to user input, digital cinematic master data that includes at least one of augmented reality (AR) data or virtual reality (VR) data for providing one of an AR output or a VR output comprising a cinematic presentation contemporaneously with output for display on a 2D screen; wherein the digital cinematic master data enables locating off-screen objects coordinated with a cinematic presentation on a display screen shared by multiple viewers, so that one of the off-screen objects appears in subjective viewpoints each relative to a different one of the multiple immersive output devices and another of the off-screen objects appears in an objective viewpoint relative to the shared display screen; and
recording, by the at least one processor, the digital cinematic master data in a non-transitory computer-readable medium.

### Claim 38 (depends on 37)

The apparatus of claim 37, wherein the memory holds further instructions for configuring the video data and the VR data to play at different, non-overlapping times, such that ones of the multiple individuals wearing a VR output device view content on the display screen and on a VR output device at different times.

### Claim 39 (depends on 37)

The apparatus of claim 37, wherein the memory holds further instructions for configuring the video data and the VR data to play contemporaneously.

### Claim 40 (depends on 37)

The apparatus of claim 37, wherein the memory holds further instructions for configuring the video data as one of two-dimensional non-stereoscopic or stereoscopic frame data.
