# US 12,003,790 B2 · Rendering a modeled scene

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,003,790 B2
- Document ID: US12003790B2
- Status: Granted
- Kind: B2
- Application number: 17/840,465
- Filed: 2022-06-14
- Published: 2022-09-29
- Granted: 2024-06-04
- Earliest claimed: 2012-10-31
- Assignees: Outward, Inc.
- Applicants: Outward, Inc.
- Inventors: Clarence Chui
- Web page: https://patentgrep.com/patent/US12003790B2

## CPC

- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Techniques for rendering a scene are disclosed. In some embodiments, a scene definition is modified to generate a modified scene definition based at least in part on a current state of a local database at a device. The modified scene definition is constrained to include references to objects locally available in the local database, and at least one object referenced in the scene definition is substituted with a different object in the modified scene definition that is locally available in the local database. The scene is rendered at the device according to the modified scene definition.

## Claims

### Claim 1

A method for rendering a scene, comprising:
receiving a scene definition representing requested source content, wherein the scene definition comprises object references but not object definitions;
modifying the received scene definition representing requested source content to generate a modified scene definition based at least in part on a current state of a local database at a device and customization based on profiling of a user of the device, wherein the modified scene definition is constrained to include references to objects locally available in the local database and whose definitions are received at the device separately from the scene definition and wherein at least one object referenced in the scene definition is substituted with a different object in the modified scene definition that is locally available in the local database; and
rendering the scene at the device from object definitions of objects referenced in the modified scene definition that are available at the device, wherein the rendered scene represents the requested source content at the device but is rendered differently than an intended version of the requested source content based on object definitions locally available in the local database.

### Claim 2 (depends on 1)

The method of claim 1, wherein the scene definition is modified and rendered differently at different devices based on different customizations from profiling users of the devices.

### Claim 3 (depends on 1)

The method of claim 1, wherein the modified scene definition is at least in part personalized to the user of the device.

### Claim 4 (depends on 1)

The method of claim 1, wherein the scene definition is modified and rendered differently at different devices based on object definitions available at their respective local databases.

### Claim 5 (depends on 1)

The method of claim 1, wherein the scene definition and object definitions populating the local database are separately received at the device via different communication channels.

### Claim 6 (depends on 1)

The method of claim 1, wherein the scene definition is received at the device via a relatively low bandwidth communication channel and wherein object definitions populating the local database are received at the device via a relatively high bandwidth communication channel.

### Claim 7 (depends on 1)

The method of claim 1, wherein object definitions populating the local database are asynchronously received at the device at a different time than when the scene definition is received at the device.

### Claim 8 (depends on 1)

The method of claim 1, wherein the scene definition or the modified scene definition comprises a script with instructions for rendering.

### Claim 9 (depends on 1)

The method of claim 1, wherein the scene definition or the modified scene definition comprises a list of objects and associated parameters.

### Claim 10 (depends on 1)

The method of claim 1, wherein the scene definition or the modified scene definition comprises specifications of one or more of: object locations or coordinates, object orientations, object motions or animations, scene lighting, camera poses and setting, and audio data.

### Claim 11 (depends on 1)

The method of claim 1, wherein object definitions populating the local database facilitate generating local renderings at the device.

### Claim 12 (depends on 1)

The method of claim 1, wherein object definitions populating the local database are used to render a plurality of different, independent scenes.

### Claim 13 (depends on 1)

The method of claim 1, wherein the local database comprises at least a subset of a global database.

### Claim 14 (depends on 1)

The method of claim 1, wherein the local database is synced with respect to a master database.

### Claim 15 (depends on 1)

The method of claim 1, wherein the local database is continuously updated or updated at prescribed times.

### Claim 16 (depends on 1)

The method of claim 1, wherein the scene is rendered at the device in a user selectable quality or in a highest quality supported by the device.

### Claim 17 (depends on 1)

The method of claim 1, wherein the scene is rendered at the device in photoreal visual quality.

### Claim 18 (depends on 1)

The method of claim 1, wherein the received scene definition does not include original pixel information of the requested source content.

### Claim 19

A system for rendering a scene, comprising:
a processor configured to:
receive a scene definition representing requested source content, wherein the scene definition comprises object references but not object definitions;
modify the received scene definition representing requested source content to generate a modified scene definition based at least in part on a current state of a local database at a device and customization based on profiling of a user of the device, wherein the modified scene definition is constrained to include references to objects locally available in the local database and whose definitions are received at the device separately from the scene definition and wherein at least one object referenced in the scene definition is substituted with a different object in the modified scene definition that is locally available in the local database; and
render the scene at the device from object definitions of objects referenced in the modified scene definition that are available at the device, wherein the rendered scene represents the requested source content at the device but is rendered differently than an intended version of the requested source content based on object definitions locally available in the local database; and
a memory coupled to the processor and configured to provide the processor with instructions.

### Claim 20 (depends on 19)

The system of claim 19, wherein the scene definition is modified and rendered differently at different devices based on different customizations from profiling users of the devices.

### Claim 21 (depends on 19)

The system of claim 19, wherein the modified scene definition is at least in part personalized to the user of the device.

### Claim 22 (depends on 19)

The system of claim 19, wherein the scene definition is modified and rendered differently at different devices based on object definitions available at their respective local databases.

### Claim 23 (depends on 19)

The system of claim 19, wherein the scene definition and object definitions populating the local database are separately received at the device via different communication channels.

### Claim 24 (depends on 19)

The system of claim 19, wherein the scene definition is received at the device via a relatively low bandwidth communication channel and wherein object definitions populating the local database are received at the device via a relatively high bandwidth communication channel.

### Claim 25 (depends on 19)

The system of claim 19, wherein object definitions populating the local database are asynchronously received at the device at a different time than when the scene definition is received at the device.

### Claim 26 (depends on 19)

The system of claim 19, wherein the scene definition or the modified scene definition comprises a script with instructions for rendering.

### Claim 27 (depends on 19)

The system of claim 19, wherein the scene definition or the modified scene definition comprises a list of objects and associated parameters.

### Claim 28 (depends on 19)

The system of claim 19, wherein the scene definition or the modified scene definition comprises specifications of one or more of: object locations or coordinates, object orientations, object motions or animations, scene lighting, camera poses and setting, and audio data.

### Claim 29 (depends on 19)

The system of claim 19, wherein object definitions populating the local database facilitate generating local renderings at the device.

### Claim 30 (depends on 19)

The system of claim 19, wherein object definitions populating the local database are used to render a plurality of different, independent scenes.

### Claim 31 (depends on 19)

The system of claim 19, wherein the local database comprises at least a subset of a global database.

### Claim 32 (depends on 19)

The system of claim 19, wherein the local database is synced with respect to a master database.

### Claim 33 (depends on 19)

The system of claim 19, wherein the local database is continuously updated or updated at prescribed times.

### Claim 34 (depends on 19)

The system of claim 19, wherein the scene is rendered at the device in a user selectable quality or in a highest quality supported by the device.

### Claim 35 (depends on 19)

The system of claim 19, wherein the scene is rendered at the device in photoreal visual quality.

### Claim 36 (depends on 19)

The system of claim 19, wherein the received scene definition does not include original pixel information of the requested source content.

### Claim 37

A computer program product for rendering a scene embodied in a non-transitory computer usable medium and comprising computer instructions for:
receiving a scene definition representing requested source content, wherein the scene definition comprises object references but not object definitions;
modifying the received scene definition representing requested source content to generate a modified scene definition based at least in part on a current state of a local database at a device and customization based on profiling of a user of the device, wherein the modified scene definition is constrained to include references to objects locally available in the local database and whose definitions are received at the device separately from the scene definition and wherein at least one object referenced in the scene definition is substituted with a different object in the modified scene definition that is locally available in the local database; and
rendering the scene at the device from object definitions of objects referenced in the modified scene definition that are available at the device, wherein the rendered scene represents the requested source content at the device but is rendered differently than an intended version of the requested source content based on object definitions locally available in the local database.

### Claim 38 (depends on 37)

The computer program product of claim 37, wherein the scene definition is modified and rendered differently at different devices based on different customizations from profiling users of the devices.

### Claim 39 (depends on 37)

The computer program product of claim 37, wherein the modified scene definition is at least in part personalized to the user of the device.

### Claim 40 (depends on 37)

The computer program product of claim 37, wherein the scene definition is modified and rendered differently at different devices based on object definitions available at their respective local databases.

### Claim 41 (depends on 37)

The computer program product of claim 37, wherein the scene definition and object definitions populating the local database are separately received at the device via different communication channels.

### Claim 42 (depends on 37)

The computer program product of claim 37, wherein the scene definition is received at the device via a relatively low bandwidth communication channel and wherein object definitions populating the local database are received at the device via a relatively high bandwidth communication channel.

### Claim 43 (depends on 37)

The computer program product of claim 37, wherein object definitions populating the local database are asynchronously received at the device at a different time than when the scene definition is received at the device.

### Claim 44 (depends on 37)

The computer program product of claim 37, wherein the scene definition or the modified scene definition comprises a script with instructions for rendering.

### Claim 45 (depends on 37)

The computer program product of claim 37, wherein the scene definition or the modified scene definition comprises a list of objects and associated parameters.

### Claim 46 (depends on 37)

The computer program product of claim 37, wherein the scene definition or the modified scene definition comprises specifications of one or more of: object locations or coordinates, object orientations, object motions or animations, scene lighting, camera poses and setting, and audio data.

### Claim 47 (depends on 37)

The computer program product of claim 37, wherein object definitions populating the local database facilitate generating local renderings at the device.

### Claim 48 (depends on 37)

The computer program product of claim 37, wherein object definitions populating the local database are used to render a plurality of different, independent scenes.

### Claim 49 (depends on 37)

The computer program product of claim 37, wherein the local database comprises at least a subset of a global database.

### Claim 50 (depends on 37)

The computer program product of claim 37, wherein the local database is synced with respect to a master database.

### Claim 51 (depends on 37)

The computer program product of claim 37, wherein the local database is continuously updated or updated at prescribed times.

### Claim 52 (depends on 37)

The computer program product of claim 37, wherein the scene is rendered at the device in a user selectable quality or in a highest quality supported by the device.

### Claim 53 (depends on 37)

The computer program product of claim 37, wherein the scene is rendered at the device in photoreal visual quality.

### Claim 54 (depends on 37)

The computer program product of claim 37, wherein the received scene definition does not include original pixel information of the requested source content.
