# US 2022/0284661 A1 · Methods for transmitting and rendering a 3d scene, method for generating patches, and corresponding devices and computer programs

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284661 A1
- Document ID: US20220284661A1
- Status: Published application
- Kind: A1
- Application number: 17/625,574
- Filed: 2020-07-15
- Published: 2022-09-08
- Earliest claimed: 2019-07-15
- Assignees: InterDigital VC Holdings, Inc.
- Applicants: Interdigital Vc Holdings, Inc.
- Inventors: Yvon Legallais; Charline Taibi; Serge Travert; Charles Salmon-Legagneur
- Web page: https://patentgrep.com/patent/US20220284661A1

## CPC

- G06T 15/20: Perspective computation
- H04N 19/597: specially adapted for multi-view video sequence encoding
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The disclosure discloses methods and devices for transmitting and rendering a 3D scene. The method for transmitting comprises: segmenting a space into m angular sectors, the m angular sectors each corresponding to an angular distance from a viewport, and the space into n depth ranges; obtaining (11) at least one first patch, generated from a first view of the 3D scene, said at least one first patch comprising a texture component and a depth component; obtaining (12) at least one atlas, generated from at least one second view of the 3D scene, said at least one atlas being built by packing together at least one second patch generated for at least one point of one of said second view that is not visible in another view of the 3D scene and that belongs to a same angular sector among the m angular sectors, and a same depth range among the n depth ranges, at least one of morn being greater than or equal to 2, said at least one second patch comprising a texture component and a depth component, wherein each of the at least one first patch and the at least one second

## Claims

### Claim at position 1

1-15. (canceled)

### Claim 16

A method for rendering a 3D scene on a terminal, the method comprising:
receiving, at the terminal, a manifest, wherein the manifest includes:
a reference to at least one first data stream available from a server, the at least one first data stream comprising a central patch content of the 3D scene, the central patch content comprising parts of the scene visible from a central viewpoint;
a reference to a plurality of second data streams available from the server, the plurality of second data streams comprising parallax patch content of the 3D scene, wherein the parallax patch content comprises parts of the 3D scene visible from a secondary non-central viewpoint; and
an association of each of the second data streams to a range of depths;
requesting, from the server, at least one available first data stream;
requesting, from the server, a subset of available second data streams selected based at least on a range of depths associated with the at least one available second data stream; and
rendering the 3D scene using the central patch content from the requested first data streams and parallax patch content from the requested selected subset of available second data streams.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
receiving at the terminal the requested first data streams and the requested subset of available second data streams.

### Claim 18 (depends on 1)

The method of claim 1, further comprising:
specifying an association of each of the second data streams to an angular sector.

### Claim 19 (depends on 18)

The method of claim 18, wherein the associated angular sector comprises a range of angles within a view of a user of the terminal.

### Claim 20 (depends on 18)

The method of claim 18, wherein the subset of the available second data streams is selected based on a range of depths and the angular sector associated with the available second data streams.

### Claim 21 (depends on 16)

The method of claim 16, wherein the subset of the available second data streams is selected based on at least one of a bandwidth available on a communication channel between the terminal and the server, and a capability of the terminal.

### Claim 22 (depends on 16)

The method of claim 16, wherein the subset of the available second data streams is selected based on a prioritization of depth ranges, with second data streams associated to closer depth ranges given a higher priority than second data streams associated to further depth ranges.

### Claim 23 (depends on 16)

The method of claim 16, wherein the manifest additionally specifies an association of each of the second data streams to a time interval.

### Claim 24 (depends on 16)

The method of claim 16, wherein the terminal is a head mounted display.

### Claim 25 (depends on 16)

The method of claim 16, wherein the parallax patch content comprises depth patches and texture patches.

### Claim 26 (depends on 16)

The method of claim 16, wherein each second data stream carries the parallax patch content in the form of an atlas of patches.

### Claim 27

A method for generating a 3D scene at a server, the method comprising:
transmitting a manifest, wherein the manifest includes;
a reference to at least one first data stream, the at least one first data stream comprising a central patch content of the 3D scene, the central patch content comprising parts of the scene visible from a central viewpoint;
a reference to a plurality of second data streams, the plurality of second data streams comprising parallax patch content of the 3D scene, wherein the parallax patch content comprises parts of the 3D scene visible from a secondary non-central viewpoint; and
an association of each of the second data streams to a range of depths;
receiving a request for at least one available first data stream;
receiving a request for a subset of available second data streams selected based at least on a range of depths associated with the at least one available second data stream; and
transmitting the at least one available first data stream and subset of available second data streams to enable rendering of a 3D scene.

### Claim 28 (depends on 27)

The method of claim 27, further comprising:
specifying, in the manifest, an association of each of the second data streams to an angular sector.

### Claim 29 (depends on 28)

The method of claim 28, wherein the associated angular sector comprises a range of angles within a view of a user of the terminal.

### Claim 30 (depends on 27)

The method of claim 27, wherein the manifest additionally specifies an association of each of the second data streams to a time interval.

### Claim 31 (depends on 27)

The method of claim 27, wherein the parallax patch content comprises depth patches and texture patches.

### Claim 32 (depends on 27)

The method of claim 27, wherein each second data stream carries the parallax patch content in the form of an atlas of patches.

### Claim 33

A terminal comprising:
a receiver;
a transmitter; and
a processor;
wherein the receiver is configured to receive a manifest, wherein the manifest includes:
a reference to at least one first data stream available from a server, the at least one first data stream comprising a central patch content of a 3D scene, the central patch content comprising parts of the 3D scene visible from a central viewpoint;
a reference to a plurality of second data streams available from the server, the plurality of second data streams comprising parallax patch content of the 3D scene, wherein the parallax patch content comprises parts of the 3D scene visible from a secondary non-central viewpoint; and
an association of each of the second data streams to a range of depths;
wherein the transmitter is configured to request, from the server, at least one available first data stream;
wherein the transmitter is further configured to request, from the server, a subset of available second data streams selected based at least on a range of depths associated with the at least one available second data stream; and
wherein the processor is configured to render the 3D scene using the central patch content from the requested first data streams and parallax patch content from the requested selected subset of available second data streams.
