# US 2021/0176496 A1 · Method, apparatus and stream for encoding/decoding volumetric video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176496 A1
- Document ID: US20210176496A1
- Status: Published application
- Kind: A1
- Application number: 16/761,612
- Filed: 2018-10-23
- Published: 2021-06-10
- Earliest claimed: 2017-11-07
- Assignees: InterDigital VC Holdings, Inc.
- Applicants: InterDigital VC Holdings, Inc.
- Inventors: Bertrand CHUPEAU; Franck GALPIN; Julien FLEUREAU
- Web page: https://patentgrep.com/patent/US20210176496A1

## CPC

- H04N 19/597: specially adapted for multi-view video sequence encoding
- G06T 7/50: Depth or shape recovery
- G06T 7/529: from texture
- H04N 19/124: Quantisation
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/65: using error resilience
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Encoding/decoding data representative of a 3D representation according to a range of points of view can involve generating a depth map associated with a part of the 3D representation according to a parameter representative of at least a 2D parametrization associated with the part and data associated with a point of the part, and generating according to the parameter and the data a texture map associated with the part, where information representative of a variation of a quantization parameter within the depth map and/or the texture map can be obtained according to a region of interest of the 3D representation.

## Claims

### Claim at position 1

1-15. (canceled)

### Claim 16

A method, comprising:
determining a depth map of a part of a 3D representation according to a two-dimensional parametrization responsive to geometric characteristics of said part of the 3D representation and to pose information associated with a range of points of view used to determine said 3D representation;
determining a texture map of said part of the 3D representation according to said two-dimensional parametrization and to said geometric characteristics of said part;
obtaining a first information representative of variation of quantization parameter within said depth map and/or said texture map according to a region of interest of said 3D representation; and
encoding into a bitstream, said depth map, said texture map, parameters of said two-dimensional parametrization, said first information and a second information representative of a mapping between said two-dimensional parametrization and corresponding depth map and texture map.

### Claim 17 (depends on 16)

The method according to claim 16, wherein said depth map and/or said texture map is encoded according to said first information.

### Claim 18 (depends on 16)

The method according to claim 16, wherein said first information corresponds to a prediction error associated with said at least a region of interest.

### Claim 19 (depends on 16)

The method according to claim 16, wherein said first information corresponds to an information representative of sampling of said 2D parametrization, a first sampling level being applied to at least an area of said 2D parametrization associated with said region of interest and a second sampling level being applied to other areas of said 2D parametrization.

### Claim 20

A device, comprising a memory associated with at least one processor, configured to:
determine a depth map of a part of a 3D representation according to a two-dimensional parametrization responsive to geometric characteristics of said part of the 3D representation and to pose information associated with a range of points of view used to determine said 3D representation;
determine a texture map of said part of the 3D representation according to said two-dimensional parametrization and to said geometric characteristics of said part;
obtain a first information representative of variation of quantization parameter within said depth map and/or said texture map according to a region of interest of said 3D representation; and
encode into a bitstream, said depth map, said texture map, parameters of said two-dimensional parametrization, said first information and a second information representative of a mapping between said two-dimensional parametrization and corresponding depth map and texture map.

### Claim 21 (depends on 20)

The device according to claim 20, wherein said depth map and/or said texture map is encoded according to said first information.

### Claim 22 (depends on 20)

The device according to claim 20, wherein said first information corresponds to a prediction error associated with said at least a region of interest.

### Claim 23 (depends on 20)

The device according to claim 20, wherein said first information corresponds to an information representative of sampling of said 2D parametrization, a first sampling level being applied to at least an area of said 2D parametrization associated with said region of interest and a second sampling level being applied to other areas of said 2D parametrization.

### Claim 24

A non-transitory medium encoding data representative of a 3D representation of a scene, said 3D representation being according to a range of points of view, wherein the data comprises:
at least a parameter representative of a two-dimensional parametrization of a part of said 3D representation, the at least a parameter being obtained according to geometric characteristics of said part of the 3D representation and according to pose information associated with said range of points of view;
data representative of a texture map associated with said part and determined from said at least a parameter and said geometric characteristics;
data representative of a depth map of said part of the 3D representation and determined from said at least a parameter and said geometric characteristics;
a first information representative of variation of quantization parameter within said a depth map and/or said texture map according to a region of interest of said 3D representation; and
a second information representative of a mapping between said two-dimensional parametrization and corresponding depth map and texture map.

### Claim 25 (depends on 24)

The non-transitory medium according to claim 24, wherein the data representative of said depth map and/or said texture map is encoded according to said first information.

### Claim 26 (depends on 24)

The non-transitory medium according to claim 24, wherein said first information corresponds to a prediction error associated with said region of interest.

### Claim 27 (depends on 24)

The non-transitory medium according to claim 24, wherein said first information corresponds to an information representative of sampling of said 2D parametrization, a first sampling level being applied to at least an area of said 2D parametrization associated with said region of interest and a second sampling level being applied to other areas of said 2D parametrization.

### Claim 28

A method, comprising:
decoding from a bitstream, at least a parameter representative of a two-dimensional parametrization;
decoding, from said bitstream, a texture map of a part of a 3D representation;
decoding, from said bitstream, a depth map of said part of said 3D representation;
decoding a first information from said bitstream and representative of variation of quantization parameter within said depth map and/or said texture map and a second information representative of a mapping between said two-dimensional parametrization and corresponding depth map and texture map; and
de-projecting said depth and texture map according to said first and second information.

### Claim 29 (depends on 28)

The method according to claim 28, wherein said depth map and/or said texture map is decoded according to said first information.

### Claim 30 (depends on 28)

The method according to claim 28, wherein said first information corresponds to a prediction error associated with said at least a region of interest.

### Claim 31 (depends on 28)

The method according to claim 28, wherein said first information corresponds to an information representative of sampling of said 2D parametrization, a first sampling level being applied to at least an area of said 2D parametrization associated with said region of interest and a second sampling level being applied to other areas of said 2D parametrization.

### Claim 32

A device, comprising a memory associated with at least one processor, configured to:
decode, from a bitstream, at least a parameter representative of a two-dimensional parametrization;
decode, from said bitstream, a texture map of a part of a 3D representation;
decode, from said bitstream, a depth map of said part of said 3D representation;
decoding a first information from said bitstream and representative of variation of quantization parameter within said depth map and/or said texture map and a second information representative of a mapping between said two-dimensional parametrization and corresponding depth map and texture map; and
de-project said depth and texture map according to said first and second information.

### Claim 33 (depends on 32)

The device according to claim 32, wherein said depth map and/or said texture map is decoded according to said first information.

### Claim 34 (depends on 32)

The device according to claim 32, wherein said first information corresponds to a prediction error associated with said at least a region of interest.

### Claim 35 (depends on 32)

The device according to claim 32, wherein said first information corresponds to an information representative of sampling of said 2D parametrization, a first sampling level being applied to at least an area of said 2D parametrization associated with said region of interest and a second sampling level being applied to other areas of said 2D parametrization.
