# US 2023/0412842 A1 · Vertex prediction based on decoded neighbors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0412842 A1
- Document ID: US20230412842A1
- Status: Published application
- Kind: A1
- Application number: 18/312,265
- Filed: 2023-05-04
- Published: 2023-12-21
- Earliest claimed: 2022-06-17
- Assignees: Tencent America LLC
- Applicants: Tencent America LLC
- Inventors: Xiaozhong XU; Chao Huang; Jun Tian; Xiang Zhang; Shan Liu
- Web page: https://patentgrep.com/patent/US20230412842A1

## CPC

- H04N 19/597: specially adapted for multi-view video sequence encoding
- G06T 9/001: {Model-based coding, e.g. wire frame}
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/172: the region being a picture, frame or field
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and apparatus comprising computer code configured to cause a processor or processors to obtain volumetric data of at least one three-dimensional (3D) visual content, derive a first layer of a mesh including a plurality of first vertices from at least one frame of the volumetric data, determine displacement vectors from ones of the plurality of vertices of the first layer to respective ones of a plurality of second vertices of a second layer of the mesh, a total quantity of the plurality of second vertices is greater than a total quantity of the plurality of first vertices, and signal the volumetric data based on the displacement vectors.

## Claims

### Claim 1

A method for video coding, the method performed by at least one processor and comprising:
obtaining volumetric data of at least one three-dimensional (3D) visual content;
deriving a first layer of a mesh comprising a plurality of first vertices from at least one frame of the volumetric data;
determining displacement vectors from ones of the plurality of vertices of the first layer to respective ones of a plurality of second vertices of a second layer of the mesh, a total quantity of the plurality of second vertices is greater than a total quantity of the plurality of first vertices; and
signaling the volumetric data based on the displacement vectors.

### Claim 2 (depends on 1)

The method for video coding according to claim 1, further comprising:
determining second displacement vectors from the plurality of second vertices of the second layer of the mesh and from a plurality of other vertices of the second layer of the mesh; and
further signaling the volumetric data based on the second displacement vectors.

### Claim 3 (depends on 2)

The method for video coding according to claim 2,
wherein the first layer of the mesh comprises a polygon defined by straight lines interconnecting each of other ones of the plurality of first vertices, and
wherein the ones of the plurality of first vertices are arranged on respective ones of the straight lines interconnecting each of the other ones of the plurality of first vertices.

### Claim 4 (depends on 3)

The method for video coding according to claim 3,
wherein the other ones of the plurality of first vertices are decoded vertices,
wherein the ones of the plurality of first vertices are interpolated vertices, and
wherein the polygon defines boundaries of the first layer of the mesh.

### Claim 5 (depends on 3)

The method for video coding according to claim 3,
wherein the second layer of the mesh comprises a plurality of second polygons each defined by second straight lines interconnecting the plurality of second vertices of the second layer of the mesh with the other ones of plurality of first vertices of the first layer of the mesh.

### Claim 6 (depends on 5)

The method for video coding according to claim 5,
wherein at least one of the plurality of second vertices is within a boundary of the polygon.

### Claim 7 (depends on 6)

The method for video coding according to claim 6,
wherein each of the plurality of second vertices is within the boundary of the polygon.

### Claim 8 (depends on 5)

The method for video coding according to claim 5,
wherein the second polygons are each entirely within the boundary of the polygon.

### Claim 9 (depends on 5)

The method for video coding according to claim 5,
wherein at least one of the plurality of second vertices is outside a boundary of the polygon.

### Claim 10 (depends on 9)

The method for video coding according to claim 9,
wherein at least part of one of the second polygons is outside the boundary of the polygon.

### Claim 11

An apparatus for video coding, the apparatus comprising:
at least one memory configured to store computer program code;
at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:
obtaining code configured to cause the at least one processor to obtain volumetric data of at least one three-dimensional (3D) visual content;
deriving code configured to cause the at least one processor to derive a first layer of a mesh comprising a plurality of first vertices from at least one frame of the volumetric data;
determining code configured to cause the at least one processor to determine displacement vectors from ones of the plurality of vertices of the first layer to respective ones of a plurality of second vertices of a second layer of the mesh, a total quantity of the plurality of second vertices is greater than a total quantity of the plurality of first vertices; and
signaling code configured to cause the at least one processor to signal the volumetric data based on the displacement vectors.

### Claim 12 (depends on 11)

The apparatus for video coding according to claim 11,
wherein the determining code is further configured to cause the at least one processor to determine second displacement vectors from the plurality of second vertices of the second layer of the mesh and from a plurality of other vertices of the second layer of the mesh, and
wherein the signaling code is further configured to cause the at least one processor to further signal the volumetric data based on the second displacement vectors.

### Claim 13 (depends on 12)

The apparatus for video coding according to claim 12,
wherein the first layer of the mesh comprises a polygon defined by straight lines interconnecting each of other ones of the plurality of first vertices, and
wherein the ones of the plurality of first vertices are arranged on respective ones of the straight lines interconnecting each of the other ones of the plurality of first vertices.

### Claim 14 (depends on 13)

The apparatus for video coding according to claim 13,
wherein the other ones of the plurality of first vertices are decoded vertices,
wherein the ones of the plurality of first vertices are interpolated vertices, and
wherein the polygon defines boundaries of the first layer of the mesh.

### Claim 15 (depends on 13)

The apparatus for video coding according to claim 13,
wherein the second layer of the mesh comprises a plurality of second polygons each defined by second straight lines interconnecting the plurality of second vertices of the second layer of the mesh with the other ones of plurality of first vertices of the first layer of the mesh.

### Claim 16 (depends on 15)

The apparatus for video coding according to claim 15,
wherein at least one of the plurality of second vertices is within a boundary of the polygon.

### Claim 17 (depends on 16)

The apparatus for video coding according to claim 16,
wherein each of the plurality of second vertices is within the boundary of the polygon.

### Claim 18 (depends on 15)

The apparatus for video coding according to claim 15,
wherein the second polygons are each entirely within the boundary of the polygon.

### Claim 19 (depends on 15)

The apparatus for video coding according to claim 15,
wherein at least one of the plurality of second vertices is outside a boundary of the polygon.

### Claim 20

A non-transitory computer readable medium storing a program causing a computer to:
obtain volumetric data of at least one three-dimensional (3D) visual content;
derive a first layer of a mesh comprising a plurality of first vertices from at least one frame of the volumetric data;
determine displacement vectors from ones of the plurality of vertices of the first layer to respective ones of a plurality of second vertices of a second layer of the mesh, a total quantity of the plurality of second vertices is greater than a total quantity of the plurality of first vertices; and
signal the volumetric data based on the displacement vectors.
