# US 2025/0168403 A1 · Information processing device and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168403 A1
- Document ID: US20250168403A1
- Status: Published application
- Kind: A1
- Application number: 18/839,739
- Filed: 2023-03-06
- Published: 2025-05-22
- Earliest claimed: 2022-03-24
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Tsuyoshi KATO; Satoru KUMA
- Web page: https://patentgrep.com/patent/US20250168403A1

## CPC

- H04N 19/597: specially adapted for multi-view video sequence encoding
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

There is provided an information processing device and a method that allow for suppression of reduction in encoding efficiency while suppressing degradation in subjective image quality. A base mesh with fewer vertices than a target mesh is generated, a plurality of patches are generated by dividing the target mesh and projecting the divided parts on the base mesh, a geometry image is generated by arranging the patches on a frame image, and vertex connectivity information about the base mesh and the geometry image are encoded. The vertex connectivity information and the encoded data of the geometry image are decoded, the number of vertices of the base mesh is increased using the vertex connectivity information, the patches are reconstructed, and reconstructed vertex information is generated using the reconstructed patches. The present disclosure can be applied for example to an information processing device, an electronic apparatus, an information processing method, or a program.

## Claims

### Claim 1

An information processing device comprising:
a base mesh generation unit configured to generate a base mesh which is 3D data that represents a three-dimensional structure of an object by vertices and connections and has a smaller number of the vertices than a target mesh;
a patch generation unit configured to generate a plurality of patches by dividing the target mesh and projecting the divided parts on the base mesh;
a geometry image generation unit configured to generate a geometry image by arranging the patches on a frame image;
a meta information encoding unit configured to encode meta information including vertex connectivity information about the vertices and the connections of the base mesh; and
a geometry image encoding unit configured to encode the geometry image.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein the base mesh generation unit generates the base mesh by decimating the target mesh.

### Claim 3 (depends on 2)

The information processing device according to claim 2, wherein the base mesh generation unit generates the base mesh by deforming the decimated target mesh.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein the base mesh generation unit generates the base mesh using a mesh model prepared in advance.

### Claim 5 (depends on 4)

The information processing device according to claim 4, wherein the base mesh generation unit generates the base mesh by deforming the mesh model.

### Claim 6 (depends on 1)

The information processing device according to claim 1, wherein the base mesh generation unit generates the base mesh common among a plurality of frames of the target mesh.

### Claim 7 (depends on 1)

The information processing device according to claim 1, further comprising a vertex number increasing unit configured to increase the number of vertices of the base mesh, wherein
the patch generation unit generates a plurality of the patches by projecting the divided parts of the target mesh on the base mesh with the increased number of vertices.

### Claim 8 (depends on 7)

The information processing device according to claim 7, wherein the vertex number increasing unit increases the number of vertices by dividing a polygon of the base mesh.

### Claim 9 (depends on 7)

The information processing device according to claim 7, wherein the patch generation unit calculates difference in position between each of the vertices of the base mesh with the increased number of vertices and the target mesh.

### Claim 10

An information processing method comprising the steps of generating a base mesh which is 3D data that represents a three-dimensional structure of an object by vertices and connections and has a smaller number of the vertices than a target mesh;
generating a plurality of patches by dividing the target mesh and projecting the divided parts on the base mesh;
generating a geometry image by arranging the patches on a frame image;
encoding meta information including vertex connectivity information about the vertices and the connections of the base mesh; and
encoding the geometry image.

### Claim 11

An information processing device comprising:
a meta information decoding unit configured to decode encoded data of meta information including vertex connectivity information which is information about vertices and connections of a base mesh;
a geometry image decoding unit configured to decode encoded data of a geometry image which is a frame image having a patch arranged thereon,
a vertex number increasing unit configured to increase the number of vertices of the base mesh using the vertex connectivity information;
a patch reconstruction unit configured to reconstruct the patch using the geometry image and the base mesh with the increased number of vertices;
a vertex information reconstruction unit configured to generate reconstructed vertex information about the vertices of the base mesh with the increased number of vertices by reconstructing three-dimensional positions of the vertices of the base mesh with the increased number of vertices using the reconstructed patch;
wherein
the base mesh is 3D data that represents a three-dimensional structure of an object by the vertices and the connections and has a smaller number of the vertices than a target mesh, and
the patch is a divided part of the target mesh that represents the base mesh as a projection plane.

### Claim 12 (depends on 11)

The information processing device according to claim 11, wherein the vertex connectivity information includes identification information about a mesh model prepared in advance, and
the meta information decoding unit generates base mesh vertex information about the vertices of the base mesh and base mesh connectivity information about the connections of the base mesh using the mesh model corresponding to the identification information.

### Claim 13 (depends on 12)

The information processing device according to claim 12, wherein the meta information decoding unit generates the base mesh vertex information and the base mesh connectivity information by enlarging, reducing, rotating or moving the entire mesh model.

### Claim 14 (depends on 12)

The information processing device according to claim 12, wherein the meta information decoding unit generates the base mesh vertex information and the base mesh connectivity information by moving, increasing or reducing the vertices of the mesh model.

### Claim 15 (depends on 11)

The information processing device according to claim 11, wherein the vertex connectivity information includes identification information about a further frame,
the meta information decoding unit refers to the base mesh vertex information about the vertices of the base mesh and the base mesh connectivity information about the connections of the base mesh corresponding to the further frame and determines these kinds of information as the base mesh vertex information and the base mesh connectivity information corresponding to a current frame.

### Claim 16 (depends on 11)

The information processing device according to claim 11, wherein the vertex number increasing unit increases the number of vertices by dividing a polygon of the base mesh.

### Claim 17 (depends on 11)

The information processing device according to claim 11, wherein the patch reconstruction unit reconstructs the patch by extracting a pixel value corresponding to the vertex in a small region in the geometry image.

### Claim 18 (depends on 17)

The information processing device according to claim 17, wherein the vertex information reconstruction unit generates the reconstructed vertex information by arranging the vertex in a position away from the small region by a distance indicated by the pixel value along any of three-dimensional coordinate axes.

### Claim 19 (depends on 18)

The information processing device according to claim 18, wherein the vertex information reconstruction unit calculates an offset of the small region with respect to a plane perpendicular to any of the three-dimensional coordinate axes and arranges the vertex using the offset.

### Claim 20

An information processing method comprising the steps of decoding encoded data of meta information including vertex connectivity information about vertices and connections of a base mesh;
decoding encoded data of a geometry image which is a frame image having a patch arranged thereon;
increasing the number of vertices of the base mesh using the vertex connectivity information;
reconstructing the patch using the geometry image and the base mesh having the increased number of the vertices; and
generating reconstructed vertex information about the vertices of the base mesh having the increased number of vertices by reconstructing three-dimensional positions of the vertices of the base mesh having the increased number of vertices using the reconstructed patch, wherein
the base mesh is 3D data that represents a three-dimensional structure of an object by the vertices and the connections and has a smaller number of the vertices than a target mesh, and
the patch is a divided part of the target mesh that represents the base mesh as a projection plane.
