# US 11,310,518 B2 · Image processing apparatus and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,310,518 B2
- Document ID: US11310518B2
- Status: Granted
- Kind: B2
- Application number: 16/981,722
- Filed: 2019-03-28
- Published: 2021-08-12
- Granted: 2022-04-19
- Earliest claimed: 2018-04-11
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Satoru Kuma; Ohji Nakagami; Koji Yano; Tsuyoshi Kato
- Web page: https://patentgrep.com/patent/US11310518B2

## CPC

- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- G06T 3/08: Projecting images onto non-planar surfaces, e.g. geodetic screens
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- H04N 19/172: the region being a picture, frame or field
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/37: with arrangements for assigning different transmission priorities to video input data or to video coded data
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus and method that make it possible to decode encoded data of 3D data with increased ease. A bit stream is generated which includes projection direction information including information relating to a projection direction of position information of 3D data representative of a three-dimensional structure on a two-dimensional plane and encoded data of a geometry image obtained by projecting the position information on the two-dimensional plane.

## Claims

### Claim 1

An image processing apparatus comprising:
a bit stream generator configured to generate a bit stream that includes projection direction information including information relating to a projection direction of position information of 3D data representative of a three-dimensional structure on a two-dimensional plane and encoded data of a geometry image obtained by projecting the position information on the two-dimensional plane,
the projection direction information includes information relating to a correspondence of an identifier to a direction and a position at the time of projecting the position information on the two-dimensional plane,
the projection direction information further includes attribute information relating to decoding, and
the attribute information includes meaning information indicative of a characteristic in the three-dimensional structure.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
a projection direction information generator configured to generate the projection direction information, wherein
the bit stream generator generates a bit stream that includes the projection direction information generated by the projection direction information generator and the encoded data.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
a packer configured to place and pack the geometry image on an image according to the projection direction information; and
an encoder configured to encode the image on which the geometry image is packed by the packer to generate the encoded data, wherein
the bit stream generator generates a bit stream that includes the projection direction information and the encoded data generated by the encoder.

### Claim 4

An image processing apparatus comprising:
a packer configured to place and pack a geometry image that is obtained by projecting position information of 3D data representative of a three-dimensional structure on a two-dimensional plane, in an encoder of an image according to a projection direction of the position information on the two-dimensional plane,
the packer packs the geometry image on a basis of encoder information indicative of a correspondence between an identifier of the projection direction and information indicative of an encoder for placing the geometry image,
the encoder information further includes attribute information relating to decoding, and
the attribute information includes meaning information indicative of a characteristic in the three-dimensional structure.

### Claim 5 (depends on 4)

The image processing apparatus according to claim 4, further comprising:
an encoder information generator configured to generate the encoder information, wherein
the packer packs the geometry image on a basis of the encoder information generated by the encoder information generator.

### Claim 6 (depends on 4)

The image processing apparatus according to claim 4, further comprising:
the encoder configured to encode the image on which the geometry image is packed by the packer to generate encoded data; and
a bit stream generator configured to generate a bit stream that includes the encoder information and the encoded data generated by the encoder.

### Claim 7 (depends on 4)

The image processing apparatus according to claim 4, wherein the encoder includes a slice, a tile, or a picture.

### Claim 8

An image processing apparatus comprising:
a decoder configured to decode, from an encoder of a bit stream according to a projection direction of position information of 3D data representative of a three-dimensional structure on a two-dimensional plane, a geometry image projected on the two-dimensional plane in the projection direction,
the projection direction information includes information relating to a correspondence of an identifier to a direction and a position at the time of projecting the position information on the two-dimensional plane,
the projection direction information further includes attribute information relating to decoding, and
the attribute information includes meaning information indicative of a characteristic in the three-dimensional structure.

### Claim 9

An image processing method comprising:
decoding, from an encoder of a bit stream according to a projection direction of position information of 3D data representative of a three-dimensional structure on a two-dimensional plane, a geometry image projected on the two-dimensional plane in the projection direction,
the projection direction information includes information relating to a correspondence of an identifier to a direction and a position at the time of projecting the position information on the two-dimensional plane,
the projection direction information further includes attribute information relating to decoding, and
the attribute information includes meaning information indicative of a characteristic in the three-dimensional structure.
