# US 2022/0044448 A1 · Image processing device and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044448 A1
- Document ID: US20220044448A1
- Status: Published application
- Kind: A1
- Application number: 17/278,786
- Filed: 2019-09-18
- Published: 2022-02-10
- Earliest claimed: 2018-10-02
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Ohji NAKAGAMI; Koji YANO; Satoru KUMA; Tsuyoshi KATO
- Web page: https://patentgrep.com/patent/US20220044448A1

## CPC

- G06T 9/001: {Model-based coding, e.g. wire frame}
- G06T 9/40: Tree coding, e.g. quadtree, octree
- H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/60: using transform coding
- H04N 19/62: by frequency transforming in three dimensions [3D] (H04N19/63 takes precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

There is provided an image processing device and a method that are configured to be capable of reducing the increase of a load on encoding/decoding of attribute information of a point cloud. The attribute information of the point cloud is encoded using contexts corresponding to weight values obtained by an orthogonal transformation made on location information of the point cloud, the orthogonal transformation taking into consideration a three-dimensional structure. Further, encoded data associated with the attribute information of the point cloud is decoded using contexts corresponding to weight values obtained by an orthogonal transformation made on the location information of the point cloud, the orthogonal transformation taking into consideration a three-dimensional structure. The present disclosure can be applied to, for example, image processing devices, electronic equipment, image processing methods, programs, and the like.

## Claims

### Claim 1

An image processing device comprising:
an encoding section that encodes attribute information of a point cloud by using contexts corresponding to weight values obtained by an orthogonal transformation made on location information of the point cloud, the orthogonal transformation taking into consideration a three-dimensional structure.

### Claim 2 (depends on 1)

The image processing device according to claim 1, further comprising:
a context selection section that selects the contexts corresponding to the weight values,
wherein the encoding section encodes the attribute information by using the contexts having been selected by the context selection section.

### Claim 3 (depends on 2)

The image processing device according to claim 2, wherein the context selection section selects the contexts according to the weight values by using a preliminarily determined number of the contexts and preliminarily determined threshold values associated with the weight values.

### Claim 4 (depends on 2)

The image processing device according to claim 2, wherein the context selection section selects the contexts according to the weight values by using a set number of the contexts and set threshold values associated with the weight values.

### Claim 5 (depends on 2)

The image processing device according to claim 2, further comprising:
a weight value deriving section that derives the weight values,
wherein the context selection section selects the contexts corresponding to the weight values having been derived by the weight value deriving section.

### Claim 6 (depends on 5)

The image processing device according to claim 5, wherein the weight value deriving section performs RAHT (Region Adaptive Hierarchical Transform) as the orthogonal transformation on the location information, to derive the weight values.

### Claim 7 (depends on 5)

The image processing device according to claim 5, wherein the weight value deriving section derives the weight values on a basis of an octree regarding the location information.

### Claim 8 (depends on 5)

The image processing device according to claim 5, further comprising:
a RAHT (Region Adaptive Hierarchical Transform) processing section that performs RAHT on the attribute information by using the weight values having been derived by the weight value deriving section,
wherein the encoding section encodes transformed coefficients associated with the attribute information and generated by the RAHT processing section.

### Claim 9 (depends on 1)

The image processing device according to claim 1, further comprising:
a bitstream generation section that generates a bitstream including encoded data associated with the location information and encoded data associated with the attribute information and generated by the encoding section.

### Claim 10

An image processing method comprising:
encoding attribute information of a point cloud by using contexts corresponding to weight values obtained by an orthogonal transformation made on location information of the point cloud, the orthogonal transformation taking into consideration a three-dimensional structure.

### Claim 11

An image processing device comprising:
a decoding section that decodes encoded data associated with attribute information of a point cloud, by using contexts corresponding to weight values obtained by an orthogonal transformation made on location information of the point cloud, the orthogonal transformation taking into consideration a three-dimensional structure.

### Claim 12 (depends on 11)

The image processing device according to claim 11, further comprising:
a context selection section that selects the contexts corresponding to the weight values,
wherein the decoding section decodes the encoded data associated with the attribute information, by using the contexts having been selected by the context selection section.

### Claim 13 (depends on 12)

The image processing device according to claim 12, wherein the context selection section selects the contexts according to the weight values by using a preliminarily determined number of the contexts and preliminarily determined threshold values associated with the weight values.

### Claim 14 (depends on 12)

The image processing device according to claim 12, wherein the context selection section selects the contexts according to the weight values by using the number of the contexts and threshold values associated with the weight values that are supplied from an encoding side.

### Claim 15 (depends on 12)

The image processing device according to claim 12, further comprising:
a weight value deriving section that derives the weight values,
wherein the context selection section selects the contexts corresponding to the weight values having been derived by the weight value deriving section.

### Claim 16 (depends on 15)

The image processing device according to claim 15, wherein the weight value deriving section performs RAHT (Region Adaptive Hierarchical Transform) as the orthogonal transformation on the location information, to derive the weight values.

### Claim 17 (depends on 15)

The image processing device according to claim 15, wherein the weight value deriving section derives the weight values on a basis of an octree regarding the location information.

### Claim 18 (depends on 15)

The image processing device according to claim 15, further comprising:
an inverse RAHT (Region Adaptive Hierarchical Transform) processing section that performs inverse RAHT on the attribute information having been generated by the decoding section, by using the weight values having been derived by the weight value deriving section.

### Claim 19 (depends on 11)

The image processing device according to claim 11, further comprising:
a point cloud data generation section that generates point cloud data including the location information and the attribute information having been generated by the decoding section.

### Claim 20

An image processing method comprising:
decoding encoded data associated with attribute information of a point cloud, by using contexts corresponding to weight values obtained by an orthogonal transformation made on location information of the point cloud, the orthogonal transformation taking into consideration a three-dimensional structure.
