# US 2022/0036593 A1 · Information processing apparatus and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036593 A1
- Document ID: US20220036593A1
- Status: Published application
- Kind: A1
- Application number: 17/296,411
- Filed: 2019-12-16
- Published: 2022-02-03
- Earliest claimed: 2018-12-28
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Ryohei TAKAHASHI; Mitsuhiro HIRABAYASHI; Mitsuru KATSUMATA; Takumi TSURU; Ohji NAKAGAMI; Satoru KUMA
- Web page: https://patentgrep.com/patent/US20220036593A1

## CPC

- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- G06T 9/001: {Model-based coding, e.g. wire frame}
- H03M 7/3075: {Space}
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)}
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 21/85406: {involving a specific file format, e.g. MP4 format}
- H03M 7/3064: {Segmenting}
- H03M 7/4043: {Adaptive prefix coding}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H03M: CODING; DECODING; CODE CONVERSION IN GENERAL (using fluidic means F15C4/00; optical analogue/digital converters G02F7/00; coding, decoding or code conversion, specially adapted for particular applications, see the relevant subclasses, e.g. G01D, G01R, G06F, G06T, G09G, G10L, G11B, G11C, H04B, H04L, H04M, H04N; ciphering or deciphering for cryptography or other purposes involving the need for secrecy G09C)

## Abstract

The present disclosure relates to an information processing apparatus and an information processing method that are capable of distributing higher-quality G-PCC streams. When G-PCC streams obtained by encoding Point Cloud data according to G-PCC are generated, there are generated spatial positional information indicating spatial positions of respective pieces of partial Point Cloud data that represent individual parts into which the Point Cloud data is segmented, and grouping information that groups the partial Point Cloud data. The present technology is applicable to a generating apparatus that generates G-PCC streams, for example.

## Claims

### Claim 1

An information processing apparatus comprising:
a file generating section that generates a file including spatial positional information indicating spatial positions of respective pieces of partial Point Cloud data that represent individual parts into which Point Cloud data is segmented when the Point Cloud data is encoded on a three-dimensional structure base to generate encoded Point Cloud data streams, and grouping information that groups the partial Point Cloud data.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the file generated by the file generating section further includes direction corresponding information indicating a direction required to display the partial Point Cloud on a basis of a local coordinate system of the Point Cloud data.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the file generated by the file generating section further includes the spatial positional information that is changed dynamically.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2, wherein
the file generated by the file generating section further includes the direction corresponding information that is changed dynamically.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein
the file generated by the file generating section includes a file having a DASH MPD (Dynamic Adaptive Streaming over HTTP Media Presentation Description) or ISOBMFF (ISO Base Media File Format) structure.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein
the parts include a brick representing a collection of points that can independently be encoded and decoded in the Point Cloud data, and
the file generated by the file generating section further includes information linking spatial positional information of the brick in units of data of the brick in the Point Cloud data streams.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1, wherein
the partial Point Cloud data includes a brick representing a collection of points that can independently be encoded and decoded in the Point Cloud data, and
the file generated by the file generating section further includes information linking spatial positional information of the brick in units of data of the brick in streams of the partial Point Cloud data.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, wherein
the partial Point Cloud data includes a brick representing a collection of points that can independently be encoded and decoded in the Point Cloud data, and
the file generated by the file generating section further includes information linking spatial positional information of the brick in units of data of the brick in streams of the partial Point Cloud data.

### Claim 9

An information processing method comprising:
by an information processing apparatus,
generating a file including spatial positional information indicating spatial positions of respective pieces of partial Point Cloud data that represent individual parts into which Point Cloud data is segmented when the information processing apparatus encodes the Point Cloud data on a three-dimensional structure base to generate encoded data streams, and grouping information that groups the partial Point Cloud data.

### Claim 10

An information processing apparatus comprising:
an encoding section that generates partial definition degree information representing definition degrees of encoded parts when Point Cloud data is encoded on a three-dimensional structure base to generate encoded Point Cloud data streams, wherein
the encoding section generates directional information indicating a direction pointing to an area of a relatively high image quality in a local coordinate system of the Point Cloud data, on a basis of the partial definition degree information.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, further comprising:
a file generating section that generates a file including the partial definition degree information and the directional information generated by the encoding section.

### Claim 12 (depends on 11)

The information processing apparatus according to claim 11, wherein
the file generated by the file generating section includes a file having a DASH MPD or ISOBMFF structure.

### Claim 13 (depends on 12)

The information processing apparatus according to claim 12, wherein
the file generated by the file generating section further includes linking information of partial Point Cloud data pieces that are made high in definition in combination, with regard to partial Point Cloud data pieces representing individual parts into which the Point Cloud data is segmented.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13, wherein
the file generated by the file generating section further includes definition degree information representing definition degrees of the partial Point Cloud data pieces in combination.

### Claim 15 (depends on 11)

The information processing apparatus according to claim 11, wherein
the file generated by the file generating section further includes rendering information for rendering low-definition ones of the parts.

### Claim 16 (depends on 15)

The information processing apparatus according to claim 15, wherein
the file generated by the file generating section further includes subjective quality increasing rendering information indicating a rendering process required to increase different subjective qualities of the respective parts.

### Claim 17

An information processing method comprising:
by an information processing apparatus,
generating partial definition degree information representing definition degrees of encoded parts when the information processing apparatus encodes Point Cloud data on a three-dimensional structure base to generate encoded data streams, wherein
directional information indicating a direction pointing to an area of a relatively high image quality is generated in a local coordinate system of the Point Cloud data, on a basis of the partial definition degree information.

### Claim 18 (depends on 4)

The information processing apparatus according to claim 4, wherein
the file generated by the file generating section includes a file having a DASH MPD (Dynamic Adaptive Streaming over HTTP Media Presentation Description) or ISOBMFF (ISO Base Media File Format) structure.
