# US 2021/0343069 A1 · Information processing apparatus and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343069 A1
- Document ID: US20210343069A1
- Status: Published application
- Kind: A1
- Application number: 17/280,609
- Filed: 2019-09-18
- Published: 2021-11-04
- Earliest claimed: 2018-10-02
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Ryohei TAKAHASHI; Mitsuhiro HIRABAYASHI; Ohji NAKAGAMI; Satoru KUMA
- Web page: https://patentgrep.com/patent/US20210343069A1

## CPC

- G06T 15/20: Perspective computation
- H04N 21/816: {involving special video data, e.g 3D video}
- G06T 15/04: Texture mapping
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 21/23439: {for generating different versions}
- H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.

## Claims

### Claim 1

An information processing apparatus comprising:
a preprocessing section adapted to generate image data of a plurality of projection directions by projecting 3D data in a plurality of the projection directions and converting the 3D data into two-dimensional data and generate projection direction information indicating the projection directions of the image data as projection metadata.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the projection metadata includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the image data has a texture image, a geometry image, and an occupancy map image for each of the projection directions.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein
the preprocessing section further generates, as the projection metadata, display-alone-yes/no information indicating whether or not the image data in the projection directions indicated by the projection direction information or the additional projection direction identification information is able to be displayed alone.

### Claim 5 (depends on 1)

The information processing apparatus according to claim 1, wherein
the preprocessing section further generates, as image quality metadata, an effective pixel count of the image data.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
an MPD (Media Presentation Description) file generation section adapted to generate an MPD that signals the generated projection metadata for each of files, the files each being a data unit for reference when the 3D data is displayed.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein
in a case where the 3D data is not able to be displayed alone with one of the files, the MPD file generation section signals association with another file among the files, the another file being required to display the 3D data.

### Claim 8 (depends on 6)

The information processing apparatus according to claim 6, wherein
in a case where the 3D data is not able to be displayed alone with one of the files, the MPD file generation section groups together, for signaling, the file and another file among the files, the another file being required to display the 3D data.

### Claim 9 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
a file generation section adapted to generate an ISOBMFF (ISO Base Media File Format) file that signals the projection metadata for each of track, the tracks each being a data unit of a plurality of the projection directions.

### Claim 10 (depends on 9)

The information processing apparatus according to claim 9, wherein
in a case where the 3D data is not able to be displayed alone with one of the tracks, the file generation section groups together, for signaling, the track and another track among the tracks, the another track being required to display the 3D data.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
a coding section adapted to code an Elementary Stream that signals the projection metadata for each of patches, the patches each being a data unit of a plurality of the projection directions.

### Claim 12 (depends on 11)

The information processing apparatus according to claim 11, wherein
in a case where the 3D data is not able to be displayed alone with one of the patches, the coding section groups together, for signaling, the patch and an identifier of an additional patch required to display the 3D data.

### Claim 13 (depends on 4)

The information processing apparatus according to claim 4, wherein
in a case where the image data of the projection directions has been generated on a basis of a block which is part of an object box in a shape of a rectangular parallelepiped including the 3D data, the preprocessing section further generates, as the projection metadata, block position information that identifies a position of each of the blocks in a three-dimensional space relative to the object box.

### Claim 14

An information processing method comprising:
by an information processing apparatus,
generating image data of a plurality of projection directions by projecting 3D data in a plurality of the projection directions and converting the data into two-dimensional data; and
generating projection direction information indicating the projection directions of the image data as projection metadata.
