# US 2021/0084346 A1 · Transmission device, transmission method, reception device and reception method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0084346 A1
- Document ID: US20210084346A1
- Status: Published application
- Kind: A1
- Application number: 16/959,558
- Filed: 2019-01-10
- Published: 2021-03-18
- Earliest claimed: 2018-01-12
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Ikuo TSUKAGOSHI
- Web page: https://patentgrep.com/patent/US20210084346A1

## CPC

- H04N 21/238: Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams {(hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60)}
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras}
- H04N 21/2362: Generation or processing of Service Information [SI]
- H04N 21/462: Content or additional data management e.g. creating a master electronic programme guide from data received from the Internet and a Head-end or controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/854: Content authoring
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A certain partial image in a wide viewing angle image is made displayable between receivers by use or by user with consistency. A coded stream obtained by encoding image data of a wide viewing angle image is transmitted and rendering meta information including information of a predetermined number of viewpoints registered in groups is transmitted. For example, the information of a viewpoint includes information of an azimuth angle (azimuth information) and an elevation angle (elevation information) indicating a position of the viewpoint.

## Claims

### Claim 1

A transmission device comprising:
a transmission unit configured to transmit a coded stream obtained by encoding image data of a wide viewing angle image and transmit rendering meta information including information of a predetermined number of viewpoints registered in groups.

### Claim 2 (depends on 1)

The transmission device according to claim 1, wherein
the wide viewing angle image is a projection picture obtained by cutting out part or all of a spherical captured image and performing plane packing for the cutout spherical captured image.

### Claim 3 (depends on 1)

The transmission device according to claim 1, wherein
the information of a viewpoint includes information of an azimuth angle and an elevation angle indicating a position of the viewpoint.

### Claim 4 (depends on 1)

The transmission device according to claim 1, wherein
the transmission unit inserts the rendering meta information into a layer of the coded stream and/or a layer of a container including the coded stream and transmits the rendering meta information.

### Claim 5 (depends on 4)

The transmission device according to claim 4, wherein
the transmission unit further transmits a metafile including meta information regarding the coded stream, and
the metafile includes identification information indicating the insertion of the rendering meta information in the layer of the coded stream and/or of the container.

### Claim 6 (depends on 4)

The transmission device according to claim 4, wherein
the container is an ISOBMFF, and
the transmission unit inserts the rendering meta information into a moov box and transmits the rendering meta information.

### Claim 7 (depends on 4)

The transmission device according to claim 4, wherein
the container is an ISOBMFF, and
the transmission unit transmits the rendering meta information, using a track different from a track including the coded stream obtained by encoding image data of the wide viewing angle image.

### Claim 8 (depends on 4)

The transmission device according to claim 4, wherein
the container is an MPEG2-TS, and
the transmission unit inserts the rendering meta information into a program map table and transmits the rendering meta information.

### Claim 9 (depends on 4)

The transmission device according to claim 4, wherein
the container is an MMT stream, and
the transmission unit inserts the rendering meta information into an MMT package table and transmits the rendering meta information.

### Claim 10 (depends on 1)

The transmission device according to claim 1, wherein
the coded stream obtained by encoding image data of the wide viewing angle image is a coded stream corresponding to each divided region obtained by dividing the wide viewing angle image.

### Claim 11 (depends on 10)

The transmission device according to claim 10, wherein
the coded stream of each divided region is obtained by individually encoding each divided region of the wide viewing angle image.

### Claim 12 (depends on 10)

The transmission device according to claim 10, wherein
the coded stream of each divided region is obtained by performing encoding using a tile function using each divided region of the wide viewing angle image as a tile.

### Claim 13 (depends on 10)

The transmission device according to claim 10, wherein
the information of a viewpoint includes information of a divided region where the viewpoint is located.

### Claim 14

A transmission method comprising the step of
by a transmission unit, transmitting a coded stream obtained by encoding image data of a wide viewing angle image and transmitting information of a predetermined number of viewpoints registered in groups.

### Claim 15

A reception device comprising:
a reception unit configured to receive a coded stream obtained by encoding image data of a wide viewing angle image and receive information of a predetermined number of viewpoints registered in groups; and
a processing unit configured to process the image data of the wide viewing angle image obtained by decoding the coded stream on a basis of the information of a viewpoint to obtain display image data.

### Claim 16 (depends on 15)

The reception device according to claim 15, wherein
the processing unit uses the information of a viewpoint of a group determined according to an attribute of a user or contract content.

### Claim 17 (depends on 16)

The reception device according to claim 16, wherein
the processing unit obtains the display image data having a position indicated by the information of a viewpoint selected by a user operation as a center position.

### Claim 18 (depends on 15)

The reception device according to claim 15, wherein
the reception unit receives, as the coded stream obtained by encoding image data of the wide viewing angle image, a coded stream corresponding to each divided region obtained by dividing the wide viewing angle image, and
the processing unit decodes coded streams of a predetermined number of divided regions to be used for obtaining the display image data, of the coded streams each corresponding to each divided region.

### Claim 19 (depends on 18)

The reception device according to claim 18, wherein
the reception unit requests a distribution server to transmit the coded streams of a predetermined number of divided regions, and receives the coded streams of a predetermined number of divided regions from the distribution server.

### Claim 20

A reception method comprising:
a reception step of receiving a coded stream obtained by encoding image data of a wide viewing angle image and receiving rendering meta information including information of a predetermined number of viewpoints registered in groups, by a reception unit; and
a processing step of processing the image data of a wide viewing angle image obtained by decoding the coded stream on a basis of the rendering meta information to obtain display image data, by a processing unit.
