# US 2019/0174151 A1 · Transmitting device, transmitting method, receiving device, and receiving method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0174151 A1
- Document ID: US20190174151A1
- Status: Published application
- Kind: A1
- Application number: 16/324,760
- Filed: 2017-08-17
- Published: 2019-06-06
- Earliest claimed: 2016-08-30
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Ikuo TSUKAGOSHI
- Web page: https://patentgrep.com/patent/US20190174151A1

## CPC

- H04N 21/236: Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream {(multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)}
- H04N 19/21: with binary alpha-plane coding for video objects, e.g. context-based arithmetic encoding [CAE]
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 21/23614: {Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28)}
- H04N 21/4725: using interactive regions of the image, e.g. hot spots {(details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94)}
- H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A receiving side can perform interactive processing based on information of an object. Image data is coded to obtain a video stream having coded image data. The video stream is transmitted in a state of being added with information of an object detected on the basis of image data. For example, information of an object includes coded data obtained by coding one-bit data showing a shape of the object, information of a region that is a rectangular area enclosing the object, display priority information of the region, text information that explains the object, and the like. The receiving side can acquire information of an object without the need of detecting an object by processing image data, and without depending on its own performance, and is allowed to perform interactive processing based on information of an object in an excellent manner.

## Claims

### Claim 1

A transmitting device, comprising:
an image encoding unit configured to code image data to obtain a video stream having coded image data; and
a transmitting unit configured to transmit the video stream in a state of being added with information of an object detected on a basis of the image data.

### Claim 2 (depends on 1)

The transmitting device according to claim 1, wherein
the information of an object includes coded data obtained by coding one-bit data showing a shape of the object.

### Claim 3 (depends on 1)

The transmitting device according to claim 1, wherein
the object information includes information of a region that is a rectangular area enclosing the object.

### Claim 4 (depends on 3)

The transmitting device according to claim 3, wherein
the object information further includes display priority information of the region.

### Claim 5 (depends on 1)

The transmitting device according to claim 1, wherein
the object information includes text information that explains the object.

### Claim 6 (depends on 1)

The transmitting device according to claim 1, wherein
the information of an object is transmitted by being inserted into the video stream.

### Claim 7 (depends on 6)

The transmitting device according to claim 6, wherein
the object information at least includes coded data obtained by coding one-bit data showing a shape of the object and information of a region that is a rectangular area enclosing the object, and
the coded data is inserted into a first area in the video stream, and the information of a region is inserted into a second area that is different from the first area in the video stream.

### Claim 8

(canceled)

### Claim 9

A receiving device, comprising a receiving unit configured to receive a video stream having coded image data obtained by coding image data, wherein
the video stream is added with information of an object detected on a basis of the image data,
the receiving device further comprising a control unit configured to control interactive processing performed on a basis of the information of an object.

### Claim 10 (depends on 9)

The receiving device according to claim 9, wherein
the interactive processing is processing of highlighting a predetermined object selected on a basis of the information of an object.

### Claim 11 (depends on 9)

The receiving device according to claim 9, wherein
the interactive processing is processing of acquiring predetermined information by analyzing an image of a predetermined object selected on a basis of the information of an object.

### Claim 12 (depends on 9)

The receiving device according to claim 9, wherein
the interactive processing is processing of displaying information relating to a predetermined object selected on a basis of the object information.

### Claim 13

(canceled)

### Claim 14

A receiving device, comprising:
a receiving unit configured to receive a video stream having coded image data obtained by coding image data; and
a control unit configured to control processing of detecting information of an object on a basis of the image data obtained by decoding the coded image data, and interactive processing performed on a basis of the information of an object.

### Claim 15

(canceled)
