# US 2019/0246116 A1 · Extensions of motion-constrained tile sets sei message for interactivity

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246116 A1
- Document ID: US20190246116A1
- Status: Published application
- Kind: A1
- Application number: 16/386,552
- Filed: 2019-04-17
- Published: 2019-08-08
- Earliest claimed: 2013-07-15
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Cheung Auyeung; Jun Xu; Ali J Tabatabai
- Web page: https://patentgrep.com/patent/US20190246116A1

## CPC

- H04N 19/162: User input
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/172: the region being a picture, frame or field
- H04N 19/33: in the spatial domain
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An extension to the motion-constrained tile sets SEI message provides functionality to signal all tiles are independently decodable and to signal the ROIs that may have more than one tile per ROI. With this extension, the functionality to redefine any independently decodable region-of-interest in a CVS at a coding tree unit level based on user interactivity is enabled. The extension supports the interactivity utilized in various applications such as interactive Ultra High Definition Television (UHDTV), dynamic high-quality zoom-in application, interactive on-demand, e-learning, smart surveillance and many other applications. Additionally, the temporal MCTS SEI message is able to be used by an encoder for tiled streaming to signal explicitly to the decoder that the decoder need only to display the ROI.

## Claims

### Claim at position 1

1-57. (canceled)

### Claim 58

A method, comprising:
receiving a bitstream of a video, wherein the bitstream includes a motion-constrained tile sets supplemental enhancement information message, further wherein the supplemental enhancement information message comprises a flag having a value indicating one of:
a decoded value of each sample of tiles in the motion-constrained tile is not the same as a decoded value of the same sample when all coding tree blocks of a picture of the video are decoded and when the coding tree blocks that do not belong to any tile in the motion-constrained tile sets are not decoded; and
a decoded value of each sample in the tiles in the motion-constrained tile sets is the same as a decoded value of the same sample when the coding tree blocks that do not belong to any tile in the motion-constrained tile sets are not decoded; and
decoding the bitstream, based on the value of the flag of the supplemental enhancement information, to generate an image.

### Claim 59 (depends on 1)

The method of claim 1 wherein all tiles in a base layer of the video are independently decodable.

### Claim 60 (depends on 1)

The method of claim 1 wherein all tiles in an enhancement layer of the video are independently decodable.

### Claim 61 (depends on 1)

The method of claim 1 wherein a region of interest of the video is selected by a user, wherein the region of interest selected by the user is presented on the device.

### Claim 62 (depends on 1)

The method of claim 1 wherein a region of interest of the video is selected by a user, wherein the region of interest selected by the user is presented on a second device.

### Claim 63 (depends on 1)

The method of claim 1 wherein a region of interest of the video is selected by a director, wherein the region of interest selected by the director is presented on the device of a user, wherein the director is a user who controls the video and/or is able to modify the video.

### Claim 64 (depends on 1)

The method of claim 1 wherein the video is encoded with independently decodable tiles and in one or more resolution layers and stored on a server.

### Claim 65 (depends on 1)

The method of claim 1 wherein different users request different resolution layers of the video.

### Claim 66 (depends on 1)

The method of claim 1 wherein different directors request different resolution layers of the video.

### Claim 67 (depends on 1)

The method of claim 1 wherein the supplemental enhancement information message indicates coding tree blocks outside a selected region of interest, wherein the coding tree blocks outside the selected region of interest are not displayed.

### Claim 68 (depends on 1)

The method of claim 1 wherein the supplemental enhancement information message indicates coding tree blocks outside a selected region of interest, wherein the coding tree blocks outside the selected region of interest are encoded as tiles that are able to be encoded efficiently to reduce bitrate.

### Claim 69

An apparatus, comprising:
a non-transitory memory to store an application, the application to:
receive a bitstream of a video, wherein the bitstream includes a motion-constrained tile sets supplemental enhancement information message, further wherein the supplemental enhancement information message comprises a flag having a value indicating one of:
a decoded value of each sample of tiles in the motion-constrained tile is not the same as a decoded value of the same sample when all coding tree blocks of a picture of the video are decoded and when the coding tree blocks that do not belong to any tile in the motion-constrained tile sets are not decoded; and
a decoded value of each sample in the tiles in the motion-constrained tile sets is the same as a decoded value of the same sample when the coding tree blocks that do not belong to any tile in the motion-constrained tile sets are not decoded; and
decode the bitstream, based on the value of the flag of the supplemental enhancement information, to generate an image; and
a processing component coupled to the memory, the processing component configured to process the application.

### Claim 70

A system, comprising:
non-transitory memory configured to store an application, the application configured to:
receive a bitstream of a video, wherein the bitstream includes a supplemental enhancement information message, further wherein the supplemental enhancement information message comprises a flag having a value indicating one of:
a decoded value of each sample of tiles in the motion-constrained tile is not the same as a decoded value of the same sample when all coding tree blocks of a picture of the video are decoded and when the coding tree blocks that do not belong to any tile in the motion-constrained tile sets are not decoded; and
a decoded value of each sample in the tiles in the motion-constrained tile sets is the same as a decoded value of the same sample when the coding tree blocks that do not belong to any tile in the motion-constrained tile sets are not decoded; and
decode the bitstream, based on the value of the flag of the supplemental enhancement information, to generate an image; and
a display configured for display the decoded bitstream.
