# US 10,771,791 B2 · View-independent decoding for omnidirectional video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,771,791 B2
- Document ID: US10771791B2
- Status: Granted
- Kind: B2
- Application number: 15/671,070
- Filed: 2017-08-07
- Published: 2018-02-08
- Granted: 2020-09-08
- Earliest claimed: 2016-08-08
- Assignees: Mediatek Inc.
- Applicants: MediaTek Inc.
- Inventors: Jian-Liang Lin; Hung-Chih Lin; Shen-Kai Chang
- Web page: https://patentgrep.com/patent/US10771791B2

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/426: using memory downsizing methods
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/52: by predictive encoding
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20108: Interactive selection of 2D slice in a 3D data set
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

For omnidirectional video such as 360-degree Virtual Reality (360VR) video, a video system that support independent decoding of different views of the omnidirectional video is provided. A decoder for such a system can extract a specified part of a bitstream to decode a desired perspective/face/view of an omnidirectional image without decoding the entire image while suffering minimal or no loss in coding efficiency.

## Claims

### Claim 1

A method comprising:
receiving a bitstream comprising an encoded sequence of omnidirectional images, each omnidirectional image having a plurality of views, each view having a set of view-specific data for decoding the view;
receiving a selection of a view from the plurality of views of one of the omnidirectional images in the sequence;
for the one of the omnidirectional images in the sequence, decoding the set of view-specific data of the selected view of the one of the omnidirectional images and also decoding a part of at least a first other view of the plurality of views of the one of the omnidirectional images that is adjacent to the selected view without decoding at least a second other view of the plurality of views of the one of the omnidirectional images that is not adjacent to the selected view; and
providing the selected view of the omnidirectional image based on the decoded set of view-specific data for display.

### Claim 2 (depends on 1)

The method of claim 1, wherein each view of the plurality of views is coded as a set of slices or a set of tiles.

### Claim 3 (depends on 1)

The method of claim 1, wherein the set of view-specific data of each view is independently entropy encoded, wherein encoding a set of view-specific data of a view comprises resetting an entropy coding state.

### Claim 4 (depends on 1)

The method of claim 1, wherein the set of view-specific data of the selected view has no dependency to view-specific data of another view.

### Claim 5 (depends on 1)

The method of claim 1, wherein the set of view-specific data of the selected view comprises a referential element associated with a pixel block that references data outside of the pixel block, the method further comprising modifying the referential element when the referential element references data outside of the view, wherein the modified referential element references data within the view.

### Claim 6 (depends on 5)

The method of claim 5, wherein the referential element is selected from a list of candidates comprising motion vectors associated with neighboring pixel blocks.

### Claim 7 (depends on 1)

The method of claim 1 further comprising:
when the omnidirectional image is a base layer picture in a prediction hierarchy:
decoding view-specific data of all views of the omnidirectional image; and
allowing a selection of a different view.

### Claim 8

An electronic apparatus comprising:
a video decoding circuit capable of:
receiving a bitstream comprising an encoded sequence of omnidirectional images, each omnidirectional image having a plurality of views, each view having a set of view-specific data for decoding the view;
receiving a selection of a view from the plurality of views of one of the omnidirectional images in the sequence;
for the one of the omnidirectional images in the sequence, decoding the set of view-specific data of the selected view of the one of the omnidirectional images and also decoding a part of at least a first other view of the plurality of views of the one of the omnidirectional images that is adjacent to the selected view without decoding at least a second other view of the plurality of views of the one of the omnidirectional images that is not adjacent to the selected view; and
displaying the selected view of the omnidirectional image based on the decoded set of view-specific data; and
a user interface circuit capable of providing the selection of the view.

### Claim 9 (depends on 8)

The electronic apparatus of claim 8, wherein the set of view-specific data of the selected view comprises a referential element associated with a pixel block that references data outside of the pixel block, the method further comprising modifying the referential element when the referential element references data outside of the view, wherein the modified referential element references data within the view.

### Claim 10 (depends on 8)

The electronic apparatus of claim 8, wherein the video decoder circuit is further capable of:
when the omnidirectional image is a base layer picture in a prediction hierarchy:
decoding view-specific data of all views of the omnidirectional image; and
allowing a selection of a different view.
