# US 2014/0192887 A1 · Techniques for prediction of unavailable samples in inter-layer predicted video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192887 A1
- Document ID: US20140192887A1
- Status: Published application
- Kind: A1
- Application number: 14/147,909
- Filed: 2014-01-06
- Published: 2014-07-10
- Earliest claimed: 2013-01-04
- Assignees: Vidyo, Inc.
- Applicants: Vidyo, Inc.
- Inventors: Danny Hong; Jill Boyce
- Web page: https://patentgrep.com/patent/US20140192887A1

## CPC

- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/503: involving temporal prediction (adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109)
- H04N 19/513: Processing of motion vectors
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed herein are video coding techniques for prediction of a to-be-reconstructed block from enhancement layer/view data from base layer/view data in conjunction with enhancement layer/view data, where samples that are not available in the base or enhancement layer/view, respectively, are being predicted through padding.

## Claims

### Claim 1

A method for video decoding, comprising:
decoding a first picture of a reference layer including first header information pertaining to the first picture, wherein the first header information comprises dimensions of the first picture;
decoding second header information of a second picture of an enhancement layer or view, wherein the second header information comprises the dimensions of the second picture;
decoding at least one offset indicative of the relative position of at least one sample of the second picture relative to its reference sample position in the first picture;
determining a sample location in the first picture using at least two of the first picture's dimensions, the second picture's dimensions, and at least one of the at least one offsets;
identifying at least one unavailable sample position in the first picture for which the corresponding sample location for the second picture is not within the first picture's picture dimensions;
inferring at least one property of the sample in the at least one unavailable sample position; and
decoding the second picture utilizing the at least one property of the sample in the at least one unavailable sample position for inter-layer prediction.

### Claim 2 (depends on 1)

The method of claim 1, wherein the header information of a picture of an enhancement layer or view comprises the dimensions of a cropping window.

### Claim 3 (depends on 1)

The method of claim 1, wherein the inferring comprises padding of at least one property of a sample.

### Claim 4 (depends on 3)

The method of claim 3, wherein the at least one property comprises a sample value.

### Claim 5 (depends on 3)

The method of claim 3, wherein the at least one property comprises a motion vector.

### Claim 6 (depends on 3)

The method of claim 3, wherein the at least one property comprises a coding mode.

### Claim 7 (depends on 3)

The method of claim 3, wherein the at least one property comprises an intra prediction mode comprising an intra direction.

### Claim 8 (depends on 3)

The method of claim 3, wherein the inferring involves a weighted average of at least two values of motion vectors.

### Claim 9 (depends on 3)

The method of claim 3, wherein the inferring involves a weighted average of at least two values of intra prediction directions.

### Claim 10 (depends on 3)

The method of claim 3, wherein the padding comprises copying of the at least one property from a sample of the first picture closest to the unavailable sample position in the first picture into the unavailable sample position.

### Claim 11 (depends on 1)

The method of claim 1, wherein the inferring comprises obtaining at least one property of an unavailable sample in the first picture from sample position of an available sample closest to the unavailable sample.

### Claim 12 (depends on 11)

The method of claim 11, wherein the at least one property comprises a sample value.

### Claim 13 (depends on 11)

The method of claim 11, wherein the at least one property comprises a motion vector.

### Claim 14 (depends on 11)

The method of claim 11, wherein the at least one property comprises a coding mode.

### Claim 15 (depends on 11)

The method of claim 11, wherein the at least one property comprises an intra prediction mode comprising an intra direction.

### Claim 16 (depends on 11)

The method of claim 11, wherein the inferring involves a weighted average of at least two values of motion vectors.

### Claim 17 (depends on 11)

The method of claim 11, wherein the inferring involves a weighted average of at least two values of intra prediction directions.

### Claim 18 (depends on 1)

The method of claim 1, further comprising:
determining a scaling factor between first and second picture using at least two dimension values of the first and second header information, respectively, and at least one of the at least one offsets; and
determining at least two input locations for a multi-tap upsampling filter.

### Claim 19 (depends on 18)

The method of claim 18, wherein the two or more input locations comprise at least two neighboring locations in the second picture.

### Claim 20 (depends on 19)

The method of claim 19, comprising determining at least one unavailable location of the at least two input locations for which the corresponding reference layer sample location is not within the reference layer picture dimensions.

### Claim 21 (depends on 20)

The method of claim 20, comprising applying the multi-tap upsampling filter to the two or more input locations to compute the corresponding upsampled sample.

### Claim 22 (depends on 21)

The method of claim 21, wherein the computed corresponding reference layer sample value is used for predictively decoding a sample of the enhancement layer picture.

### Claim 23

A non-transitory computer readable medium comprising a set of executable instructions to direct a processor to:
decode a first picture of a reference layer including first header information pertaining to the first picture, wherein the first header information comprises dimensions of the first picture;
decode second header information of a second picture of an enhancement layer or view, wherein the second header information comprises the dimensions of the second picture;
decode at least one offset indicative of the relative position of at least one sample of the second picture relative to its reference sample position in the first picture;
determine a sample location in the first picture using at least two of the first picture's dimensions, the second picture's dimensions, and at least one of the at least one offsets;
identify at least one unavailable sample position in the first picture for which the corresponding sample location for the second picture is not within the first picture's picture dimensions;
infer at least one property of the sample in the at least one unavailable sample position; and
decode the second picture utilizing the at least one property of the sample in the at least one unavailable sample position for inter-layer prediction.

### Claim 24

A system for video decoding, comprising:
a processor; and
a non-transitory computer readable medium embodying software that is configured when executed by the processor to:
decode a first picture of a reference layer including first header information pertaining to the first picture, wherein the first header information comprises dimensions of the first picture;
decode second header information of a second picture of an enhancement layer or view, wherein the second header information comprises the dimensions of the second picture;
decode at least one offset indicative of the relative position of at least one sample of the second picture relative to its reference sample position in the first picture;
determine a sample location in the first picture using at least two of the first picture's dimensions, the second picture's dimensions, and at least one of the at least one offsets;
identify at least one unavailable sample position in the first picture for which the corresponding sample location for the second picture is not within the first picture's picture dimensions;
infer at least one property of the sample in the at least one unavailable sample position; and
decode the second picture utilizing the at least one property of the sample in the at least one unavailable sample position for inter-layer prediction.
