# US 2014/0192868 A1 · Inter-layer reference picture generation for hls-only scalable video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192868 A1
- Document ID: US20140192868A1
- Status: Published application
- Kind: A1
- Application number: 14/137,889
- Filed: 2013-12-20
- Published: 2014-07-10
- Earliest claimed: 2013-01-07
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Jianle Chen; Vadim Seregin; Liwei Guo; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US20140192868A1

## CPC

- H04N 19/33: in the spatial domain
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/134: characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/187: the unit being a scalable video layer
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus for coding video information may include a memory unit configured to store video information associated with a picture and a processor in communication with the memory unit configured to resample video information of a reference picture to obtain a resampled picture having a plurality of slices and a different picture size than a picture to be encoded. Further, the processor may determine slice definitions for slices in the resampled picture. The slices of the resampled picture may correspond to slices of the reference picture. The processor may determine, based on the slice definitions, whether a slice of the resampled picture satisfies one or more slice definition rules. In response to determining that the slice of the resampled picture does not satisfy at least one slice definition rule, the processor can modify the slice definition for the slice so as to satisfy the slice definition rule.

## Claims

### Claim 1

An apparatus for coding video information, the apparatus comprising:
a memory unit configured to store video information associated with a picture;
a processor in communication with the memory unit, wherein the processor is configured to:
resample video information of a reference picture to obtain a resampled picture, the reference picture having a plurality of slices and having a different picture size than a picture to be encoded;
determine slice definitions for a plurality of slices in the resampled picture, the plurality of slices of the resampled picture corresponding to a plurality of slices of the reference picture;
determine, based at least partially on the slice definitions, whether each of the plurality of slices of the resampled picture satisfies one or more slice definition rules; and
in response to determining that at least one of the plurality of slices of the resampled picture does not satisfy at least one slice definition rule, modify the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy the at least one slice definition rule so as to satisfy the slice definition rule.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to determine whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes a disparity between a height of the slice in a first column and a height of the slice in a previous column that is greater than one largest coding unit (LCU).

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to determine whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes more than one incomplete scan line.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to determine whether each of the plurality of slices in the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes a partial LCU.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the processor is further configured to modify the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy at least one slice definition rule by rounding the partial LCU.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein rounding the partial LCU comprises modifying the slice definition for at least one slice of the plurality of slices in the resampled picture that includes the partial LCU to remove the partial LCU from the slice definition.

### Claim 7 (depends on 5)

The apparatus of claim 5, wherein rounding the partial LCU comprises modifying the slice definition for at least one slice of the plurality of slices in the resampled picture that includes the partial LCU to include the entire LCU corresponding to the partial LCU in the slice definition.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to modify the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy at least one slice definition rule by dividing at least one slice of the plurality of resampled slices into multiple sub-slices.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein, for at least some sub-slices of the multiple sub-slices, the processor is further configured to associate at least some of the information included in a slice header of the at least one slice of the plurality of slices in the resampled picture with a slice header of the sub-slice.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the reference picture is a reference picture for a single layer video codec.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the processor is further configured to add the resampled picture to a reference picture list for the current picture to be encoded.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the processor is further configured to use the resampled reference picture as a collocated picture for temporal motion vector derivation.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the reference picture is a reference picture from a lower layer than the picture to be encoded in a multi-layer video codec.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the processor is further configured to use the resampled picture to perform inter layer prediction.

### Claim 15 (depends on 13)

The apparatus of claim 13, wherein the processor is further configured to add the resampled picture to a reference picture list for the picture to be encoded.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein the processor is further configured to use the reference picture as a collocated picture for temporal motion vector derivation.

### Claim 17 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to encode the picture to be encoded using the resampled picture.

### Claim 18 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to decode the picture using the resampled picture.

### Claim 19 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to associate each block in the resampled picture with a slice header of the slice which includes the collocated block in the reference picture.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the block size is 16×16.

### Claim 21 (depends on 1)

The apparatus of claim 1, further comprising one or more of a desktop computer, a notebook computers, a laptop computer, a tablet computer, a set-top box, a telephone handset, a smart phone, a smart pad, a television, a camera, a display device, a digital media player, a video gaming console, or a video streaming device.

### Claim 22

A method of coding video information, the method comprising:
resampling video information of a reference picture of a picture to be encoded to obtain a resampled picture, the reference picture having a plurality of slices and having a different picture size than the picture to be encoded;
determining slice definitions for a plurality of resampled slices in the resampled picture, the plurality of slices of the resampled picture corresponding to a plurality of slices of the reference picture;
determining, based at least partially on the slice definitions, whether each of the plurality of slices of the resampled picture satisfies one or more slice definition rules; and
in response to determining that at least one of the plurality of slices of the resampled picture does not satisfy at least one slice definition rule, modifying the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy the at least one slice definition scan rule to satisfy the at least one slice definition rule.

### Claim 23 (depends on 22)

The method of claim 22, wherein said determining comprises determining whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes a disparity between a height of the slice in a first column and a height of the slice in a previous column that is greater than one largest coding unit (LCU).

### Claim 24 (depends on 22)

The method of claim 22, wherein said determining comprises determining whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes more than one incomplete scan line.

### Claim 25 (depends on 22)

The method of claim 22, wherein said determining comprises determining whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices in the resampled picture includes a partial LCU.

### Claim 26 (depends on 25)

The method of claim 25, wherein said modifying comprises rounding the partial LCU.

### Claim 27 (depends on 26)

The method of claim 26, wherein rounding the partial LCU comprises modifying the slice definition for at least one slice of the plurality of slices in the resampled picture that includes the partial LCU to remove the partial LCU from the slice definition.

### Claim 28 (depends on 26)

The method of claim 26, wherein rounding the partial LCU comprises modifying the slice definition for at least one slice of the plurality of slices in the resampled picture that includes the partial LCU to include the entire LCU corresponding to the partial LCU in the slice definition.

### Claim 29 (depends on 22)

The method of claim 22, wherein said modifying comprises dividing at least one slice of the plurality of slices into multiple sub-slices.

### Claim 30 (depends on 29)

The method of claim 29, wherein, for at least some sub-slices of the multiple sub-slices, the method further comprises associating at least some of the information included in a slice header of the at least one slice of the plurality of slices in the resampled picture with a slice header of the sub-slice.

### Claim 31 (depends on 22)

The method of claim 22, wherein the reference picture is a reference picture for a single layer video codec.

### Claim 32 (depends on 31)

The method of claim 31, further comprising adding the resampled picture to a reference picture list for the picture to be encoded.

### Claim 33 (depends on 31)

The method of claim 31, further comprising using the resampled reference picture as a collocated picture for temporal motion vector derivation.

### Claim 34 (depends on 22)

The method of claim 22, wherein the reference picture is a reference picture from a lower layer than the picture to be encoded in a multi-layer video codec.

### Claim 35 (depends on 34)

The method of claim 34, further comprising using the resampled picture to perform inter layer prediction.

### Claim 36 (depends on 34)

The method of claim 34, further comprising adding the resampled picture to a reference picture list for the picture to be encoded.

### Claim 37 (depends on 34)

The method of claim 34, further comprising using the resampled reference picture as a collocated picture for temporal motion vector derivation.

### Claim 38 (depends on 22)

The method of claim 22, further comprising encoding the picture to be encoded using the resampled picture.

### Claim 39 (depends on 22)

The method of claim 22, further comprising decoding an encoded copy of the picture using the resampled layer.

### Claim 40 (depends on 22)

The method of claim 22, further comprising associating each block in the resampled picture with a slice header of the slice which includes the collocated block in the reference picture.

### Claim 41 (depends on 40)

The method of claim 40, wherein the block size is 16×16.

### Claim 42

Non-transitory computer-readable storage media having instructions stored thereon that when executed cause an apparatus comprising at least one processor to:
resample video information of a reference picture to obtain a resampled picture, the reference picture having a plurality of slices and having a different picture size than a picture to be encoded;
determine slice definitions for a plurality of slices in the resampled picture, the plurality of slices of the resampled picture corresponding to a plurality of slices of the reference picture;
determine, based at least partially on the slice definitions, whether each of the plurality of slices of the resampled picture satisfies one or more slice definition rules; and
in response to determining that at least one of the plurality of slices of the resampled picture does not satisfy at least one slice definition rule, modify the slice definition for at least some of the plurality of slices in the resampled picture that do not satisfy the at least one slice definition rule to satisfy the slice definition rule.

### Claim 43 (depends on 42)

The non-transitory computer readable storage medium of claim 42, wherein the apparatus is further configured to determine whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition rules by determining whether a slice from the plurality of slices of the resampled picture includes a partial LCU.

### Claim 44 (depends on 43)

The non-transitory computer readable storage medium of claim 43, wherein the apparatus is further configured to modify the slice definition for at least some of the plurality of slices of the resampled picture that do not satisfy at least one slice definition rule by modifying the slice definition for at least one slice of the plurality of slices that includes the partial block to either (1) remove the partial LCU from the slice definition; or (2) include the entire LCU corresponding to the partial LCU in the slice definition.

### Claim 45 (depends on 42)

The non-transitory computer readable storage medium of claim 42, wherein the apparatus is further configured to modify the slice definition for at least some of the plurality of slices of the resampled picture that do not satisfy at least one slice definition rule by dividing at least one slice of the plurality of slices into multiple sub-slices.

### Claim 46

An apparatus configured to code video information, the apparatus comprising:
means for storing video information associated with a picture;
means for resampling video information of the picture to obtain a resampled picture, the picture having a plurality of slices;
means for determining slice definitions for a plurality of slices of the resampled picture, the plurality of slices of the resampled picture corresponding to the plurality of slices of the picture;
means for determining, based at least partially on the slice definitions, whether each of the plurality of slices of the resampled picture satisfies one or more slice definition rules; and
means for modifying the slice definition for at least some of the plurality of slices of the resampled picture in response to determining that at least one of the plurality of slices of the resampled picture does not satisfy at least one of the one or more slice definition rules.

### Claim 47 (depends on 46)

The apparatus of claim 46, wherein at least two of the said means for storing video information, means for resampling, means for determining slice definitions, means for determining, and means for modifying comprise the same means.

### Claim 48 (depends on 46)

The apparatus of claim 46, wherein said means for determining is further configured to determine whether each of the plurality of slices of the resampled picture satisfies the one or more slice definition scan rules by determining whether a slice from the plurality of slices of the resampled picture includes a partial LCU.

### Claim 49 (depends on 48)

The apparatus of claim 48, wherein said means for modifying is further configured to modify the slice definition for at least some of the plurality of slices of the resampled picture by modifying the slice definition for at least one slice of the plurality of slices that includes the partial LCU to either (1) remove the partial LCU from the slice definition; or (2) include the entire LCU corresponding to the partial LCU in the slice definition.

### Claim 50 (depends on 46)

The apparatus of claim 46, wherein said means for modifying is further configured to modify the slice definition for at least some of the plurality of slices of the resampled layer by dividing at least one slice of the plurality of slices into multiple sub-slices.
