# US 2013/0294513 A1 · Inter layer merge list construction for video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0294513 A1
- Document ID: US20130294513A1
- Status: Published application
- Kind: A1
- Application number: 13/888,173
- Filed: 2013-05-06
- Published: 2013-11-07
- Earliest claimed: 2012-05-07
- Assignees: QUALCOMM Incorporated
- Applicants: Qualcomm Incorporated
- Inventors: Vadim SEREGIN; Xianglin WANG
- Web page: https://patentgrep.com/patent/US20130294513A1

## CPC

- H04N 19/52: by predictive encoding
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/513: Processing of motion vectors
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of decoding video data includes receiving syntax elements extracted from an encoded video bitstream, determining a candidate list for an enhancement layer block, and selectively pruning the candidate list. The syntax elements include information associated with a base layer block of a base layer of the video data. The candidate list is determined at least in part on motion information associated with the base layer block. The enhancement layer block is in an enhancement layer of the video data. The candidate list includes at least one motion information candidate that includes the motion information associated with the base layer block. The candidate list includes a merge list or an AMVP list. Pruning includes comparing one or more motion information candidates and at least one motion information candidate associated with the base layer block that is in the candidate list.

## Claims

### Claim 1

A method of decoding video data, the method comprising:
receiving syntax elements extracted from an encoded video bit stream, wherein the syntax elements comprise information associated with a base layer block of a base layer of the video data;
determining a candidate list for an enhancement layer block based at least in part on motion information associated with the base layer block, the enhancement layer block being in an enhancement layer of the video data, the candidate list including at least one motion information candidate comprising the motion information associated with the base layer block, wherein the candidate list comprises a merge list or an AMVP list; and
selectively pruning the candidate list by comparing one or more motion information candidates and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining at least one additional motion information candidate based at least in part on a motion information candidate in the candidate list and a motion information offset; and
including the at least one additional motion information candidate in the candidate list.

### Claim 3 (depends on 2)

The method of claim 2, wherein the additional motion information candidate is determined based on the first motion information candidate in the candidate list regardless of whether the first motion information candidate was derived from a collocated block in a base layer or from a spatial or temporal candidate of the enhancement layer block.

### Claim 4 (depends on 2)

The method of claim 2, wherein the additional motion information candidate is a uni-directional candidate and the offset is added to the motion information candidate on which the additional motion information candidate is based.

### Claim 5 (depends on 2)

The method of claim 2, wherein the offset is added to or subtracted from the motion information candidate on which the additional motion information candidate is based depending on: (1) Picture Order Count (POC) values of a reference frame and a current frame, (2) an inter direction type, or (3) both the POC values of the reference frame and the current frame and the inter direction type.

### Claim 6 (depends on 2)

The method of claim 2, further comprising, when the additional motion information candidate is a bi-directional candidate:
adding the offset to the motion information candidate on which the additional motion information candidate is based if both Picture Order Count (POC) values of reference frames from list L0 and L1 are smaller or greater than a current frame POC; and
subtracting the offset from the list L0 motion information candidate and adding the offset to the list L1 motion information candidate if both Picture Order Count (POC) values of reference frames from list L0 and L1 are not both smaller or both greater than a current frame POC.

### Claim 7 (depends on 2)

The method of claim 2, wherein a reference index from the motion information candidate on which the additional motion information candidate is based is used for the additional motion information candidate.

### Claim 8 (depends on 2)

The method of claim 2, further comprising generating multiple additional motion information candidates and limiting the number of multiple additional motion information candidates to a determined amount.

### Claim 9 (depends on 8)

The method of claim 8, wherein the determined amount is predetermined

### Claim 10 (depends on 8)

The method of claim 8, wherein the determined amount is 1, 2, 3 or 4.

### Claim 11 (depends on 8)

The method of claim 8, wherein the determined amount is determined based on an availability of spatial candidates.

### Claim 12 (depends on 2)

The method of claim 2, wherein the motion information candidate is a zero candidate comprising a motion vector equal to zero and a reference index equal to zero, wherein the additional motion information candidate is generated based on the zero candidate.

### Claim 13 (depends on 12)

The method of claim 12, further comprising omitting the additional motion information candidate from the candidate list if the additional motion information candidate is a same zero candidate as the motion information candidate.

### Claim 14 (depends on 1)

The method of claim 1, wherein the base layer block is collocated with the enhancement layer block.

### Claim 15 (depends on 14)

The method of claim 14, wherein the candidate list for the current block is the same as a candidate list associated with the collocated base layer block.

### Claim 16 (depends on 1)

The method of claim 1, wherein said selective pruning comprises adding an additional motion information candidate to the candidate list based on comparing the additional motion information candidate and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 17 (depends on 1)

The method of claim 1, wherein the base layer block is adjacent to or offset from a collocated block in the base layer that is collocated with the enhancement layer block.

### Claim 18

A method of encoding video data, the method comprising:
receiving information associated with a base layer block of a base layer of the video data; and
determining a candidate list for an enhancement layer block based at least in part on motion information associated with the base layer block, the enhancement layer block being in an enhancement layer of the video data, the candidate list including at least one motion information candidate comprising the motion information associated with the base layer block, wherein the candidate list comprises a merge list or an AMVP list;
selectively pruning the candidate list by comparing one or more motion information candidates and at least one motion information candidate associated with the base layer block that is in the candidate list; and
generating at least one syntax element associated with said candidate list.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
determining at least one additional motion information candidate based at least in part on a motion information candidate in the candidate list and a motion information offset; and
including the at least one additional motion information candidate in the candidate list.

### Claim 20 (depends on 19)

The method of claim 19, wherein the additional motion information candidate is determined based on the first motion information candidate in the candidate list regardless of whether the first motion information candidate was derived from a collocated block in a base layer or from a spatial or temporal candidate of the enhancement layer block.

### Claim 21 (depends on 19)

The method of claim 19, wherein the additional motion information candidate is a uni-directional candidate and the offset is added to the motion information candidate on which the additional motion information candidate is based.

### Claim 22 (depends on 19)

The method of claim 19, wherein the offset is added to or subtracted from the motion information candidate on which the additional motion information candidate is based depending on: (1) Picture Order Count (POC) values of a reference frame and a current frame, (2) an inter direction type, or (3) both the POC values of the reference frame and the current frame and the inter direction type.

### Claim 23 (depends on 19)

The method of claim 19, further comprising, when the additional motion information candidate is a bi-directional candidate:
adding the offset to the motion information candidate on which the additional motion information candidate is based if both Picture Order Count (POC) values of reference frames from list L0 and L1 are smaller or greater than a current frame POC; and
subtracting the offset from the list L0 motion information candidate and adding the offset to the list L1 motion information candidate if both Picture Order Count (POC) values of reference frames from list L0 and L1 are not both smaller or both greater than a current frame POC.

### Claim 24 (depends on 19)

The method of claim 19, wherein a reference index from the motion information candidate on which the additional motion information candidate is based is used for the additional motion information candidate.

### Claim 25 (depends on 19)

The method of claim 19, further comprising generating multiple additional motion information candidates and limiting the number of multiple additional motion information candidates to a determined amount.

### Claim 26 (depends on 25)

The method of claim 25, wherein the determined amount is predetermined

### Claim 27 (depends on 25)

The method of claim 25, wherein the determined amount is 1, 2, 3 or 4.

### Claim 28 (depends on 25)

The method of claim 25, wherein the determined amount is determined based on an availability of spatial candidates.

### Claim 29 (depends on 19)

The method of claim 19, wherein the motion information candidate is a zero candidate comprising a motion vector equal to zero and a reference index equal to zero, wherein the additional motion information candidate is generated based on the zero candidate.

### Claim 30 (depends on 29)

The method of claim 29, further comprising omitting the additional motion information candidate from the candidate list if the additional motion information candidate is a same zero candidate as the motion information candidate.

### Claim 31 (depends on 18)

The method of claim 18, wherein the base layer block is collocated with the enhancement layer block.

### Claim 32 (depends on 31)

The method of claim 31, wherein the candidate list for the current block is the same as a candidate list associated with the collocated base layer block.

### Claim 33 (depends on 18)

The method of claim 18, wherein said selective pruning comprises adding an additional motion information candidate to the candidate list based on comparing the additional motion information candidate and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 34 (depends on 18)

The method of claim 18, wherein the base layer block is adjacent to or offset from a collocated block in the base layer that is collocated with the enhancement layer block.

### Claim 35

An apparatus configured to code video data, the apparatus comprising:
a memory configured to store video data, the video data comprising a base layer block of a base layer; and
a processor in communication with the memory, the processor configured to:
determine a candidate list for an enhancement layer block based at least in part on motion information associated with the base layer block, the enhancement layer block being in an enhancement layer of the video data, the candidate list including at least one motion information candidate comprising the motion information associated with the base layer block, wherein the candidate list comprises a merge list or an AMVP list; and
selectively prune the candidate list by comparing one or more motion information candidates and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 36 (depends on 35)

The apparatus of claim 35, wherein the processor is further configured to:
determine at least one additional motion information candidate based at least in part on a motion information candidate in the candidate list and a motion information offset; and
include the at least one additional motion information candidate in the candidate list.

### Claim 37 (depends on 36)

The apparatus of claim 36, wherein the processor is further configured to determine the additional motion information candidate based on the first motion information candidate in the candidate list regardless of whether the first motion information candidate was derived from a collocated block in a base layer or from a spatial or temporal candidate of the enhancement layer block.

### Claim 38 (depends on 36)

The apparatus of claim 36, wherein the additional motion information candidate is a uni-directional candidate and wherein the processor is further configured to add the offset to the motion information candidate on which the additional motion information candidate is based.

### Claim 39 (depends on 36)

The apparatus of claim 36, wherein the processor is further configured to add the offset to or subtract the offset from the motion information candidate on which the additional motion information candidate is based depending on: (1) Picture Order Count (POC) values of a reference frame and a current frame, (2) an inter direction type, or (3) both the POC values of the reference frame and the current frame and the inter direction type.

### Claim 40 (depends on 36)

The apparatus of claim 36, wherein the processor is further configured to, when the additional motion information candidate is a bi-directional candidate:
add the offset to the motion information candidate on which the additional motion information candidate is based if both Picture Order Count (POC) values of reference frames from list L0 and L1 are smaller or greater than a current frame POC; and
subtract the offset from the list L0 motion information candidate and adding the offset to the list L1 motion information candidate if both Picture Order Count (POC) values of reference frames from list L0 and L1 are not both smaller or both greater than a current frame POC.

### Claim 41 (depends on 36)

The apparatus of claim 36, wherein the processor is further configured to use a reference index from the motion information candidate on which the additional motion information candidate is based for the additional motion information candidate.

### Claim 42 (depends on 36)

The apparatus of claim 36, wherein the processor is further configured to generate multiple additional motion information candidates and limit the number of multiple additional motion information candidates to a determined amount.

### Claim 43 (depends on 42)

The apparatus of claim 42, wherein the determined amount is predetermined

### Claim 44 (depends on 42)

The apparatus of claim 42, wherein the determined amount is 1, 2, 3 or 4.

### Claim 45 (depends on 42)

The apparatus of claim 42, wherein the determined amount is determined by the processor based on an availability of spatial candidates.

### Claim 46 (depends on 36)

The apparatus of claim 36, wherein the motion information candidate is a zero candidate comprising a motion vector equal to zero and a reference index equal to zero, wherein the processor is further configured to generate the additional motion information candidate based on the zero candidate.

### Claim 47 (depends on 46)

The apparatus of claim 46, wherein the processor is further configured to omit the additional motion information candidate from the candidate list if the additional motion information candidate is a same zero candidate as the motion information candidate.

### Claim 48 (depends on 35)

The apparatus of claim 35, wherein the base layer block is collocated with the enhancement layer block.

### Claim 49 (depends on 48)

The apparatus of claim 48, wherein the candidate list for the current block is the same as a candidate list associated with the collocated base layer block.

### Claim 50 (depends on 35)

The apparatus of claim 35, wherein the processor is configured to selective prune by adding an additional motion information candidate to the candidate list based on comparing the additional motion information candidate and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 51 (depends on 35)

The apparatus of claim 35, wherein the base layer block is adjacent to or offset from a collocated block in the base layer that is collocated with the enhancement layer block.

### Claim 52 (depends on 35)

The apparatus of claim 35, wherein the apparatus is configured to encode the video information.

### Claim 53 (depends on 35)

The apparatus of claim 35, wherein the apparatus is configured to decode the video information.

### Claim 54

A video coding apparatus, comprising:
means for processing one or more syntax elements associated with a video bit stream, wherein the one or more syntax elements comprise information associated with a base layer block of a base layer of the video data;
means for determining a candidate list for an enhancement layer block based at least in part on motion information associated with the base layer block, the enhancement layer block being in an enhancement layer of the video data, the candidate list including at least one motion information candidate comprising the motion information associated with the base layer block, wherein the candidate list comprises a merge list or an AMVP list; and
means for pruning the candidate list by comparing one or more motion information candidates and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 55 (depends on 54)

The video coding apparatus of claim 54, further comprising:
means for determining at least one additional motion information candidate based at least in part on a motion information candidate in the candidate list and a motion information offset; and
means for including the at least one additional motion information candidate in the candidate list.

### Claim 56 (depends on 55)

The video coding apparatus of claim 55, wherein the means for determining the at least one additional motion information candidate comprises means for determining the at least one additional motion information candidate based on the first motion information candidate in the candidate list regardless of whether the first motion information candidate was derived from a collocated block in a base layer or from a spatial or temporal candidate of the enhancement layer block.

### Claim 57 (depends on 55)

The video coding apparatus of claim 55, wherein the additional motion information candidate is a uni-directional candidate and further comprising means for adding the offset to the motion information candidate on which the additional motion information candidate is based.

### Claim 58 (depends on 55)

The video coding apparatus of claim 55, further comprising means for adding the offset to or subtracting the offset from the motion information candidate on which the additional motion information candidate is based depending on: (1) Picture Order Count (POC) values of a reference frame and a current frame, (2) an inter direction type, or (3) both the POC values of the reference frame and the current frame and the inter direction type.

### Claim 59 (depends on 55)

The video coding apparatus of claim 55, further comprising, when the additional motion information candidate is a bi-directional candidate:
means for adding the offset to the motion information candidate on which the additional motion information candidate is based if both Picture Order Count (POC) values of reference frames from list L0 and L1 are smaller or greater than a current frame POC; and
means for subtracting the offset from the list L0 motion information candidate and adding the offset to the list L1 motion information candidate if both Picture Order Count (POC) values of reference frames from list L0 and L1 are not both smaller or both greater than a current frame POC.

### Claim 60 (depends on 55)

The video coding apparatus of claim 55, wherein the motion information candidate is a zero candidate comprising a motion vector equal to zero and a reference index equal to zero, further comprising means for generating the additional motion information candidate based on the zero candidate.

### Claim 61 (depends on 54)

The video coding apparatus of claim 54, wherein said means for selective pruning comprises means for adding an additional motion information candidate to the candidate list based on comparing the additional motion information candidate and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 62 (depends on 54)

The video coding apparatus of claim 54, wherein the base layer block is collocated with the enhancement layer block, adjacent to or offset from a collocated block in the base layer that is collocated with the enhancement layer block.

### Claim 63

A non-transitory computer readable medium having stored thereon code that when executed causes an apparatus to:
determine a candidate list for an enhancement layer block based at least in part on motion information associated with the base layer block, the enhancement layer block being in an enhancement layer of the video data, the candidate list including at least one motion information candidate comprising the motion information associated with the base layer block, wherein the candidate list comprises a merge list or an AMVP list; and
prune the candidate list by comparing one or more motion information candidates and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 64 (depends on 63)

The non-transitory computer readable medium of claim 63, further comprising code that when executed causes the apparatus to:
determine at least one additional motion information candidate based at least in part on a motion information candidate in the candidate list and a motion information offset; and
include the at least one additional motion information candidate in the candidate list.

### Claim 65 (depends on 64)

The non-transitory computer readable medium of claim 64, further comprising code that when executed causes the apparatus to determine the at least one additional motion information candidate by determining the at least one additional motion information candidate based on the first motion information candidate in the candidate list regardless of whether the first motion information candidate was derived from a collocated block in a base layer or from a spatial or temporal candidate of the enhancement layer block.

### Claim 66 (depends on 64)

The non-transitory computer readable medium of claim 64, further comprising code that when executed causes the apparatus to, when the additional motion information candidate is a uni-directional candidate, add the offset to the motion information candidate on which the additional motion information candidate is based.

### Claim 67 (depends on 64)

The non-transitory computer readable medium of claim 64, further comprising code that when executed causes the apparatus to add the offset to or subtract the offset from the motion information candidate on which the additional motion information candidate is based depending on: (1) Picture Order Count (POC) values of a reference frame and a current frame, (2) an inter direction type, or (3) both the POC values of the reference frame and the current frame and the inter direction type.

### Claim 68 (depends on 64)

The non-transitory computer readable medium of claim 64, further comprising code that when executed causes the apparatus to, when the additional motion information candidate is a bi-directional candidate:
add the offset to the motion information candidate on which the additional motion information candidate is based if both Picture Order Count (POC) values of reference frames from list L0 and L1 are smaller or greater than a current frame POC; and
subtract the offset from the list L0 motion information candidate and adding the offset to the list L1 motion information candidate if both Picture Order Count (POC) values of reference frames from list L0 and L1 are not both smaller or both greater than a current frame POC.

### Claim 69 (depends on 64)

The non-transitory computer readable medium of claim 64, wherein the motion information candidate is a zero candidate comprising a motion vector equal to zero and a reference index equal to zero, further comprising code that when executed causes the apparatus to generate the additional motion information candidate based on the zero candidate.

### Claim 70 (depends on 63)

The non-transitory computer readable medium of claim 63, wherein said code that causes said selective pruning comprises code that causes the apparatus to add an additional motion information candidate to the candidate list based on comparing the additional motion information candidate and at least one motion information candidate associated with the base layer block that is in the candidate list.

### Claim 71 (depends on 63)

The non-transitory computer readable medium of claim 63, wherein the base layer block is collocated with the enhancement layer block, adjacent to or offset from a collocated block in the base layer that is collocated with the enhancement layer block.
