# US 10,484,712 B2 · Implicit coding of reference line index used in intra prediction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,484,712 B2
- Document ID: US10484712B2
- Status: Granted
- Kind: B2
- Application number: 15/616,853
- Filed: 2017-06-07
- Published: 2017-12-14
- Granted: 2019-11-19
- Earliest claimed: 2016-06-08
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Li Zhang; Xiang Li; Wei-Jung Chien; Jianle Chen; Xin Zhao; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US10484712B2

## CPC

- H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/593: involving spatial prediction techniques
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A device for decoding video data determines that a current block of video data is coded using a linear model prediction mode; for the luma component of the current block, determines reconstructed luma samples; based on luma samples in a luma component of one or more already decoded neighboring blocks and chroma samples in a chroma component of the one or more already decoded neighboring blocks, determines values for linear parameters, wherein the luma samples in the luma component of the one or more already decoded neighboring blocks comprise luma samples from a starting line in the luma component of the one or more already decoded neighboring blocks, wherein the starting line in the luma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the luma component of the current block.

## Claims

### Claim 1

A method for decoding video data, the method comprising:
determining that a current block of video data is coded using a linear model prediction mode, wherein the linear model prediction mode is used to predict a chroma component of the current block, wherein the current block comprises a luma component and at least one chroma component including the chroma component predicted using the linear model prediction mode;
determining that the luma component of the current block is coded using an intra prediction mode;
receiving a syntax element set to a value;
in response to the value of the syntax element being equal to 2, determining that a reference line index for the luma component of the current block is equal to 3, wherein the reference line index identifies a starting line in the luma component of the one or more already decoded neighboring blocks from which to intra predict luma samples for the luma component of the current block;
for the luma component of the current block, determining reconstructed luma samples from the intra predicted luma samples;
based on the reference line index being equal to 3, determining the starting line in the luma component of the one or more already decoded neighboring blocks to be used for determining the values for the linear parameters;
based on luma samples in a luma component of one or more already decoded neighboring blocks and chroma samples in a chroma component of the one or more already decoded neighboring blocks, determining values for linear parameters, wherein the luma samples in the luma component of the one or more already decoded neighboring blocks comprise luma samples from the starting line in the luma component of the one or more already decoded neighboring blocks, wherein the starting line in the luma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the luma component of the current block;
based on the linear parameters and the reconstructed luma samples, generating prediction chroma samples for the chroma component of the current block; and
reconstructing the chroma component of the current block based on the generated prediction chroma samples and received residual data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the chroma samples in the chroma component of the one or more already decoded neighboring blocks comprise chroma samples from a starting line in the chroma component of the one or more already decoded neighboring blocks, wherein the starting line in the chroma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the chroma component of the current block.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
based on the reference line index being equal to 3, determining a starting line in the chroma component of the one or more already decoded neighboring blocks to be used for determining the values for the linear parameters, wherein the starting line in the chroma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the chroma component of the current block.

### Claim 4 (depends on 1)

The method of claim 1, wherein the luma component of the one or more already decoded neighboring blocks comprises N available reference lines, wherein N is a positive integer and each of the N available reference lines has an associated reference index ranging from 0 to N−1, wherein a line closest to the border line of the luma component of the current block has a reference index equal to 0 and wherein a line furthest from the border line of the luma component of the current block has a reference index equal to N−1, wherein a reference index for the starting line in the luma component of the one or more already decoded neighboring blocks is greater than zero.

### Claim 5 (depends on 4)

The method of claim 4, wherein the chroma component of the one or more already decoded neighboring blocks comprises M reference lines, wherein M is a positive integer and each of the M reference lines has an associated reference index ranging from 0 to M−1, wherein a line closest to the border line of the chroma component of the current block has a reference index equal to 0 and wherein a line furthest from the border line of the luma component of the current block has a reference index equal to M−1.

### Claim 6 (depends on 5)

The method of claim 5, wherein the video data comprises video data with a 4:4:4 chroma subsampling format, and wherein M equals N.

### Claim 7 (depends on 5)

The method of claim 5, wherein the video data comprises video data with a 4:2:0 chroma subsampling format, and wherein M equals N/2.

### Claim 8 (depends on 1)

The method of claim 1, wherein the luma samples in the luma component of the one or more already decoded neighboring blocks comprise luma samples from more than one line of the one or more already decoded neighboring blocks.

### Claim 9 (depends on 1)

The method of claim 1, wherein the method for decoding video data is performed as part of a video encoding process.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving the video data at a receiver of a wireless communication device;
storing the video data in a memory of the wireless communication device; and
processing the video data on one or more processors of the wireless communication device.

### Claim 11 (depends on 10)

The method of claim 10, wherein the wireless communication device comprises a telephone handset and wherein receiving the video data at the receiver of the wireless communication device comprises demodulating, according to a wireless communication standard, a signal comprising the video data.

### Claim 12

A device for decoding video data, the device comprising:
one or more memory devices; and
one or more processors configured to:
determine that a current block of video data is coded using a linear model prediction mode, wherein the linear model prediction mode is used to predict a chroma component of the current block, wherein the current block comprises a luma component and at least one chroma component including the chroma component predicted using the linear model prediction mode;
determine that the luma component of the current block is coded using an intra prediction mode;
receive a syntax element set to a value;
in response to the value of the syntax element being equal to 2, determine that a reference line index for the luma component of the current block is equal to 3, wherein the reference line index identifies a starting line in the luma component of the one or more already decoded neighboring blocks from which to intra predict luma samples for the luma component of the current block;
for the luma component of the current block, determine reconstructed luma samples from the intra predicted luma samples;
based on the reference line index being equal to 3, determine the starting line in the luma component of the one or more already decoded neighboring blocks to be used for determining the values for the linear parameters;
based on luma samples in a luma component of one or more already decoded neighboring blocks and chroma samples in a chroma component of the one or more already decoded neighboring blocks, determine values for linear parameters, wherein the luma samples in the luma component of the one or more already decoded neighboring blocks comprise luma samples from the starting line in the luma component of the one or more already decoded neighboring blocks, wherein the starting line in the luma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the luma component of the current block;
based on the linear parameters and the reconstructed luma samples, generate prediction chroma samples for the chroma component of the current block; and
reconstruct the chroma component of the current block based on the generated prediction chroma samples and received residual data.

### Claim 13 (depends on 12)

The device of claim 12, wherein the chroma samples in the chroma component of the one or more already decoded neighboring blocks comprise chroma samples from a starting line in the chroma component of the one or more already decoded neighboring blocks, wherein the starting line in the chroma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the chroma component of the current block.

### Claim 14 (depends on 12)

The device of claim 12, wherein the one or more processors are further configured to:
based on the reference line index being equal to 3, determine a starting line in the chroma component of the one or more already decoded neighboring blocks to be used for determining the values for the linear parameters, wherein the starting line in the chroma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the chroma component of the current block.

### Claim 15 (depends on 12)

The device of claim 12, wherein the luma component of the one or more already decoded neighboring blocks comprises N available reference lines, wherein N is a positive integer and each of the N available reference lines has an associated reference index ranging from 0 to N−1, wherein a line closest to the border line of the luma component of the current block has a reference index equal to 0 and wherein a line furthest from the border line of the luma component of the current block has a reference index equal to N−1, wherein a reference index for the starting line in the luma component of the one or more already decoded neighboring blocks is greater than zero.

### Claim 16 (depends on 15)

The device of claim 15, wherein the chroma component of the one or more already decoded neighboring blocks comprises M reference lines, wherein M is a positive integer and each of the M reference lines has an associated reference index ranging from 0 to M−1, wherein a line closest to the border line of the chroma component of the current block has a reference index equal to 0 and wherein a line furthest from the border line of the luma component of the current block has a reference index equal to M−1.

### Claim 17 (depends on 16)

The device of claim 16, wherein the video data comprises video data with a 4:4:4 chroma subsampling format, and wherein M equals N.

### Claim 18 (depends on 16)

The device of claim 16, wherein the video data comprises video data with a 4:2:0 chroma subsampling format, and wherein M equals N/2.

### Claim 19 (depends on 12)

The device of claim 12, wherein the luma samples in the luma component of the one or more already decoded neighboring blocks comprise luma samples from more than one line of the one or more already decoded neighboring blocks.

### Claim 20 (depends on 12)

The device of claim 12, wherein the device comprises a wireless communication device, further comprising a receiver configured to receive encoded video data.

### Claim 21 (depends on 20)

The device of claim 20, wherein the wireless communication device comprises a telephone handset and wherein the receiver is configured to demodulate, according to a wireless communication standard, a signal comprising the encoded video data.

### Claim 22

A non-transitory computer-readable storage medium storing instructions that when executed cause one or more processors of a device for coding video data to:
determine that a current block of video data is coded using a linear model prediction mode, wherein the linear model prediction mode is used to predict a chroma component of the current block, wherein the current block comprises a luma component and at least one chroma component including the chroma component predicted using the linear model prediction mode;
determine that the luma component of the current block is coded using an intra prediction mode;
receive a syntax element set to a value;
in response to the value of the syntax element being equal to 2, determine that a reference line index for the luma component of the current block is equal to 3, wherein the reference line index identifies a starting line in the luma component of the one or more already decoded neighboring blocks from which to intra predict luma samples for the luma component of the current block;
for the luma component of the current block, determine reconstructed luma samples from the intra predicted luma samples;
based on the reference line index being equal to 3, determine the starting line in the luma component of the one or more already decoded neighboring blocks to be used for determining the values for the linear parameters;
based on luma samples in a luma component of one or more already decoded neighboring blocks and chroma samples in a chroma component of the one or more already decoded neighboring blocks, determine values for linear parameters, wherein the luma samples in the luma component of the one or more already decoded neighboring blocks comprise luma samples from the starting line in the luma component of the one or more already decoded neighboring blocks, wherein the starting line in the luma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the luma component of the current block;
based on the linear parameters and the reconstructed luma samples, generate prediction chroma samples for the chroma component of the current block; and
reconstruct the chroma component of the current block based on the generated prediction chroma samples and received residual data.

### Claim 23 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, wherein the chroma samples in the chroma component of the one or more already decoded neighboring blocks comprise chroma samples from a starting line in the chroma component of the one or more already decoded neighboring blocks, wherein the starting line in the chroma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the chroma component of the current block.

### Claim 24 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, wherein the one or more processors are further configured to:
based on the reference line index being equal to 3, determine a starting line in the chroma component of the one or more already decoded neighboring blocks to be used for determining the values for the linear parameters, wherein the starting line in the chroma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the chroma component of the current block.

### Claim 25 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, wherein the luma component of the one or more already decoded neighboring blocks comprises N available reference lines, wherein N is a positive integer and each of the N available reference lines has an associated reference index ranging from 0 to N−1, wherein a line closest to the border line of the luma component of the current block has a reference index equal to 0 and wherein a line furthest from the border line of the luma component of the current block has a reference index equal to N−1, wherein a reference index for the starting line in the luma component of the one or more already decoded neighboring blocks is greater than zero.

### Claim 26 (depends on 25)

The non-transitory computer-readable storage medium of claim 25, wherein the chroma component of the one or more already decoded neighboring blocks comprises M reference lines, wherein M is a positive integer and each of the M reference lines has an associated reference index ranging from 0 to M−1, wherein a line closest to the border line of the chroma component of the current block has a reference index equal to 0 and wherein a line furthest from the border line of the luma component of the current block has a reference index equal to M−1.

### Claim 27 (depends on 26)

The non-transitory computer-readable storage medium of claim 26, wherein the video data comprises video data with a 4:4:4 chroma subsampling format, and wherein M equals N.

### Claim 28 (depends on 26)

The non-transitory computer-readable storage medium of claim 26, wherein the video data comprises video data with a 4:2:0 chroma subsampling format, and wherein M equals N/2.

### Claim 29 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, wherein the luma samples in the luma component of the one or more already decoded neighboring blocks comprise luma samples from more than one line of the one or more already decoded neighboring blocks.

### Claim 30

A device for decoding video data, the device comprising:
means for determining that a current block of video data is coded using a linear model prediction mode, wherein the linear model prediction mode is used to predict a chroma component of the current block, wherein the current block comprises a luma component and at least one chroma component including the chroma component predicted using the linear model prediction mode;
means for determining that the luma component of the current block is coded using an intra prediction mode;
means for receiving a syntax element set to a value;
means for determining that a reference line index for the luma component of the current block is equal to 3 in response to the value of the syntax element being equal to 2, wherein the reference line index identifies a starting line in the luma component of the one or more already decoded neighboring blocks from which to intra predict luma samples for the luma component of the current block;
means for determing reconstructed luma samples for the luma component of the current block;
means for determining values for linear parameters based on luma samples in a luma component of one or more already decoded neighboring blocks and chroma samples in a chroma component of the one or more already decoded neighboring blocks, wherein the luma samples in the luma component of the one or more already decoded neighboring blocks comprise luma samples from the starting line in the luma component of the one or more already decoded neighboring blocks, wherein the starting line in the luma component of the one or more already decoded neighboring blocks is at least one line removed from a border line of the luma component of the current block;
means for generating prediction chroma samples for the chroma component of the current block based on the linear parameters and the reconstructed luma samples; and
means for reconstructing the chroma component of the current block based on the generated prediction chroma samples and received residual data.
