# US 2020/0267410 A1 · Image data encoding and decoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0267410 A1
- Document ID: US20200267410A1
- Status: Published application
- Kind: A1
- Application number: 16/753,139
- Filed: 2018-10-24
- Published: 2020-08-20
- Earliest claimed: 2017-10-27
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Karl James SHARMAN; Stephen Mark KEATING; Magali Kimlee Miri PHILIPPE
- Web page: https://patentgrep.com/patent/US20200267410A1

## CPC

- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/45: {performing compensation of the inverse transform mismatch, e.g. Inverse Discrete Cosine Transform [IDCT] mismatch}
- H04N 19/513: Processing of motion vectors
- H04N 19/593: involving spatial prediction techniques
- H04N 19/60: using transform coding
- H04N 19/156: Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image encoding apparatus comprises a selector configured to select, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples; an intra-image predictor configured to derive predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples; in which, for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region; a detector configured to detect whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region and, if any of the two or more parallel linear arrays of reference samples are unavailable, to inhibit selection, by the selector, of a candidate prediction operation dependent upon the unavailable reference samples.

## Claims

### Claim at position 1

1-24. (canceled)

### Claim 25

An image encoding apparatus comprising circuitry configured to:
select, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples;
derive predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples;
in which, for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region; and
detect whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region and, if any of the two or more parallel linear arrays of reference samples are unavailable, to inhibit selection, by the selector, of a candidate prediction operation dependent upon the unavailable reference samples.

### Claim 26 (depends on 25)

The apparatus according to claim 25, in which the circuitry is further configured to detect for a current region of a current image which, if any, of the two or more parallel linear arrays are available for use in prediction of samples of the current region and to allow selection as a prediction operation, by the circuitry, of a candidate prediction operation dependent upon at least one of the available parallel linear arrays.

### Claim 27 (depends on 25)

The apparatus according to claim 25, in which:
for at least some of the candidate prediction operations, the group of reference samples comprises one or more predetermined values;
the circuitry is further configured to detect for a current region of a current image if none of the two or more parallel linear arrays is available for use in prediction of samples of the current region and to allow selection as a prediction operation, by the circuitry, of a candidate prediction operation for that current region dependent upon the predetermined values as reference samples.

### Claim 28 (depends on 25)

The apparatus according to claim 25, in which the circuitry is responsive to an image location of the current region.

### Claim 29 (depends on 28)

The apparatus according to claim 28, in which the circuitry is configured to detect whether the current region is adjacent an edge of the current region such that sample locations corresponding to at least some of the two or more parallel linear arrays of reference samples lie outside the current image.

### Claim 30 (depends on 28)

The apparatus according to claim 28, in which:
the image encoding apparatus is configured to encode the current image as successive coding units of samples;
the image encoding apparatus comprises a sample store to store samples corresponding to a region of the current image other than the current region; and
the circuitry is configured to detect whether, for an image region at a location within a coding unit adjacent to a previous coding unit, any of the two or more parallel linear arrays of reference samples are held by the sample store.

### Claim 31 (depends on 25)

The apparatus according to claim 25, in which the circuitry is configured to detect, separately for reference sample positions disposed vertically or horizontally with respect to the current image region, whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region and, if any of the two or more parallel linear arrays of reference samples are unavailable for reference sample positions disposed vertically or horizontally with respect to the current image region, to inhibit selection, by the selector, of a candidate prediction operation dependent upon the unavailable reference samples.

### Claim 32 (depends on 25)

The apparatus according to claim 25, in which the circuitry is responsive to configuration data defining one or more parameters of a decoding apparatus to detect whether samples corresponding to any of the two or more parallel linear arrays of reference samples will be available for use in prediction of samples of the current region at the decoding apparatus.

### Claim 33 (depends on 25)

A video storage, capture, transmission or reception apparatus comprising the apparatus according to claim 25.

### Claim 34

An image decoding apparatus comprising circuitry configured to:
select, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples;
derive predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples;
in which, for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region; and
detect whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region and, if any of the two or more parallel linear arrays of reference samples are unavailable, to inhibit selection, by the circuitry, of a candidate prediction operation dependent upon the unavailable reference samples.

### Claim 35 (depends on 34)

The apparatus according to claim 34, in which the circuitry is further configured to detect for a current region of a current image which, if any, of the two or more parallel linear arrays are unavailable for use in prediction of samples of the current region and to allow selection as a prediction operation, by the circuitry, of a candidate prediction operation dependent upon at least one of the available parallel linear arrays.

### Claim 36 (depends on 34)

The apparatus according to claim 34, in which:
for at least some of the candidate prediction operations, the group of reference samples comprises one or more predetermined values;
the circuitry is further configured to detect for a current region of a current image if none of the two or more parallel linear arrays is available for use in prediction of samples of the current region and to allow selection as a prediction operation, by the circuitry, of a candidate prediction operation for that current region dependent upon the predetermined values as reference samples.

### Claim 37 (depends on 34)

The apparatus according to claim 34, in which the circuitry is responsive to an image location of the current region.

### Claim 38 (depends on 37)

The apparatus according to claim 37, in which the circuitry is configured to detect whether the current region is adjacent an edge of the current region such that sample locations corresponding to at least some of the two or more parallel linear arrays of reference samples lie outside the current image.

### Claim 39 (depends on 37)

The apparatus according to claim 37, in which:
the image decoding apparatus is configured to decode the current image as successive coding units of samples;
the image decoding apparatus comprises a sample store to store samples corresponding to a region of the current image other than the current region; and
the circuitry is configured to detect whether, for an image region at a location within a coding unit adjacent to a previous coding unit, any of the two or more parallel linear arrays of reference samples are held by the sample store.

### Claim 40 (depends on 34)

The apparatus according to claim 34, in which the circuitry is configured to detect, separately for reference sample positions disposed vertically or horizontally with respect to the current image region, whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region and, if any of the two or more parallel linear arrays of reference samples are unavailable for reference sample positions disposed vertically or horizontally with respect to the current image region, to inhibit selection, by the circuitry, of a candidate prediction operation dependent upon the unavailable reference samples.

### Claim 41 (depends on 34)

A video storage, capture, transmission or reception apparatus comprising the apparatus according to claim 34.

### Claim 42

An image encoding method comprising:
selecting, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples;
deriving intra-image predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples;
in which, for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region;
detecting whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region and
inhibiting selection by the selecting step, if any of the two or more parallel linear arrays of reference samples are unavailable, of a candidate prediction operation dependent upon the unavailable reference samples.

### Claim 43 (depends on 42)

A non-transitory computer readable medium including computer program instructions, which when executed by a computer, causes the computer to perform the method of claim 42.

### Claim 44

An image decoding method comprising:
selecting, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples;
deriving intra-image predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples;
in which, for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region;
detecting whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region and
inhibiting selection by the selecting step, if any of the two or more parallel linear arrays of reference samples are unavailable, of a candidate prediction operation dependent upon the unavailable reference samples.

### Claim 45 (depends on 44)

A non-transitory computer readable medium including computer program instructions, which when executed by a computer, causes the computer to perform the method of claim 44.
