# US 12,113,998 B2 · No reference image quality assessment based decoder side intra prediction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,113,998 B2
- Document ID: US12113998B2
- Status: Granted
- Kind: B2
- Application number: 17/525,606
- Filed: 2021-11-12
- Published: 2022-05-19
- Granted: 2024-10-08
- Earliest claimed: 2020-11-13
- Assignees: Ofinno, LLC
- Applicants: Ofinno, LLC
- Inventors: Tae Meon Bae; Esmael Hejazi Dinan; Kalyan Goswami
- Web page: https://patentgrep.com/patent/US12113998B2

## CPC

- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/18: the unit being a set of transform coefficients
- H04N 19/463: by compressing encoding parameters before transmission
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A decoder may receive, for a block, an indication of decoder-side-prediction and a reconstructed residual block from a bit stream. The decoder may generate, for each respective intra prediction mode of a plurality of intra prediction modes, a reconstructed block based on: a prediction block generated for the respective intra prediction mode; and the reconstructed residual block. The decoder may determine a selected prediction mode, from the plurality of intra prediction modes, for the block based on a visual quality of each of the reconstructed blocks. The decoder may decode the block based on the indication of the decoder-side-prediction and the selected prediction mode.

## Claims

### Claim 1

A method comprising:
receiving, by a decoder, from a bitstream for a block:
an indication of decoder-side-prediction of an intra prediction mode, wherein a first value of the indication indicates that the intra prediction mode is to be determined by the decoder and a second value of the indication indicates that the intra prediction mode is to be determined from the bitstream; and
a reconstructed residual block;
based on the indication having the first value,
generating, by the decoder, a plurality of reconstructed blocks for a plurality of intra prediction modes, wherein each reconstructed block of the plurality of reconstructed blocks is generated based on:
a prediction block generated for a respective intra prediction mode of the plurality of intra prediction modes; and
the reconstructed residual block;
selecting, by the decoder, a prediction mode, from the plurality of intra prediction modes, as the intra prediction mode of the block based on
a visual quality of each of the plurality of reconstructed blocks; and
decoding, by the decoder, the block based on the intra prediction mode.

### Claim 2 (depends on 1)

The method of claim 1, wherein the receiving comprises:
receiving transform coefficients from the bitstream; and
decoding the transform coefficients to generate the reconstructed residual block.

### Claim 3 (depends on 2)

The method of claim 2, wherein the decoding the transform coefficients to generate the reconstructed residual block comprises:
de-quantizing the transform coefficients; and
inverse transforming the de-quantized transform coefficients.

### Claim 4 (depends on 1)

The method of claim 1, wherein the prediction mode for the block is selected further based on the visual quality, among the visual qualities of the reconstructed blocks, with a highest visual quality.

### Claim 5 (depends on 1)

The method of claim 1, wherein the visual quality of each of the reconstructed blocks is determined without using the block as a reference.

### Claim 6 (depends on 1)

The method of claim 1, wherein the reconstructed block, generated for each respective intra prediction mode of the plurality of intra prediction modes, is generated by summing the prediction block generated for the respective intra prediction mode and the reconstructed residual block.

### Claim 7 (depends on 1)

The method of claim 1, wherein the visual quality of each of the reconstructed blocks is determined based on a visual parameter measurement index.

### Claim 8 (depends on 1)

The method of claim 1, wherein the visual quality of each of the reconstructed blocks is determined based on a deep Learning for Blind Image Quality Assessment.

### Claim 9

A decoder comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the decoder to:
receive, from a bitstream for a block:
an indication of decoder-side-prediction of an intra prediction mode, wherein a first value of the indication indicates that the intra prediction mode is to be determined by the decoder and a second value of the indication indicates that the intra prediction mode is to be determined from the bitstream; and
a reconstructed residual block;
based on the indication having the first value,
generate a plurality of reconstructed blocks for a plurality of intra prediction modes, wherein each reconstructed block of the plurality of reconstructed blocks is generated based on:
a prediction block generated for a respective intra prediction mode of the plurality of intra prediction modes; and
the reconstructed residual block;
select, by the decoder, a prediction mode, from the plurality of intra prediction modes, as the intra prediction mode of the block based on
a visual quality of each of the plurality of reconstructed blocks; and
decode the block based on the intra prediction mode.

### Claim 10 (depends on 9)

The decoder of claim 9, wherein to receive the reconstructed residual block, the decoder is further caused to:
receive transform coefficients from the bitstream; and
decode the transform coefficients to generate the reconstructed residual block.

### Claim 11 (depends on 10)

The decoder of claim 10, wherein to decode the transform coefficients, the decoder is further caused to:
de-quantize the transform coefficients; and
inverse transform the de-quantized transform coefficients.

### Claim 12 (depends on 9)

The decoder of claim 9, wherein the prediction mode for the block is selected further based on the visual quality, among the visual qualities of the reconstructed blocks, with a highest visual quality.

### Claim 13 (depends on 9)

The decoder of claim 9, wherein the visual quality of each of the reconstructed blocks is determined without using the block as a reference.

### Claim 14 (depends on 9)

The decoder of claim 9, wherein the reconstructed block, generated for each respective intra prediction mode of the plurality of intra prediction modes, is generated by summing the prediction block generated for the respective intra prediction mode and the reconstructed residual block.

### Claim 15 (depends on 9)

The decoder of claim 9, wherein the visual quality of each of the reconstructed blocks is determined based on a visual parameter measurement index.

### Claim 16 (depends on 9)

The decoder of claim 9, wherein the visual quality of each of the reconstructed blocks is determined based on a deep Learning for Blind Image Quality Assessment.

### Claim 17

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a decoder, cause the decoder to:
receive, from a bitstream for a block:
an indication of decoder-side-prediction of an intra prediction mode, wherein a first value of the indication indicates that the intra prediction mode is to be determined by the decoder and a second value of the indication indicates that the intra prediction mode is to be determined from the bitstream; and
a reconstructed residual block;
based on the indication having the first value,
generate a plurality of reconstructed blocks for a plurality of intra prediction modes, wherein each reconstructed block of the plurality of reconstructed blocks is generated based on:
a prediction block generated for a respective intra prediction mode of the plurality of intra prediction modes; and
the reconstructed residual block;
select a prediction mode, from the plurality of intra prediction modes, as the intra prediction mode of the block based on
a visual quality of each of the plurality of reconstructed blocks; and
decode the block based on the intra prediction mode.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the prediction mode for the block is selected further based on the visual quality, among the visual qualities of the reconstructed blocks, with a highest visual quality.

### Claim 19 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the visual quality of each of the reconstructed blocks is determined without using the block as a reference.

### Claim 20 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the reconstructed block, generated for each respective intra prediction mode of the plurality of intra prediction modes, is generated by summing the prediction block generated for the respective intra prediction mode and the reconstructed residual block.