# US 10,484,689 B2 · Apparatus and method for performing rate-distortion optimization based on Hadamard-quantization cost

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,484,689 B2
- Document ID: US10484689B2
- Status: Granted
- Kind: B2
- Application number: 15/015,456
- Filed: 2016-02-04
- Published: 2017-07-06
- Granted: 2019-11-19
- Earliest claimed: 2016-01-05
- Assignees: Electronics and Telecommunications Research Institute
- Applicants: Electronics and Telecommunications Research Institute
- Inventors: Jin-Wuk Seok; Myung-Seok Ki; Youn-Hee Kim; Hui-Yong Kim; Jin-Soo Choi
- Web page: https://patentgrep.com/patent/US10484689B2

## CPC

- H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567)
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/15: by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus and method perform rate-distortion optimization based on cost. The encoding apparatus selects an encoding mode to be used to encode a target block from among multiple modes and performs computation for rate-distortion optimization in the encoding mode. The encoding apparatus calculates a cost of at least one of the multiple modes in relation to the encoding of the target block, and selects the encoding mode from among the multiple modes, based on the cost.

## Claims

### Claim 1

An encoding apparatus, comprising:
a hardware processor configured to
select an encoding mode to be used to encode a target block from among multiple modes; and
perform computation for rate-distortion optimization in the encoding mode,
wherein the hardware processor calculates a rate-distortion cost of at least one of the multiple modes in relation to encoding of the target block, and selects the encoding mode from among the multiple modes, based on the cost,
the multiple modes comprise an inter mode, and
the hardware processor determines whether to perform prediction in the inter mode upon encoding the target block, based on both a level of a Hadamard value in the inter mode and a first threshold function.

### Claim 2 (depends on 1)

The encoding apparatus of claim 1, wherein the multiple modes comprise a skip mode, a merge mode, an inter mode, and an intra mode.

### Claim 3 (depends on 1)

The encoding apparatus of claim 1, wherein:
the hardware processor calculates costs of the multiple modes in relation to encoding of the target block, and
the encoding mode is a mode having a minimum cost among the multiple costs.

### Claim 4 (depends on 1)

The encoding apparatus of claim 1, wherein the cost is a similar rate-distortion cost that is a value related to rate-distortion cost when the mode is used for encoding the target block.

### Claim 5 (depends on 1)

The encoding apparatus of claim 1, wherein the cost is calculated based on a model parameter for the corresponding mode, a Hadamard value in the mode, a Lagrangian multiplier in the mode, and a number of bits occurring in the mode.

### Claim 6 (depends on 5)

The encoding apparatus of claim 5, wherein the Hadamard value is calculated based on both the target block and a prediction block for the target block.

### Claim 7 (depends on 1)

The encoding apparatus of claim 1, wherein:
the cost is a sum of a first value and a second value,
the first value is a product of a model parameter for the corresponding mode and a Hadamard value in the mode, and
the second value is a product of a Lagrangian multiplier in the mode and an estimated value of a number of bits required for description of the mode.

### Claim 8 (depends on 1)

The encoding apparatus of claim 1, wherein the cost of the mode is calculated without using a reconstructed block for the target block.

### Claim 9 (depends on 1)

The encoding apparatus of claim 1, wherein:
the multiple modes comprise a merge mode and a skip mode, and
the hardware processor determines whether the encoding mode of the target block is the skip mode, using a prediction block in the merge mode and the target block.

### Claim 10 (depends on 1)

The encoding apparatus of claim 1, wherein:
the multiple modes comprise a merge mode and a skip mode, and
the hardware processor determines the encoding mode of the target block to be the skip mode when a level of a Hadamard value in the merge mode is 0.

### Claim 11 (depends on 1)

The encoding apparatus of claim 1, wherein the hardware processor is configured to, when a level of a Hadamard value in the corresponding mode is equal to or greater than a predefined value, perform motion compensation at a depth subsequent to a current depth of the target block without performing motion compensation at the current depth.

### Claim 12

An encoding apparatus, comprising:
a hardware processor configured to
select an encoding mode to be used to encode a target block from among multiple modes; and
perform computation for rate-distortion optimization in the encoding mode,
wherein the hardware processor calculates a rate-distortion cost of at least one of the multiple modes in relation to encoding of the target block, and selects the encoding mode from among the multiple modes, based on the cost,
the multiple modes comprise a skip mode, a merge mode, an inter mode, and an intra mode,
the hardware processor sets modes such that prediction in the skip mode and in the merge mode is performed, and such that prediction of the target block in the inter mode is performed while prediction of the target block in the intra mode is omitted if a level of a Hadamard value in the inter mode is in a high cost state, and
the high cost state indicates a state in which the level of the Hadamard value in the inter mode has a value that causes prediction to be performed at a subsequent depth of the target block.

### Claim 13 (depends on 12)

The encoding apparatus of claim 12, wherein the hardware processor determines whether to perform prediction in the intra mode depending on a result of prediction in the inter mode.

### Claim 14 (depends on 12)

The encoding apparatus of claim 12, wherein the hardware processor determines whether to omit prediction in the intra mode and to perform prediction in the inter mode upon encoding the target block, based on both the level of the Hadamard value in the inter mode and a second threshold function.

### Claim 15 (depends on 1)

The encoding apparatus of claim 1, wherein:
the multiple modes comprise a merge mode and an inter mode, and
the hardware processor determines whether to perform prediction in the inter mode, using both a prediction block in the merge mode and the target block.

### Claim 16 (depends on 1)

The encoding apparatus of claim 1, wherein:
the multiple modes comprise a merge mode and an inter mode, and
the hardware processor determines whether to perform prediction in the inter mode, using both a prediction block in the merge mode and the target block if a Hadamard value in the merge mode is in a high cost state.

### Claim 17 (depends on 1)

The encoding apparatus of claim 1, wherein:
the multiple modes comprise a skip mode, a merge mode, an inter mode, and an intra mode, and
the hardware processor determines a mode in which motion compensation is to be performed, among the multiple modes, using both the target block and a prediction block for the target block if levels of Hadamard values in the multiple modes are identical to each other.

### Claim 18 (depends on 1)

The encoding apparatus of claim 1, wherein the hardware processor does not perform computation for rate-distortion optimization in modes other than a mode selected as the encoding mode, from among the multiple modes.

### Claim 19

An encoding method, comprising:
selecting an encoding mode to be used to encode a target block from among multiple modes; and
performing computation for rate-distortion optimization in the selected encoding mode,
wherein selecting the encoding mode comprises:
calculating a rate-distortion cost of at least one of the multiple modes in relation to encoding of the target block; and
selecting the encoding mode from among the multiple modes, based on the cost,
the multiple modes comprise an inter mode, and
whether to perform prediction in the inter mode upon encoding the target block is determined based on both a level of a Hadamard value in the inter mode and a first threshold function.