# US 9,438,882 B2 · Method for image prediction of multi-view video codec and computer readable recording medium therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,438,882 B2
- Document ID: US9438882B2
- Status: Granted
- Kind: B2
- Application number: 14/460,945
- Filed: 2014-08-15
- Published: 2014-12-04
- Granted: 2016-09-06
- Earliest claimed: 2007-01-11
- Assignees: Korea Electronics Technology Institute
- Applicants: Korea Electronics Technology Institute
- Inventors: Ji-Ho Park; Byeong-Ho Choi; Yong-Hwan Kim; Je-Woo Kim; Hwa-Seon Shin; Yo-Sung Ho
- Web page: https://patentgrep.com/patent/US9438882B2

## CPC

- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/50: using predictive coding (H04N19/61 takes precedence)
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/61: in combination with predictive coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided are a method for image prediction of a multi-view video codec capable of improving coding efficiency, and a computer readable recording medium therefor. The method for image prediction of a multi-view video codec includes partitioning an image to a plurality of base blocks, acquiring information of reference images which are temporally different, acquiring information of reference images which have different views, and predicting a target block based on the acquired information. Accordingly, an image that is most similar to an image of a view to be currently compressed is generated using multiple images of different views, so that coding efficiency can be improved.

## Claims

### Claim 1

A method for image prediction of a multi-view video codec, which encodes multi-view images comprising a base-view image and at least one different-view image which is captured from a different viewpoint from a viewpoint capturing the base-view image, the base-view image and the different-view image being captured at a same time, the method comprising:
partitioning the base-view image into a plurality of base blocks;
predicting a base block among the base blocks based on the different-view image and a different-time image Which is captured at a time different from a time when the base-view image is captured, the base-view image and the different-time image being captured from a same viewpoint;
acquiring a difference between a prediction result of the base block and the base block, and encoding the difference; and
generating a bitstream comprising the encoded difference,
wherein the predicting the base block comprises using at least one of a first residual adjusted using a second residual and the second residual adjusted using the first residual, and
wherein the first residual is a difference between the base-view image and the different-time image, and the second residual is a difference between the base-view image and the different-view image.

### Claim 2 (depends on 1)

The method of claim 1, wherein information about the first residual and the second residual is contained in a macroblock layer or a higher layer than the macroblock layer.

### Claim 3 (depends on 2)

The method of claim 2, wherein the higher layer than the macroblock layer is a slice header extension (SHE), a picture parameter set extension (PPSE), or a sequence parameter set extension (SPSE).

### Claim 4 (depends on 1)

The method of claim 1, wherein the adjusted first residual is a result of adding the second residual to the first residual or subtracting the second residual from the first residual, and the adjusted second residual is a result of adding the first residual to the second residual or subtracting the first residual from the second residual.

### Claim 5 (depends on 1)

The method of claim 1, wherein the predicting the base block based on the different-view image comprises performing weighted prediction by applying a weighting value to at least one of the base-view image and the different-view image.

### Claim 6 (depends on 5)

The method of claim 5, wherein the generating the bitstream comprises including the weighting value in the bitstream.

### Claim 7 (depends on 5)

The method of claim 5, wherein in the predicting the base block, a same weighting value is applied to both the base-view image and the different-view image.

### Claim 8 (depends on 5)

The method of claim 5, wherein in the predicting the base block, different weighting values are applied to the base-view image and the different-view image, respectively.

### Claim 9 (depends on 5)

The method of claim 5, wherein the generating the bitstream comprises including information about the weighted prediction in the bitstream.

### Claim 10 (depends on 1)

The method of claim 1, wherein the different-time image is an image which is the most similar to the base-view image among a plurality of different-time images with respect to the base-view image, and the different-view image is an image which is the most-similar to the base-view image among a plurality of different-view images with respect to the base-view image.

### Claim 11

A non-transitory computer-readable recording medium storing a program for executing a method for image prediction of a multi-view video codec, which encodes multi-view images comprising a base-view image and at least one different-view image which is captured from a different viewpoint from a viewpoint capturing the base-view image, the base-view image and the different-view image being captured at a same time, the method comprising:
partitioning the base view image into a plurality of base blocks;
predicting a base block among the base blocks based on the different-view image and a different-time image which is captured at a time different from a time when the base view image is captured, the base view image and the different-time image being captured from a same viewpoint;
acquiring a difference between a prediction result of the base block and the base block, and encoding the difference; and
generating a bitstream comprising the encoded difference,
wherein the predicting the base block comprises using at least one of a first residual adjusted using a second residual and a second residual adjusted using the first residual, and
wherein the first residual is a difference between the base-view image and the different-time image, and the second residual is a difference between the base-view image and the different-view image.

### Claim 12

A method for image prediction of a multi-view video codec, which encodes multi-view images comprising a base-view image and at least one different-view image which is captured from a different viewpoint from a viewpoint capturing the base-view image, the base-view image and the different-view image being captured at a same time, the method comprising:
partitioning the base-view image into a plurality of base blocks;
predicting a base block among the base blocks based on the different-view image or a different-time image which is captured at a time different from a time when the base-view image is captured, the base-view image and the different-time image being captured from a same viewpoint;
acquiring a difference between a prediction result of the base block and the base block, and encoding the difference; and
generating a bitstream comprising the encoded difference,
wherein in case where the base block is predicted by using the different-view image, the predicting the base block comprises performing weighted prediction by applying at least one weighting value to the base-view image and the different-view image.

### Claim 13 (depends on 12)

The method of claim 12, wherein the generating the bitstream comprises including the weighting value in the bitstream.

### Claim 14 (depends on 12)

The method of claim 12, wherein in case where the base block is predicted by using the different-view image, a same weighting value is applied to both the base-view image and the different-view image.

### Claim 15 (depends on 12)

The method of claim 12, wherein in case where the base block is predicted by using the different-view image, different weighting values are applied to the base-view image and the different-view image, respectively.

### Claim 16 (depends on 12)

The method of claim 12, wherein in case where the base block is predicted by using the different-view image, the generating the bitstream comprises of including information about the weighted prediction in the bitstream.

### Claim 17 (depends on 12)

The method of claim 12, wherein the different-time image is an image which is the most similar to the base-view image among a plurality of different-time images with respect to the base-view image, and the different-view image is an image which is the most-similar to the base-view image among a plurality of different-view images with respect to the base-view image.
