# US 2008/0187049 A1 · Moving image encoding device and moving image encoding method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0187049 A1
- Document ID: US20080187049A1
- Status: Published application
- Kind: A1
- Application number: 12/003,172
- Filed: 2007-12-20
- Published: 2008-08-07
- Earliest claimed: 2007-02-06
- Assignees: Oki Electronic Industry Co., Ltd.
- Inventors: Masayuki Tokumitsu; Satoshi Nakagawa
- Web page: https://patentgrep.com/patent/US20080187049A1

## CPC

- H04N 19/51: Motion estimation or motion compensation
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A moving image encoding device that encodes a difference between a predicted image and an original image is provided. The predicted image is generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image. The moving image encoding device includes an image data reduction section and a weighting estimation section. The image data reduction section reduces data volumes of the original image and the reference image while retaining characteristics of the original image and the reference image. The weighting estimation section estimates weighting parameters on the basis of image data of the original image and reference image of which the data volumes have been reduced by the image data reduction section.

## Claims

### Claim 1

A moving image encoding device that encodes a difference between a predicted image and an original image, the predicted image being generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image, and the moving image encoding device comprising:
an image data reduction section that reduces data volumes of the original image and the reference image while retaining characteristics of the original image and the reference image; and
a weighting estimation section that estimates weighting parameters on the basis of image data of the original image and reference image of which the data volumes have been reduced by the image data reduction section.

### Claim 2 (depends on 1)

The moving image encoding device of claim 1, wherein the weighting estimation section processes the image data with a least squares method.

### Claim 3 (depends on 1)

The moving image encoding device of claim 1, wherein the image data reduction section includes a thumbnail image generation section that creates a thumbnail.

### Claim 4 (depends on 1)

The moving image encoding device of claim 1, further comprising a reduction ratio adjustment section that adjusts a reduction ratio of the image data at the image data reduction section.

### Claim 5

A moving image encoding device that encodes a difference between a predicted image and an original image, the predicted image being generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image, and the moving image encoding device comprising:
an image data reduction section that reduces data volumes of the original image and the reference image while retaining characteristics of the original image and the reference image;
a weighted motion vector search section that searches for a motion vector on the basis of the original image and reference image which have been reduced by the image data reduction section;
a motion compensation section that generates a motion-compensated image using the motion vector searched for by the weighted motion vector search section and the reference image; and
a weighting estimation section that estimates weighting parameters from the motion-compensated image generated by the motion compensation section and the original image.

### Claim 6 (depends on 5)

The moving image encoding device of claim 5, wherein the motion compensation section performs processing on the basis of the original image data and reference image data which have been reduced by the image data reduction section.

### Claim 7 (depends on 5)

The moving image encoding device of claim 5, wherein the image data reduction section includes a thumbnail image generation section that creates a thumbnail.

### Claim 8 (depends on 5)

The moving image encoding device of claim 5, further comprising a reduction ratio adjustment section that adjusts a reduction ratio of the image data at the image data reduction section.

### Claim 9

A moving image encoding device that encodes a difference between a predicted image and an original image, the predicted image being generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image, and the moving image encoding device comprising:
an image data reduction section that reduces data volumes of the original image and the reference image while retaining characteristics of the original image and the reference image;
a first weighting estimation section that estimates weighting parameters on the basis of image data of the original image and reference image of which the data volumes have been reduced by the image data reduction section;
a weighted motion vector search section that searches for a motion vector on the basis of the weighting parameters estimated by the first weighting estimation section and at least one of
the original image and reference image which have been reduced by the image data reduction section and
the original image and reference image prior to being reduced;
a motion compensation section that generates a motion-compensated image using the motion vector searched for by the weighted motion vector search section and the reference image; and
a second weighting estimation section that estimates weighting parameters from the motion-compensated image generated by the motion compensation section and the original image.

### Claim 10 (depends on 9)

The moving image encoding device of claim 9, wherein the motion compensation section and the second weighting estimation section perform processing on the basis of the original image data and reference image data which have been reduced by the image data reduction section.

### Claim 11 (depends on 9)

The moving image encoding device of claim 9, wherein the image data reduction section includes a thumbnail image generation section that creates a thumbnail.

### Claim 12 (depends on 9)

The moving image encoding device of claim 9, wherein at least one of the first weighting estimation section and the second weighting estimation performs processing using a least squares method.

### Claim 13 (depends on 9)

The moving image encoding device of claim 9, further comprising a reduction ratio adjustment section that adjusts a reduction ratio of the image data at the image data reduction section.

### Claim 14 (depends on 9)

The moving image encoding device of claim 9, further comprising a motion-compensated image data reduction section that reduces a data volume while retaining characteristics of the motion-compensated image from the motion compensation section,
wherein the second weighting estimation section performs processing on the basis of image data from the motion-compensated image data reduction section and the original image data which has been reduced by the image data reduction section.

### Claim 15 (depends on 14)

The moving image encoding device of claim 14, wherein the motion-compensated image data reduction section includes a thumbnail image generation section that creates a thumbnail.

### Claim 16 (depends on 14)

The moving image encoding device of claim 14, further comprising a reduction ratio adjustment section that adjusts a reduction ratio of the image data at the motion-compensated image data reduction section.

### Claim 17

A moving image encoding device that encodes a difference between a predicted image and an original image, the predicted image being generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image, and the moving image encoding device comprising:
a weighting estimation section that finds weighting parameters from the reference image and the original image with a least squares method; and
an effectiveness judgment section that judges effectiveness of a weight and offset outputted by the weighting estimation section, using a statistical quantity generated in a process of weighting calculation processing at the weighting estimation section.

### Claim 18 (depends on 17)

The moving image encoding device of claim 17, further comprising:
at least one weighting estimation section, other than the weighting estimation section with the least squares method, that performs weighting estimation processing with at least one of the least squares method and a different method; and
a weighting parameter selection section that performs selection of an output from the plural weighting estimation sections, using a judgment result from the effectiveness judgment section.

### Claim 19

A moving image encoding method that encodes a difference between a predicted image and an original image, the predicted image being generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image, and the moving image encoding method comprising:
(a) reducing data volumes of the original image and the reference image while retaining characteristics of the original image and the reference image; and
(b) estimating weighting parameters on the basis of image data of the original image and reference image of which the data volumes have been reduced in (a).

### Claim 20 (depends on 19)

The moving image encoding method of claim 19, wherein (b) includes processing the image data with a least squares method.

### Claim 21 (depends on 19)

The moving image encoding method of claim 19, wherein (a) includes adjusting a reduction ratio of the image data in accordance with a required processing speed and accuracy.

### Claim 22 (depends on 19)

The moving image encoding method of claim 19, wherein (a) includes forming a thumbnail original image and a thumbnail reference image.

### Claim 23

A moving image encoding method that encodes a difference between a predicted image and an original image, the predicted image being generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image, and the moving image encoding method comprising:
(a) reducing data volumes of the original image and the reference image while retaining characteristics of the original image and the reference image;
(b) searching for a motion vector on the basis of the original image and reference image which have been reduced in (a);
(c) generating a motion-compensated image using the motion vector searched for in (b) and the reference image; and
(d) estimating weighting parameters from the motion-compensated image generated in (c) and the original image.

### Claim 24 (depends on 23)

The moving image encoding method of claim 23, wherein (c) includes processing on the basis of the original image data and reference image data which have been reduced in (a).

### Claim 25 (depends on 23)

The moving image encoding method of claim 23, wherein (a) includes a thumbnail image generation step that creates a thumbnail.

### Claim 26 (depends on 23)

The moving image encoding method of claim 23, wherein (a) includes a step of adjusting a reduction ratio of the image data in accordance with a required processing speed and accuracy.

### Claim 27

A moving image encoding method that encodes a difference between a predicted image and an original image, the predicted image being generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image, and the moving image encoding method comprising:
(a) reducing data volumes of the original image and the reference image while retaining characteristics of the original image and the reference image;
(b) estimating weighting parameters on the basis of image data of the original image and reference image of which the data volumes have been reduced in (a);
(c) searching for a motion vector on the basis of the weighting parameters estimated in (b) and at least one of
the original image and reference image which have been reduced in (a) and
the original image and reference image prior to being reduced;
(d) generating a motion-compensated image using the motion vector searched for in (c) and the reference image; and
(e) estimating weighting parameters from the motion-compensated image generated in
(d) and the original image.

### Claim 28 (depends on 27)

The moving image encoding method of claim 27, wherein (d) and (e) include processing on the basis of the original image data and reference image data which have been reduced in (a).

### Claim 29 (depends on 27)

The moving image encoding method of claim 27, wherein (a) includes a thumbnail image generation step that creates a thumbnail.

### Claim 30 (depends on 27)

The moving image encoding method of claim 27, wherein at least one of (b) and (e) includes processing using a least squares method.

### Claim 31 (depends on 27)

The moving image encoding method of claim 27, wherein (a) includes a step of adjusting a reduction ratio of the image data in accordance with a required processing speed and accuracy.

### Claim 32 (depends on 27)

The moving image encoding method of claim 27, further comprising
(f) reducing a data volume while retaining characteristics of the motion-compensated image from (d),
wherein (e) includes processing on the basis of image data from (f) and the original image data which has been reduced in (a).

### Claim 33 (depends on 32)

The moving image encoding method of claim 32, wherein (f) includes a thumbnail image generation step that creates a thumbnail.

### Claim 34 (depends on 32)

The moving image encoding method of claim 32, wherein (f) includes a step of adjusting a reduction ratio of the image data in accordance with a required processing speed and accuracy.

### Claim 35

A moving image encoding method that encodes a difference between a predicted image and an original image, the predicted image being generated using a weighted reference image, for which a weight is multiplied with and an offset is added to a reference image, and the moving image encoding method comprising:
(a) finding weighting parameters from the reference image and the original image with a least squares method; and
(b) judging effectiveness of a weight and offset outputted by (a), using a statistical quantity generated in a process of weighting calculation processing in (a).

### Claim 36 (depends on 35)

The moving image encoding method of claim 35, further comprising:
(c) other than (a) with the least squares method, performing at least one weighting estimation process with at least one of the least squares method and a different method; and
(d) selecting at least one output from (c), using a judgment result from (b).
