# US 10,375,402 B2 · Image encoding apparatus and method, and image encoding program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,402 B2
- Document ID: US10375402B2
- Status: Granted
- Kind: B2
- Application number: 14/903,132
- Filed: 2014-07-22
- Published: 2016-06-02
- Granted: 2019-08-06
- Earliest claimed: 2013-07-25
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Tokinobu Mitasaki; Naoki Ono; Atsushi Shimizu
- Web page: https://patentgrep.com/patent/US10375402B2

## CPC

- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/122: Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/52: by predictive encoding
- H04N 19/61: in combination with predictive coding
- H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image encoding method that encodes an image so as to optimize estimated values of processing units which are a coding unit, a prediction unit, and a transform unit by selecting sizes of the individual processing units. The method includes a division step that divides an image having a size of the coding unit into a plurality of blocks; an activity computation step that computes activities pertaining to the individual blocks; and a transform unit size determination step that determines, based on the computed activities, a size pattern of the transform unit within the image having the size of the coding unit.

## Claims

### Claim 1

An image encoding apparatus that encodes an image so as to optimize estimated values of processing units which are a coding unit, a prediction unit, and a transform unit by selecting sizes of the individual processing units, the apparatus comprising:
a division device that divides a coding unit included in the image into four divided blocks having a block size;
an activity computation device that computes activities pertaining to the four divided blocks; and
a transform unit size determination device that determines, based on the computed activities, a size pattern of the transform unit within the image having the size of the coding unit,
wherein the transform unit size determination device
determines whether any one of the four divided blocks has an adjacent block which produces an activity difference smaller than or equal to a predetermined threshold,
when any one of the four divided blocks has the adjacent block, determines the block size of the four divided blocks as the size pattern of the transform unit, and
when none of the four divided blocks has the adjacent block, determines a smaller block size as the size pattern of the transform unit, the small block size being obtained by dividing the block size of the four divided blocks.

### Claim 2

An image encoding apparatus that encodes an image so as to optimize estimated values of processing units which are a coding unit, a prediction unit, and a transform unit by selecting sizes of the individual processing units, the apparatus comprising:
a division device that divides an image having a size of the coding unit into a plurality of blocks;
a motion information computation device that computes motion information which indicates a motion state of each of the blocks by utilizing a numeric value:
a transform unit size determination device that determines, based on the computed motion information, a size pattern of the transform unit within the image having the size of the coding unit,
wherein the motion information computation device computes, for each of the blocks, motion information items of any two blocks adjacent to the relevant block, where the two blocks each have a size smaller than or equal to the size of the relevant block; and
if a difference between the two motion information items of the two blocks adjacent to the relevant block is smaller than or equal to a predetermined threshold, the transform unit size determination device determines the size of the transform unit in the relevant block to be a block size of the relevant block, otherwise the relevant block is further divided into small blocks, and the transform unit size determination device determines the size pattern of the transform unit by repeatedly subjecting, a predetermined number of times, each of the small blocks to the motion information acquisition of the adjacent blocks and the comparison between the difference of the relevant motion information items and the threshold.

### Claim 3

An image encoding method that encodes an image so as to optimize estimated values of processing units which are a coding unit, a prediction unit, and a transform unit by selecting sizes of the individual processing units, the method comprising:
a division step that divides a coding unit included in the image into four divided blocks having a block size;
an activity computation step that computes activities pertaining to the four divided blocks; and
a transform unit size determination step that determines, based on the computed activities, a size pattern of the transform unit within the image having the size of the coding unit,
wherein the transform unit size determination step including:
determining whether any one of the four divided blocks has an adjacent block which produces an activity difference smaller than or equal to a predetermined threshold;
when any one of the four divided blocks has the adjacent block, determining the block size of the four divided blocks as the size pattern of the transform unit; and
when none of the four divided blocks has the adjacent block, and determining a smaller block size as the size pattern of the transform unit, the smaller block size being obtained by dividing the block size of the four divided blocks.

### Claim 4 (depends on 3)

A non-transitory computer-readable recoding medium having an image encoding program by which a computer executes the image encoding method in accordance with claim 3.

### Claim 5

An image encoding method that encodes an image so as to optimize estimated values of processing units which are a coding unit, a prediction unit, and a transform unit by selecting sizes of the individual processing units, the method comprising:
a division step that divides an image having a size of the coding unit into a plurality of blocks;
a motion information computation step that computes motion information which indicates a motion state of each of the blocks by utilizing a numeric value:
a transform unit size determination step that determines, based on the computed motion information, a size pattern of the transform unit within the image having the size of the coding unit,
wherein the motion information computation step computes, for each of the blocks, motion information items of any two blocks adjacent to the relevant block, where the two blocks each have a size smaller than or equal to the size of the relevant block; and
if a difference between the two motion information items of the two blocks adjacent to the relevant block is smaller than or equal to a predetermined threshold, the transform unit size determination step determines the size of the transform unit in the relevant block to be a block size of the relevant block, otherwise the relevant block is further divided into small blocks, and the transform unit size determination step determines the size pattern of the transform unit by repeatedly subjecting, a predetermined number of times, each of the small blocks to the motion information acquisition of the adjacent blocks and the comparison between the difference of the relevant motion information items and the threshold.

### Claim 6 (depends on 5)

A non-transitory computer-readable recoding medium having an image encoding program by which a computer executes the image encoding method in accordance with claim 5.