# US 2003/0067979 A1 · Image processing apparatus and method, recording medium, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2003/0067979 A1
- Document ID: US20030067979A1
- Status: Published application
- Kind: A1
- Application number: 10/196,259
- Filed: 2002-07-17
- Published: 2003-04-10
- Earliest claimed: 2001-07-23
- Assignees: Sony Corporation
- Inventors: Kuniaki Takahashi; Kazushi Sato; Yoichi Yagasaki
- Web page: https://patentgrep.com/patent/US20030067979A1

## CPC

- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/124: Quantisation
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/15: by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
- H04N 19/152: by measuring the fullness of the transmission buffer
- H04N 19/172: the region being a picture, frame or field
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/18: the unit being a set of transform coefficients
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/40: using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
- H04N 19/523: with sub-pixel accuracy
- H04N 19/56: Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
- H04N 19/61: in combination with predictive coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A normalized activity calculating unit calculates a normalized activity that is calculated from luminescence component pixel values of an original image on the basis of information from an information buffer such as bit rate, an amount of bits generated in each frame, and an amount of bits generated and quantization step size in each macroblock. The normalized activity calculating unit then outputs the normalized activity to a code amount control unit. The code amount control unit calculates a quantization scale code corresponding to a target bit rate which quantization scale code matches visual characteristics, using the normalized activity inputted from the normalized activity calculating unit, and then outputs the quantization scale code to a quantizing unit. The quantizing unit quantizes discrete cosine transform coefficients inputted from a band limiting unit on the basis of the quantization scale code inputted to the quantizing unit.

## Claims

### Claim 1

An image processing apparatus for converting image data coded at a first bit rate into image data coded at a second bit rate, said image processing apparatus comprising:
first quantization scale code calculating means for calculating a first quantization scale code required to code said image data at said first bit rate on the basis of said image data coded at said first bit rate;
second quantization scale code calculating means for calculating a second quantization scale code obtained by subjecting said first quantization scale code to adaptive quantization according to visual characteristics on the basis of said image data coded at said first bit rate;
normalized activity calculating means for calculating a normalized activity on the basis of said first quantization scale code and said second quantization scale code;
third quantization scale code calculating means for calculating a third quantization scale code required to code said image data at said second bit rate; and
fourth quantization scale code calculating means for calculating a fourth quantization scale code obtained by subjecting said third quantization scale code to adaptive quantization according to visual characteristics on the basis of said third quantization scale code and said normalized activity.

### Claim 2 (depends on 1)

An image processing apparatus as claimed in claim 1,
wherein said second bit rate is lower than said first bit rate.

### Claim 3 (depends on 1)

An image processing apparatus as claimed in claim 1,
wherein said coded image data is image data compressed by an MPEG method.

### Claim 4 (depends on 1)

An image processing apparatus as claimed in claim 1,
wherein said image data coded at said first bit rate includes an amount of codes of said image data itself, an amount of bits generated in each frame, an amount of bits generated in each macroblock, and quantization step size in each macroblock.

### Claim 5 (depends on 4)

An image processing apparatus as claimed in claim 4,
wherein said first quantization scale code calculating means calculates said first quantization scale code on the basis of said amount of codes, said amount of bits generated in each frame, and said amount of bits generated in each macroblock.

### Claim 6 (depends on 4)

An image processing apparatus as claimed in claim 4,
wherein said second quantization scale code calculating means calculates said second quantization scale code obtained by subjecting said first quantization scale code to adaptive quantization according to visual characteristics by dividing said quantization step size in each macroblock by 2.

### Claim 7 (depends on 1)

An image processing apparatus as claimed in claim 1,
wherein said normalized activity calculating means calculates said normalized activity by dividing said second quantization scale code by said first quantization scale code.

### Claim 8

An image processing method of an image processing apparatus, said image processing apparatus converting image data coded at a first bit rate into image data coded at a second bit rate, said image processing method comprising:
a first quantization scale code calculating step for calculating a first quantization scale code required to code said image data at said first bit rate on the basis of said image data coded at said first bit rate;
a second quantization scale code calculating step for calculating a second quantization scale code obtained by subjecting said first quantization scale code to adaptive quantization according to visual characteristics on the basis of said image data coded at said first bit rate;
a normalized activity calculating step for calculating a normalized activity on the basis of said first quantization scale code and said second quantization scale code;
a third quantization scale code calculating step for calculating a third quantization scale code required to code said image data at said second bit rate; and
a fourth quantization scale code calculating step for calculating a fourth quantization scale code obtained by subjecting said third quantization scale code to adaptive quantization according to visual characteristics on the basis of said third quantization scale code and said normalized activity.

### Claim 9

A recording medium on which a computer readable program for controlling an image processing apparatus, said image processing apparatus converting image data coded at a first bit rate into image data coded at a second bit rate, is recorded, said program including:
a first quantization scale code calculation control step for controlling calculation of a first quantization scale code required to code said image data at said first bit rate on the basis of said image data coded at said first bit rate;
a second quantization scale code calculation control step for controlling calculation of a second quantization scale code obtained by subjecting said first quantization scale code to adaptive quantization according to visual characteristics on the basis of said image data coded at said first bit rate;
a normalized activity calculation control step for controlling calculation of a normalized activity on the basis of said first quantization scale code and said second quantization scale code;
a third quantization scale code calculation control step for controlling calculation of a third quantization scale code required to code said image data at said second bit rate; and
a fourth quantization scale code calculation control step for controlling calculation of a fourth quantization scale code obtained by subjecting said third quantization scale code to adaptive quantization according to visual characteristics on the basis of said third quantization scale code and said normalized activity.

### Claim 10

A program executed by a computer, said computer controlling an image processing apparatus, said image processing apparatus converting image data coded at a first bit rate into image data coded at a second bit rate, said program comprising:
a first quantization scale code calculation control step for controlling calculation of a first quantization scale code required to code said image data at said first bit rate on the basis of said image data coded at said first bit rate;
a second quantization scale code calculation control step for controlling calculation of a second quantization scale code obtained by subjecting said first quantization scale code to adaptive quantization according to visual characteristics on the basis of said image data coded at said first bit rate;
a normalized activity calculation control step for controlling calculation of a normalized activity on the basis of said first quantization scale code and said second quantization scale code;
a third quantization scale code calculation control step for controlling calculation of a third quantization scale code required to code said image data at said second bit rate; and
a fourth quantization scale code calculation control step for controlling calculation of a fourth quantization scale code obtained by subjecting said third quantization scale code to adaptive quantization according to visual characteristics on the basis of said third quantization scale code and said normalized activity.
