# US 2001/0043654 A1 · Circuitry and apparatus for converting a decoded image with a macroblock/raster scan conversion capability

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0043654 A1
- Document ID: US20010043654A1
- Status: Published application
- Kind: A1
- Application number: 09/167,992
- Filed: 1998-10-08
- Published: 2001-11-22
- Earliest claimed: 1997-10-31
- Assignees: Oki Electric Industry Co., Ltd.
- Inventors: MASATO YAMAZAKI
- Web page: https://patentgrep.com/patent/US20010043654A1

## CPC

- H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
- H04N 19/42: characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation (H04N19/635 takes precedence)
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/427: {Display on the fly, e.g. simultaneous writing to and reading from decoding memory}
- H04N 19/61: in combination with predictive coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Decoded image converting circuitry includes a display image compression circuit to which image data are input in the form of consecutive macroblocks. The compression circuit compresses each macroblock, a sequence of sixteen horizontal image data at a time, with a preselected compression ratio. The compressed image data representative of an I (Intra coded) picture and a P (Predictive coded) picture are written to a first memory while the compressed image data representative of a B (Bidirectionally predictive coded) picture are written to a second memory. The image data stored in the first and second memories each is read out at a preselected timing allowing raster scan data to be formed. A display image expansion circuit expands the compressed I and P pictures and B picture and thereby outputs raster scan data. An apparatus including the decoded image converting circuitry and a method practicable with the apparatus are also disclosed.

## Claims

### Claim 1

Decoded image converting circuitry for converting, on receiving decoded image data produced by dividing a frame image representative of a picture rearranged in accordance with a picture type into a plurality of small areas of image data, coding said plurality of small areas of image data, and decoding resulting coded image data, said decoded image data to raster scan data area by area, said decoded image converting circuitry comprising:
a compressing circuit for dividing the decoded image data of each of said plurality of small areas into pixel data sequences each extending in a horizontal direction in a frame image, and compressing each of said pixel data sequences to thereby output compressed image data;
a first storage for storing, among said compressed image data output from said compressing circuit, compressed image data representative of an I (Intra coded) picture and compressed image data representative of a P (Predictive coded) picture;
a second storage for storing, among said compressed image data output from said compressing circuit, compressed image data representative of a B (Bidirectionally predictive coded) picture; and
an expanding circuit for taking in said compressed image data stored in said first storage and said second storage in an order of an original picture and then expanding said compressed image data to thereby output the raster scan data.

### Claim 2 (depends on 1)

Circuitry in accordance with in claim 1, wherein said compressing circuit comprises:
a difference calculating section for producing a difference between nearby pixels adjoining each other in each of said pixel data sequences;
a transforming section for outputting a variable length code corresponding to a frequency of occurrence of the difference; and
an outputting section for outputting variable length codes output from said transforming section by every predetermined number of bits as said compressed image data.

### Claim 3 (depends on 1)

Circuitry in accordance with claim 1, wherein said compressing circuit comprises:
a difference calculating section for producing a difference between nearby pixels adjoining each other in each of said pixel data sequences;
a transforming section for outputting a variable length code corresponding to a frequency of occurrence of the difference; and
a compressed image data outputting section for outputting variable length codes output from said transforming section by every predetermined number of bits as said compressed image data;
said expanding circuit comprising:
an inverse transforming section for taking in said compressed image data stored in said first storage and said second storage, detecting said variable length codes, and producing differences between nearby pixels corresponding to said variable length codes; and
an expanded image data outputting section for determining said pixel data sequences by addition using said differences to thereby output the raster scan data.

### Claim 4

A decoded image converting apparatus comprising:
an inverse transforming circuit for executing, on receiving coded image data coded by rearranging a picture in accordance with a picture type and subjecting a resulting picture to quantization and orthogonal transform, dequantization and inverse orthogonal transform with said coded image data to thereby output image data;
a memory including two memory areas for storing decoded image data respectively representative of an I picture and a P picture;
an adder for outputting, on receiving image data representative of an I picture from said inverse transforming circuit, said image data as decoded image data and writing said image data in one of said two memory areas of said memory, or reading, on receiving image data representative of a P picture from said inverse transforming circuit, image data representative of an I picture or a P picture preceding said P picture out of one of said two memory areas, adding said image data read out to said image data output from said inverse transforming circuit, and outputting resulting decoded image data while writing said decoded image data in the other memory area of said memory, or reading, on receiving image data representative of a B picture from said inverse transforming circuit, image data out of said two memory areas, producing mean values, and adding said mean values to said image data output from said inverse transforming circuit to thereby output decoded image data;
a compressing circuit for dividing said decoded image data output from said adder into pixel data sequences each extending in a horizontal direction in a frame image, and compressing each of said pixel data sequences to thereby output compressed image data;
a first storage for storing, among said compressed image data output from said compressing circuit, compressed image data representative of an I picture and compressed image data representative of a P picture;
a second storage for storing, among said compressed image data output from said compressing circuit, compressed image data representative of a B picture; and
an expanding circuit for taking in said compressed image data stored in said first storage and said second storage in an order of an original picture and then expanding said compressed image data to thereby output raster scan data.

### Claim 5 (depends on 4)

An apparatus in accordance with claim 4, wherein said two memory areas of said memory, a memory area of said first storage and a memory area of said second storage are allotted to a memory space of a single large capacity memory.

### Claim 6

A decoded image converting apparatus comprising:
an inverse transforming circuit for executing, on receiving coded image data coded by rearranging a picture in accordance with a picture type and subjecting a resulting picture to quantization and orthogonal transform, dequantization and inverse orthogonal transform with said coded image data to thereby output image data;
a memory including two memory areas for storing decoded image data respectively representative of an I picture and a P picture;
an adder for writing, on receiving image data representative of an I picture from said inverse transforming circuit, said image data in one of said two memory areas of said memory as decoded image data, or reading, on receiving image data representative of a P picture from said inverse transforming circuit, image data representative of an I picture or a P picture preceding said P picture out of one of said two memory areas, adding said image data read out to said image data output from said inverse transforming circuit, and writing resulting decoded image data in the other memory area of said memory, or reading, on receiving image data representative of a B picture from said inverse transforming circuit, image data out of said two memory areas, producing mean values, and adding said mean values to said image data output from said inverse transforming circuit to thereby output decoded image data;
timing adjusting means for selectively reading said decoded image data representative of the I picture or the P picture out of either one of said two memory areas of said memory, storing said decoded image data for a moment, and then reading said decoded image data at a preselected timing to output corresponding raster scan data; and
decoded image converting circuitry for converting said decoded image data representative of the B image and output from said adder to raster scan data.

### Claim 7 (depends on 6)

An apparatus in accordance with claim 6, wherein said timing adjusting means comprises a FIFO (First-In First-Out) memory.

### Claim 8 (depends on 6)

An apparatus in accordance with claim 6, wherein said decoded image converting circuitry comprises:
a compressing circuit for compressing said decoded image data representative of the B picture and output from said adder;
a compressed image data storage for storing said decoded image data compressed by said compressing circuit; and
an expanding circuit for expanding said compressed image data read out of said compressed image data storage to thereby output corresponding raster scan data.

### Claim 9 (depends on 8)

An apparatus in accordance with claim 8, wherein a memory area of said compressed image storage and said memory areas of said memory are allotted to a memory space of a single large capacity memory.

### Claim 10

A decoded image converting method for converting decoded image data produced by dividing a frame image representative of a picture rearranged in accordance with a picture type into a plurality of small areas of image data, coding said plurality of small areas of image data, and decoding resulting coded image data to raster scan data area by area, said decoded image converting method comprising the steps of:
(a) dividing the decoded image data of each of said plurality of small areas into pixel data sequences each extending in a horizontal direction in a frame image, and compressing each of said pixel data sequences to thereby output compressed image data;
(b) storing, among said compressed image data output in step (a), compressed image data representative of an I picture and compressed image data representative of a P picture in a first storage;
(c) storing, among said compressed image data output in step (a), compressed image data representative of a B picture in a second storage; and
(d) reading said compressed image data stored in said first storage and said second storage in an order of an original picture and then expanding said compressed image data to thereby output the raster scan data.

### Claim 11

A decoded image converting method comprising the steps of:
(a) executing dequantization and inverse orthogonal transform with coded image data coded by rearranging a picture in accordance with a picture type and subjecting a resulting picture to quantization and orthogonal transform to thereby output image data;
(b) storing decoded image data respectively representative of an I picture and a P picture in two memory areas of a memory;
(c) outputting image data representative of an I picture output in step (a) as decoded image data while writing said image data in one of said two memory areas of said memory, or reading, when image data representative of a P picture are output in step (a), image data representative an I picture or a P picture preceding said P picture out of one of said two memory areas, adding said image data read out to said image data representative of said P picture, and outputting resulting decoded image data while writing said decoded image data in the other memory area of said memory, or reading, when image data representative of a B picture are output in step (a), image data out of said two memory areas, producing mean values, and adding said mean values to said image data representative of said B picture to thereby output decoded image data;
(d) dividing said decoded image data output in (c) into pixel data sequences each extending in a horizontal direction in a frame image, and compressing each of said pixel data sequences to thereby output compressed image data;
(e) storing, among said compressed image data output in step (d), compressed image data representative of an I picture and compressed image data representative of a P picture in a first storage assigned to the I picture and the P picture;
(f) storing, among said compressed image data output in step (d), compressed image data representative of a B picture in a second storage assigned to the B picture; and
(g) taking in said compressed image data from said first storage and said second storage in an order of an original picture and then expanding said compressed image data to thereby output corresponding raster scan data.

### Claim 12

A decoded image converting method comprising the steps of:
(a) taking in coded image data coded by rearranging a picture in accordance with a picture type and subjecting a resulting picture to quantization and orthogonal transform, and subjecting said coded image data to dequantization and inverse orthogonal transform to thereby output decoded image data;
(b) storing decoded image dada respectively representative of an I picture and a P picture in two memory areas of a memory;
(c) writing, when image data representative of an I picture are output in step (a), said image data in one of said two memory areas of said memory as decoded image data, or reading, when image data representative of a P picture are output in step (a), image data representative of an I picture or a P picture preceding said P picture out of one of said two memory areas, adding said image data read out to said image data output representative of said P picture, and writing resulting decoded image data in the other memory area of said memory, or reading, when image data representative of a B picture are output in step (a), image data out of said two memory areas, producing mean values, and adding said mean values to said image data representative of said B picture to thereby output decoded image data;
(d) selectively reading said decoded image data representative of the I picture or the P picture out of either one of said two memory areas of said memory, storing said decoded image data for a moment, and then reading said decoded image data at a preselected timing to thereby output corresponding raster scan data; and
(e) converting said decoded image data representative of the B image and output from said adder to raster scan data.

### Claim 13

In a data recording medium capable of being read by a computer and storing a decoded image conversion program for converting, when decoded image data produced by dividing a frame image representative of a picture rearranged in accordance with a picture type into a plurality of small areas of image data, coding said plurality of small areas of image data, and decoding resulting coded image data are input, said decoded image data to raster scan data area by area, said decoded image conversion program comprises the steps of:
(a) dividing the decoded image data of each of said plurality of small areas into pixel data sequences each extending in a horizontal direction in a frame image, and compressing each of said pixel data sequences to thereby output compressed image data;
(b) storing, among said compressed image data output in step (a), compressed image data representative of an I picture and compressed image data representative of a P picture in a first storage;
(c) storing, among said compressed image data output in step (a), compressed image data representative of a B picture in a second storage; and
(d) taking in said compressed image data stored in said first storage and said second storage in an order of an original picture and then expanding said compressed image data to thereby output the raster scan data.

### Claim 14

In a data recording medium capable of being read by a computer and storing a decoded image conversion program, said decoded image conversion program comprises the steps of:
(a) executing dequantization and inverse orthogonal transform with coded image data coded by rearranging a picture in accordance with a picture type and subjecting a resulting picture to quantization and orthogonal transform to thereby output image data;
(b) storing decoded image data respectively representative of an I picture and a P picture in two memory areas of a memory;
(c) outputting image data representative of an I picture output in step (a) as decoded image data while writing said image data in one of said two memory areas of said memory, or reading, when image data representative of a P picture are output in step (a), image data representative an I picture or a P picture preceding said P picture out of one of said two memory areas, adding said image data read out to said image data representative of said P picture, and outputting resulting decoded image data while writing said decoded image data in the other memory area of said memory, or reading, when image data representative of a B picture are output in step (a), image data out of said two memory areas, producing mean values, and adding said mean values to said image data representative of said B picture to thereby output decoded image data;
(d) dividing said decoded image data output in (c) into pixel data sequences each extending in a horizontal direction in a frame image, and compressing each of said pixel data sequences to thereby output compressed image data;
(e) storing, among said compressed image data output in step (d), compressed image data representative of an I picture and compressed image data representative of a P picture in a first storage assigned to the I picture and the P picture;
(f) storing, among said compressed image data output in step (d), compressed image data representative of a B picture in a second storage assigned to the B picture; and
(g) taking in said compressed im age data stored in said first storage and said second storage in an order of an original picture and then expanding said compressed image data to thereby output corresponding raster scan data.

### Claim 15

In a data recording medium capable of being read by a computer and storing a decoded image conversion program, said decoded image conversion program comprises the steps of:
(a) taking in coded image data coded by rearranging a picture in accordance with a picture type and subjecting a resulting picture to quantization and orthogonal transform, and subjecting said coded image data to dequantization and inverse orthogonal transform to thereby output decoded image data;
(b) storing decoded image dada respectively representative of an I picture and a P picture in two memory areas of a memory;
(c) writing, when image data representative of an I picture are output in step (a), said image data in one of said two memory areas of said memory as decoded image data, or reading, when image data representative of a P picture are output in step (a), image data representative of an I picture or a P picture preceding said P picture out of one of said two memory areas, adding said image data read out to said image data output representative of said P picture, and writing resulting decoded image data in the other memory area of said memory, or reading, when image data representative of a B picture are output in step (a), image data out of said two memory areas, producing mean values, and adding said mean values to said image data representative of said B picture to thereby output decoded image data;
(d) selectively reading said decoded image data representative of the I picture or the P picture out of either one of said two memory areas of said memory, storing said decoded image data for a moment, and then reading said decoded image data at a preselected timing to thereby output corresponding raster scan data; and
(e) converting said decoded image data representative of the B image to raster scan data.
