# US 2021/0344900 A1 · Image processing device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344900 A1
- Document ID: US20210344900A1
- Status: Published application
- Kind: A1
- Application number: 17/377,927
- Filed: 2021-07-16
- Published: 2021-11-04
- Earliest claimed: 2018-01-26
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: SUNG HO JUN; CHANG SOO PARK; MOON KYU SONG; KYUNG KOO LEE; KIL WHAN LEE; HYUK JAE JANG; KYUNG AH JEONG
- Web page: https://patentgrep.com/patent/US20210344900A1

## CPC

- H04N 19/103: Selection of coding mode or of prediction mode
- G06F 13/1668: {Details of memory controller}
- H04N 19/12: Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
- H04N 19/124: Quantisation
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Provided is an image processing device configured to compress first image data. The image processing device includes an encoding circuit configured to compress the first image data into second image data including prediction data and residual data, compress the second image data into third image data by performing entropy encoding on the second image data, generate a header representing a compression ratio of the third image data, and store the third image data along with the header in a memory device as compressed first image data.

## Claims

### Claim 1

An image processing device comprising:
a multimedia intellectual property (IP) configured to receive and process first image data and generate and use second image data;
a frame buffer compressor configured to compress the second image data into third image data and decompress the third image data into the second image data;
a memory configured to store the third image data and accessed by the multimedia IP,
wherein the frame buffer compressor performs compression or decompression when the multimedia IP accesses the memory,
the frame buffer compressor operates in a lossy compression mode or a lossless compression mode,
the lossless compressed third image data includes a first payload and a first header, the first header indicates a compression ratio of the first payload, and
the lossy compressed third image data includes second payload only, and the second payload is compressed by a preset compression ratio.

### Claim 2 (depends on 1)

The image processing device of claim 1, wherein a size of the first payload is an integer multiple of a size of a data access unit of the memory.

### Claim 3 (depends on 1)

The image processing device of claim 1, wherein the first payload includes a first binary code and a first k value code, the first binary code is the second image data entropy encoded and the first k value code represents a k value of the entropy encoded first binary code, and
wherein the second payload includes a second binary code and a second k value code, the second binary code is the second image data entropy encoded.

### Claim 4 (depends on 3)

The image processing device of claim 3, wherein the second binary code is quantized by a predetermined quantization parameter (QP),
the second payload includes a QP code, and the QP code indicates the QP of the second binary code.

### Claim 5 (depends on 1)

The image processing device of claim 1, wherein the second image data is encoded into YUV and includes a luma signal block, a first chroma signal block and a second chroma signal block.

### Claim 6 (depends on 5)

The image processing device of claim 5, wherein the frame buffer compressor operates first to third modes,
in the first mode, the frame buffer compressor compresses the luma signal block, the first chroma signal block and the second chroma signal block of the second image data together,
in the second mode, the frame buffer compressor compresses the first chroma signal block and the second chroma signal block of the second image data together and separately compresses the luma signal block of the second image data, and
in the third mode, the frame buffer compressor compresses the luma signal block, the first chroma signal block and the second chroma signal block of the second image data respectively.

### Claim 7 (depends on 6)

The image processing device of claim 6, wherein the third image data includes a binary code which is the compressed second image data,
in the first mode and the second mode, the binary code includes data about each pixel, and
the data about each pixel includes the data of a different plane.

### Claim 8 (depends on 6)

The image processing device of claim 6, wherein the third image data includes a binary code and a k-value code, the binary code is the second image data entropy encoded and the k-value code indicates a k-value of the entropy encoded binary code,
the k-value code has a first size when the third image data is compressed in the third mode,
the k-value code is one or twice a size of the first size when the third image data is compressed in the second mode, and
the k-value code is one, twice or three-times a size of the first size when the third image data is compressed in the first mode.

### Claim 9 (depends on 6)

The image processing device of claim 6, wherein the binary code is quantized by a predetermined quantization parameter (QP),
the third image data includes a QP code, the QP code indicates a QP of the binary code,
the QP code has a second size when the third image data is compressed in the third mode,
the QP code is one or twice a size of the second size when the third image data is compressed in the second mode,
the QP code is one, twice or three-times a size of the second size when the third image data is compressed in the first mode.

### Claim 10 (depends on 5)

The image processing device of claim 5, wherein a size ratio of the luma signal block, the first chroma signal block and the second chroma signal block in the second image data is 4:1:1 or 4:2:2.

### Claim 11

An image processing device comprising:
a multimedia intellectual property (IP) configured to receive and process first image data and generate and use second image data;
a frame buffer compressor configured to compress the second image data into third image data and decompress the third image data into the second image data; and
a memory configured to store the third image data to be accessed by the multimedia IP, and
wherein the frame buffer compressor includes,
an encoder configured to compress the second image data into the third image data; and
a decoder configured to decompress the third image data into the second image data,
wherein the encoder includes a prediction module to divide and represent prediction data and residual data and an entropy encoding module to perform entropy encoding on the second image data and compress the encoded second image data according to a k-value,
the decoder includes a prediction compensation module to decode the prediction data and the residual data into the second image data and an entropy decoding module to decode the third image data according to the k-value.

### Claim 12 (depends on 11)

The image processing device of claim 11, wherein the encoder includes a quantization module to quantize the second image data based on a quantization parameter (QP) and compress the quantized second image data,
the decoder includes an inverse quantization module to decode the second image data based on the QP.

### Claim 13 (depends on 12)

The image processing device of claim 12, wherein the frame buffer operates in a lossy mode or a lossless mode,
in the lossless mode, the second image data is transformed a compression data by the prediction module and the entropy encoding module,
in the lossy mode, the second image data is compressed to the third image data by the prediction module, the quantization module and the entropy encoding module.

### Claim 14 (depends on 12)

The image processing device of claim 12, further comprising:
a padding module configured to generate the third image data for padding corresponding to a size of the compressed data and a header indicating a compression ratio of the third image data.

### Claim 15 (depends on 14)

The image processing device of claim 14, wherein the padding module is configured such that a size of the compression data is a first integer multiple of a size of a data access unit of the memory by the padding, and
the compression ratio corresponds to the first integer.

### Claim 16

An image processing device comprising:
a multimedia intellectual property (IP) configured to receive and process first image data and generate and use second image data;
a frame buffer compressor configured to compress the second image data into third image data and decompress the third image data into the second image data; and
a memory configured to store the third image data to be accessed by the multimedia IP, and
wherein the frame buffer compressor is configured to perform the compressing or the decompressing whenever the multimedia IP accesses the memory,
the second image data includes a luma signal block, a first chroma signal block and a second chroma signal block, which is encoded into YUV,
wherein the frame buffer compressor operates first to third modes,
in the first mode, the frame buffer compressor compresses the luma signal block, the first chroma signal block and the second chroma signal block of the second image data together,
in the second mode, the frame buffer compressor compresses the first chroma signal block and the second chroma signal block of the second image data together and separately compresses the luma signal block of the second image data, and
in the third mode, the frame buffer compressor compresses the luma signal block, the first chroma signal block and the second chroma signal block of the second image data respectively.

### Claim 17 (depends on 16)

The image processing device of claim 16, wherein the multimedia IP includes a image signal processor to transform the first image data into the second image data and transfer the second image data to the frame buffer compressor,
the first image data is RGB format data and the second image data is YUV format data.

### Claim 18 (depends on 17)

The image processing device of claim 17, wherein the multimedia IP includes a multi-format codec to receive the second image data from the frame buffer compressor and compress the second image data and return the compressed second image data to the frame buffer compressor.

### Claim 19 (depends on 18)

The image processing device of claim 18, further comprising:
a shake correction module configured to receive the second image data from the frame buffer compressor, perform a shake correction on the second image data and return the corrected second image data to the frame buffer compressor.

### Claim 20 (depends on 17)

The image processing device of claim 17, further comprising:
a graphic processing unit (GPU) configured to receive the second image data from the frame buffer compressor, perform a graphic processing for the second image data and return the processed data to the frame buffer compressor.