# US 11,310,514 B2 · Encoding method and apparatus using non-encoding region, block-based encoding region, and pixel-based encoding region

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,310,514 B2
- Document ID: US11310514B2
- Status: Granted
- Kind: B2
- Application number: 15/538,853
- Filed: 2014-12-30
- Published: 2018-01-11
- Granted: 2022-04-19
- Earliest claimed: 2014-12-22
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Dae-sung Cho; Chan-yul Kim; Jeong-hoon Park; Pil-kyu Park; Kwang-pyo Choi; Dai-woong Choi; Woong-il Choi
- Web page: https://patentgrep.com/patent/US11310514B2

## CPC

- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/156: Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
- H04N 19/169: characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N 7/0127: {by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter}
- H04N 19/124: Quantisation
- H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/182: the unit being a pixel
- H04N 19/436: using parallelised computational arrangements
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/61: in combination with predictive coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Encoding an image using a non-encoding region of the image, a block-based encoding region of the image, and a pixel-based encoding region of the image.

## Claims

### Claim 1

An encoding apparatus for encoding an image, the encoding apparatus comprising:
a communicator configured to receive, from a device, device information related to the device; and
a processor configured to encode the image by using image information of the image and the device information,
wherein the processor is further configured to determine a non-encoding region, a block-based encoding region, and a pixel-based encoding region of the image according to at least one of the device information and the image information, performs block-based encoding on the block-based encoding region by using a quantization parameter determined according to at least one of the device information and the image information, perform pixel-based encoding on the pixel-based encoding region, generates an encoded image by entropy encoding a symbol determined by the block-based encoding or a symbol determined by the pixel-based encoding, and generate a bitstream comprising the encoded image, region information of the block-based encoding region and the pixel-based encoding region, and quantization information of the quantization parameter, and
wherein the communicator is further configured to transmit the bitstream to the device.

### Claim 2 (depends on 1)

The encoding apparatus of claim 1, wherein the processor is further configured to perform intra prediction or inter prediction on a coding unit of the block-based encoding region, transform residual data generated from intra prediction or inter prediction of a block-based encoding region, and quantize the transformed residual data by using the quantization parameter.

### Claim 3 (depends on 1)

The encoding apparatus of claim 1, wherein the processor is further configured to perform pixel-based prediction on an adjacent pixel with respect to each of pixels of the pixel-based encoding region, match residual data generated from pixel-based prediction of a pixel-based encoding region with a repeated residual string of the residual data, and compress the residual data by using a length and position information of the residual string.

### Claim 4 (depends on 1)

The encoding apparatus of claim 1, wherein the processor is further configured to generate an index map comprising an index corresponding to colors indicated by pixels of the pixel-based encoding region, match the index map with a repeated index string of the index map, and compress the index map by using a length of the index string and position information.

### Claim 5 (depends on 1)

The encoding apparatus of claim 1, wherein the communicator is further configured to receive display shape information about a shape of a display included in a device reproducing the image, and
wherein the processor is further configured to determine a region of the image that is not displayed on the display as the non-encoding region according to the display shape information, and
wherein the non-encoding region is a region that is not encoded.

### Claim 6 (depends on 1)

The encoding apparatus of claim 1, wherein the processor is further configured to split the image into a plurality of regions, expand sizes of the split regions such that the split regions are split in an integer number of coding units used by a block-based encoding region, obtain an area ratio of the expanded regions with respect to unexpanded regions, and determine the regions as one of the block-based encoding regions and the pixel-based encoding regions according to the area ratio.

### Claim 7 (depends on 1)

The encoding apparatus of claim 1, wherein the processor is further configured to obtain color information indicating the number of colors constituting the image, determine, according to the color information, a region in which the number of used colors is below a threshold value as the pixel-based encoding region, and determine the region in which the number of used colors is above the threshold value as the block-based encoding region.

### Claim 8 (depends on 1)

The encoding apparatus of claim 1, wherein the processor is further configured to obtain pixel gradient information indicating values indicating size differences between pixel values of adjacent pixels with respect to pixels included in the image, select a maximum value from among the values indicating the size differences between the pixel values of the adjacent pixels according to the pixel gradient information, determine a region in which the maximum value is above a threshold value as the pixel-based encoding region, and determine a region in which the maximum value is below the threshold value as the block-based encoding region.

### Claim 9 (depends on 1)

The encoding apparatus of claim 1, wherein the communicator is further configured to receive illumination information about illumination of a device reproducing the image, and
wherein the processor is further configured to adjust a frame rate of the image according to a change in brightness of a display included in the device by the illumination information and determine the quantization parameter according to the change in the brightness of the display included in the device by the illumination information.

### Claim 10 (depends on 1)

The encoding apparatus of claim 1, wherein the communicator is further configured to receive power information indicating that a device reproducing the image is in a low power mode, and
wherein, when the power information indicates the low power mode, the processor is further configured to reduce a frame rate of the image or converts a color format of the image and, determine the quantization parameter to be greater than the quantization parameter of the low power mode.

### Claim 11

A method of encoding an image, the method being performed by an encoding apparatus and comprising:
receiving, from a device, device information related to the device;
obtaining image information of the image;
determining a non-encoding region, a block-based encoding region, and a pixel-based encoding region of the image according to at least one of the device information and the image information;
determining a quantization parameter for the block-based encoding region according to at least one of the device information and the image information;
performing block-based encoding on the block-based encoding region by using the quantization parameter;
performing pixel-based encoding on the pixel-based encoding region;
generating an encoded image by entropy encoding a symbol determined by the block-based encoding and a symbol determined by the pixel-based encoding; and
transmitting a bitstream comprising the encoded image, region information of the block-based encoding region and the pixel-based encoding region, and quantization information of the quantization parameter to the device.

### Claim 12 (depends on 11)

A non-transitory computer-readable recording medium having recorded thereon a computer program for executing the encoding method of claim 11.

### Claim 13

A decoding apparatus for decoding an encoded image, the decoding apparatus comprising:
a communicator configured to transmit device information related to a device comprising the decoding apparatus to an encoding apparatus and receive, from the encoding apparatus, the encoded image generated by encoding an image and image information of the image, region information of a block-based encoding region to which block-based encoding is applied and a pixel-based encoding region to which pixel-based encoding is applied in a region of the image, and quantization information of a quantization parameter used in an encoding process of the block-based encoding region of the image; and
a processor configured to entropy decode the encoded image, perform block-based decoding on a portion corresponding to the block-based encoding region of the entropy decoded image by using the quantization parameter, perform pixel-based decoding on a portion corresponding to the pixel-based encoding region of the entropy decoded image, and reconstruct an image that is to be reproduced by the device by combining the portion corresponding to the block-based encoding region of the block-based decoded image and the portion corresponding to the pixel-based encoding region of the pixel-based decoded image.