# US 2020/0396381 A1 · Image processing device and method thereof, imaging element, and imaging device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0396381 A1
- Document ID: US20200396381A1
- Status: Published application
- Kind: A1
- Application number: 16/975,368
- Filed: 2019-02-15
- Published: 2020-12-17
- Earliest claimed: 2018-03-01
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: TOSHINORI IHARA; TAKEFUMI NAGUMO
- Web page: https://patentgrep.com/patent/US20200396381A1

## CPC

- H04N 19/124: Quantisation
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure relates to an image processing device and a method thereof, an imaging element, and an imaging device in which a signal value deviation generated through encoding and decoding of an amplified signal group can be restrained. Adaptive processing is executed on an image in which signal amplification has been executed, and the resultant image is encoded. For example, an offset value that is randomly set within a value range that depends on a gain value of the signal amplification executed on the image is added to each pixel value of the image, and then, the resultant image is encoded. The present disclosure is applicable to an image processing device, an image encoding device, an image decoding device, an imaging element, or an imaging device, for example.

## Claims

### Claim 1

An image processing device comprising:
an adaptive processing section that executes adaptive image processing of an image in which signal amplification has been executed; and
an encoding section that executes simple encoding of the image having undergone the adaptive image processing executed by the adaptive processing section.

### Claim 2 (depends on 1)

The image processing device according to claim 1, wherein
the adaptive processing section executes the imaging processing of adding, to each pixel value of the image, an offset value that is randomly set within a value range that depends on a gain value of the signal amplification executed on the image, and
the encoding section executes simple encoding of the image in which the offset value has been added to each pixel value by the adaptive processing section.

### Claim 3 (depends on 2)

The image processing device according to claim 2, wherein
the adaptive processing section adds, as the offset value, a pseudo random number corrected to fall within the value range that depends on the gain value, to each pixel value of the image.

### Claim 4 (depends on 1)

The image processing device according to claim 1, wherein
the adaptive processing section executes the image processing of subtracting, from each pixel value of the image, an offset value that is based on an average pixel value of the image and a quantization value of simple encoding to be executed by the encoding section, and
the encoding section executes simple encoding of the image in which the offset value has been subtracted from each pixel value by the adaptive processing section.

### Claim 5 (depends on 4)

The image processing device according to claim 4, wherein
the average pixel value includes an average pixel value of an image of a frame prior to a current frame which is a process target.

### Claim 6 (depends on 5)

The image processing device according to claim 5, wherein
the quantization value includes a value that depends on a compression rate of the simple encoding.

### Claim 7 (depends on 5)

The image processing device according to claim 5, wherein
the quantization value is an average of quantization values, for respective pixels, of the simple encoding of the image of a frame prior to a current frame which is a process target.

### Claim 8 (depends on 4)

The image processing device according to claim 4, wherein
for each color, the adaptive processing section subtracts the offset value from each pixel value of the image.

### Claim 9 (depends on 4)

The image processing device according to claim 4, further comprising:
a decoding section that executes simple decoding of encoded data generated by the encoding section; and
an offset adding section that adds, to each pixel value of a decoded image generated by the decoding section, an offset value that is based on an average pixel value of the image and a quantization value of the simple encoding.

### Claim 10 (depends on 1)

The image processing device according to claim 1, wherein
the adaptive processing section executes the image processing of setting a range of a quantization value of simple encoding to be executed by the encoding section, and
the encoding section executes simple encoding of the image on a basis of the range of the quantization value set by the adaptive processing section, and generates encoded data including information regarding the range of the quantization value.

### Claim 11 (depends on 10)

The image processing device according to claim 10, wherein
the adaptive processing section sets the range of the quantization value according to a gain value of the signal amplification executed on the image.

### Claim 12 (depends on 10)

The image processing device according to claim 10, further comprising:
a decoding section that executes simple decoding of the encoded data generated by the encoding section, on a basis of the information regarding the range of the quantization value included in the encoded data.

### Claim 13 (depends on 1)

The image processing device according to claim 1, wherein
the adaptive processing section executes the image processing of dividing each pixel value of the image by a gain value of the signal amplification executed on the image, and
the encoding section executes simple encoding of the image in which each pixel value has been divided by the gain value by the adaptive processing section.

### Claim 14 (depends on 13)

The image processing device according to claim 13, further comprising:
a decoding section that executes simple decoding of encoded data generated by the encoding section; and
a gain value multiplication section that multiplies, by the gain value, each pixel value of a decoded image generated by the decoding section.

### Claim 15 (depends on 1)

The image processing device according to claim 1, further comprising:
an amplification section that executes signal amplification on the image, wherein
the adaptive processing section executes the adaptive image processing of the image in which signal amplification has been executed by the amplification section.

### Claim 16 (depends on 1)

The image processing device according to claim 1, further comprising:
a gain value setting section that sets a gain value of the signal amplification executed on the image.

### Claim 17 (depends on 1)

The image processing device according to claim 1, further comprising:
a recording section that records encoded data generated by the encoding section.

### Claim 18

An image processing method comprising:
executing adaptive image processing of an image in which signal amplification has been executed; and
executing simple encoding of the image having undergone the adaptive image processing.

### Claim 19

An imaging element comprising:
an imaging section that captures an image of a subject;
an adaptive processing section that executes adaptive image processing of the captured image which has been generated by the imaging section and in which signal amplification has been executed; and
an encoding section that executes simple encoding of the captured image having undergone the adaptive image processing executed by the adaptive processing section.

### Claim 20

An imaging device comprising:
an imaging element including
an imaging section that captures an image of a subject,
an adaptive processing section that executes adaptive image processing of the captured image which has been generated by the imaging section and in which signal amplification has been executed, and
an encoding section that generates encoded data by executing simple encoding of the captured image having undergone the adaptive image processing executed by the adaptive processing section; and
a decoding section that executes simple decoding of the encoded data generated by the encoding section.
