# US 2023/0069744 A1 · Method of operating assessment device assessing color distortion of image sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0069744 A1
- Document ID: US20230069744A1
- Status: Published application
- Kind: A1
- Application number: 17/891,819
- Filed: 2022-08-19
- Published: 2023-03-02
- Earliest claimed: 2021-08-26
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: JUNGMIN LEE; Seunghyeok JUNE; JIYUN BANG; SUNGSU KIM; JOON-SEO YIM
- Web page: https://patentgrep.com/patent/US20230069744A1

## CPC

- H04N 9/69: for modifying the colour signals by gamma correction (controlling camera response for colour signals H04N23/83)
- H04N 17/002: {for television cameras}
- H04N 9/67: for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided is a method of operating an assessment device which communicates with an image sensor and includes an input buffer and a processor, the method including receiving, by the input buffer, raw image data from the image sensor that is configured to capture a test chart, generating, by the processor, conversion image data based on color domain transformation of the raw image data, generating, by the processor, estimation image data by estimating a non-distorted image based on the conversion image data, and assessing, by the processor, color distortion of the image sensor based on the estimation image data and the conversion image data.

## Claims

### Claim 1

A method of operating an assessment device which communicates with an image sensor and comprises an input buffer and a processor, the method comprising:
receiving, by the input buffer, raw image data from the image sensor that is configured to capture a test chart;
generating, by the processor, conversion image data based on color domain transformation of the raw image data;
generating, by the processor, estimation image data by estimating a non-distorted image based on the conversion image data; and
assessing, by the processor, color distortion of the image sensor based on the estimation image data and the conversion image data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the color distortion comprises a false color.

### Claim 3 (depends on 1)

The method of claim 1, wherein the test chart comprises a linear pattern, and
wherein probabilities of the linear pattern having a position, a length, and a slope are uniform and a probability of the linear pattern having a thickness exponentially decreases as the thickness of the linear pattern decreases.

### Claim 4 (depends on 1)

The method of claim 1, wherein the test chart comprises:
a common region having a first area and a first linear pattern having a first frequency;
a first sub-region overlapping the common region and having a second area smaller than the first area and a second linear pattern having a second frequency higher than the first frequency; and
a second sub-region overlapping the common region and having a third area smaller than the second area and a third linear pattern having a third frequency higher than the second frequency.

### Claim 5 (depends on 1)

The method of claim 1, wherein the generating of the conversion image data based the color domain transformation of the raw image data by the processor comprises:
generating, by the processor, the conversion image data having a brightness value, a first chrominance value, and a second chrominance value, based on the color domain transformation of the raw image data having a first color value, a second color value, and a third color value.

### Claim 6 (depends on 5)

The method of claim 5, wherein the generating of the estimation image data by the processor by estimating the non-distorted image based on the conversion image data comprises:
determining, by the processor, a first fitted chrominance value by fitting outlier values of the first chrominance value of the conversion image data through a first fitting function;
determining, by the processor, a second fitted chrominance value by fitting outlier values of the second chrominance value of the conversion image data through a second fitting function; and
generating, by the processor, the estimation image data having the brightness value, the first fitted chrominance value, and the second fitted chrominance value.

### Claim 7 (depends on 6)

The method of claim 6, wherein the assessing of the color distortion of the image sensor based on the estimation image data and the conversion image data by the processor comprises:
determining, by the processor, a first calculated difference value based on a difference between the first fitted chrominance value of the estimation image data and the first chrominance value of the conversion image data;
determining, by the processor, a second calculated difference value based on a difference between the second fitted chrominance value of the estimation image data and the second chrominance value of the conversion image data;
determining, by the processor, a first weighted sum value based on a weighted sum of the first calculated difference value and a first contrast sensitivity value of a contrast sensitivity function;
determining, by the processor, a second weighted sum value based on a weighted sum of the second calculated difference value and a second contrast sensitivity value of the contrast sensitivity function; and
assessing, by the processor, the color distortion of the image sensor based on the first weighted sum value and the second weighted sum value.

### Claim 8 (depends on 7)

The method of claim 7, wherein the assessing of the color distortion of the image sensor based on the first weighted sum value and the second weighted sum value by the processor comprises:
determining, by the processor, a score value corresponding to a level of the color distortion of the image sensor based on the first weighted sum value and the second weighted sum value, based on a score chart.

### Claim 9 (depends on 1)

The method of claim 1, wherein the processor of the assessment device is implemented:
on an embedded processor included in the image sensor;
on an image processor configured to communicate with the image sensor; or
on a processor included in a first electronic device configured to communicate with a second device comprising the image sensor.

### Claim 10

A method of operating an assessment device which is configured to communicate with an image sensor and comprises an input buffer and a processor, the method comprising:
receiving, by the input buffer, raw image data from the image sensor that is configured to capture a test chart;
generating, by the processor, replacement color information based on the raw image data and a reference chart;
generating, by the processor, color reconstruction image data by reconstructing a color of the raw image data based on the replacement color information; and
assessing, by the processor, color distortion of the image sensor based on the color reconstruction image data and the raw image data.

### Claim 11 (depends on 10)

The method of claim 10, wherein the color distortion comprises decolorization.

### Claim 12 (depends on 10)

The method of claim 10, wherein the test chart comprises a linear pattern,
wherein probabilities of the linear pattern having a position, a length, and a slope are uniform and a probability of the linear pattern having a thickness exponentially decreases as the thickness of the linear pattern decreases.

### Claim 13 (depends on 10)

The method of claim 10, wherein the test chart comprises:
a mixed color region having a linear pattern of a plurality of colors;
a first color region having a background of a first color and comprising a first linear pattern sub-region and a first plane sub-region;
a second color region having a background of a second color and comprising a second linear pattern sub-region and a second plane sub-region; and
a third color region having a background of a third color and comprising a third linear pattern sub-region and a third plane sub-region.

### Claim 14 (depends on 10)

The method of claim 10, wherein the generating of the replacement color information based the raw image data and the reference chart by the processor comprises:
extracting, by the processor, first color information based on the raw image data;
extracting, by the processor, second color information independent of a change in luminance with reference to the reference chart corresponding to the test chart; and
determining, by the processor, the replacement color information based on the first color information and the second color information.

### Claim 15 (depends on 10)

The method of claim 10, wherein the generating of the color reconstruction image data by the processor by reconstructing the color of the raw image data based the replacement color information comprises:
generating, by the processor, linear image data based on linear transformation of the raw image data;
generating, by the processor, mapping image data by mapping the replacement color information on a background of the linear image data; and
generating, by the processor, the color reconstruction image data based on gamma transformation of the mapping image data.

### Claim 16 (depends on 10)

The method of claim 10, wherein the assessing of the color distortion of the image sensor based on the color reconstruction image data and the raw image data by the processor comprises:
determining, by the processor, a chrominance ratio value based on the color reconstruction image data and the raw image data; and
assessing, by the processor, the color distortion of the image sensor based on the chrominance ratio value.

### Claim 17 (depends on 16)

The method of claim 16, wherein the assessing of the color distortion of the image sensor based on the chrominance ratio value by the processor comprises:
determining, by the processor, a score value corresponding to a level of the color distortion of the image sensor based on a score chart.

### Claim 18

A method of operating an assessment device which is configured to communicate with an image sensor and comprises an input buffer and a processor, the method comprising:
receiving, by the input buffer, raw image data from the image sensor that is configured to capture a test chart;
generating, by the processor, restored image data by restoring a false color or decolorization of the raw image data; and
assessing, by the processor, color distortion of the image sensor based on the restored image data and the raw image data,
wherein the test chart comprises a linear pattern in which probabilities of the linear pattern having a position, a length, and a slope are uniform and a probability of the linear pattern having a thickness exponentially decreases as the thickness of the linear pattern decreases.

### Claim 19 (depends on 18)

The method of claim 18, wherein the generating of the restored image data by the processor by restoring the false color or the decolorization of the raw image data comprises:
generating, by the processor, conversion image data based on color domain transformation of the raw image data; and
generating, by the processor, the restored image data by estimating a non-distorted image based on the conversion image data, and
wherein the assessing of the color distortion of the image sensor based on the restored image data and the raw image data by the processor comprises:
assessing, by the processor, a level of the false color of the image sensor based on the restored image data and the conversion image data.

### Claim 20 (depends on 18)

The method of claim 18, wherein the generating of the restored image data by the processor by restoring the false color or the decolorization of the raw image data comprises:
generating, by the processor, replacement color information based on the raw image data and a reference chart; and
generating, by the processor, the restored image data by reconstructing a color of the raw image data based on the replacement color information, and
wherein the assessing of the color distortion of the image sensor based on the restored image data and the raw image data by the processor comprises:
assessing, by the processor, a level of the decolorization of the image sensor based on the restored image data and the raw image data.

### Claim at position 21

21-25. (canceled)
