# US 2022/0277487 A1 · Color estimation device, color estimation method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0277487 A1
- Document ID: US20220277487A1
- Status: Published application
- Kind: A1
- Application number: 17/630,800
- Filed: 2020-07-27
- Published: 2022-09-01
- Earliest claimed: 2019-07-29
- Assignees: Casio Computer Co., Ltd.
- Applicants: Casio Computer Co., Ltd.
- Inventors: Naotomo MIYAMOTO
- Web page: https://patentgrep.com/patent/US20220277487A1

## CPC

- G06T 7/90: Determination of colour characteristics
- G01J 3/0264: {Electrical interface; User interface}
- G01J 3/50: using electric radiation detectors
- G01J 3/513: {having fixed filter-detector pairs}
- G02B 5/20: Filters (polarising elements G02B5/30)
- G06V 40/162: {using pixel segmentation or colour matching}
- H04B 10/116: Visible light communication
- H04B 10/66: Non-coherent receivers, e.g. using direct detection
- H04N 23/12: with one sensor only
- H10K 59/30: Devices specially adapted for multicolour light emission
- G06V 10/141: Control of illumination
- G06V 10/56: relating to colour
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04B: TRANSMISSION
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H10K: ORGANIC ELECTRIC SOLID-STATE DEVICES

## Abstract

When estimating color for a marker candidate region that is smaller in size than a DeBayer filter, a sever estimates the color of the marker candidate region using HSV average values that are the average values of the hue H, the saturation S, and the brightness V of the marker candidate region, in consideration of the Bayer array of color filters. Furthermore, the server appropriately corrects the HSV average values and converts the pixel format to convert the HSV average values to RGB (RGB average value values), and sets the RGB average values in all pixels of a marker region.

## Claims

### Claim 1

A color estimation device, comprising:
a light receiver with a plurality of arranged light receiving elements for which a color to which received light belongs is identified from a light receiving position; and
at least one processor, wherein the at least one processor is configured to
estimate, in a case in which a position of the light receiving element having received light is a position other than where the color to which the received light belongs is identifiable, a color to which the light belongs, based on a brightness of the received light.

### Claim 2 (depends on 1)

The color estimation device according to claim 1, wherein the at least one processor is configured to
perform, by correcting the brightness of the light that is, after the estimation by the at least one processor, at a position of the light receiving element having received light to increase the brightness, control so as to facilitate identification of the color to which the light at the position of the light receiving element belongs.

### Claim 3 (depends on 1)

The color estimation device according to claim 1, wherein a case in which the position of the light receiving element having received light is the position other than where the color to which the received light belongs is identifiable includes a case in which there are two or more light receiving elements having received light and the light receiving elements are adjacent to each other.

### Claim 4 (depends on 3)

The color estimation device according to claim 3, wherein in a case in which there are the light receiving elements having received light and the light receiving elements having received light are adjacent to each other, the at least one processor determines that a plurality of colors is included in the color to which the light belongs and further estimates, based on information of color space including a hue ring as a parameter, the color to which the light belongs.

### Claim 5 (depends on 1)

The color estimation device according to claim 1, further comprising:
a color filter in which a transparent member through which light in a wavelength band corresponding to each of three primary colors passes is regularly arranged so as to correspond to each position of the plurality of arranged light receiving elements; wherein
the color to which the light belongs is identified based on a type of the wavelength band of the light that passes through the transparent member.

### Claim 6 (depends on 1)

The color estimation device according to claim 1, wherein the at least one processor is configured to
decode from the color estimated by the at least one processor to information for use in a communication system that modulates information to color to communicate.

### Claim 7

A color estimation method, comprising:
receiving light by a plurality of arranged light receiving elements for which a color to which received light belongs is identified from a light receiving position; and
in a case in which a position of the light receiving element having received light in the receiving is a position other than where the color to which the received light belongs is identifiable, estimating a color to which the light belongs, based on a brightness of the received light.

### Claim 8

A non-transitory recording medium storing a program, the program causing a computer to function as:
a light receiver with a plurality of arranged light receiving elements for which a color to which received light belongs is identified from a light receiving position; and
an estimator to estimate, when a position of the light receiving element having received light is a position other than where the color to which the received light belongs is identifiable, a color to which the light belongs, based on a brightness of the received light.

### Claim 9 (depends on 7)

The color estimation method according to claim 7, further comprising:
performing, by correcting the brightness of the light that is, after the estimating, at a position of the light receiving element having received light to increase the brightness, control so as to facilitate identification of the color to which the light at the position of the light receiving element belongs.

### Claim 10 (depends on 7)

The color estimation method according to claim 7, wherein a case in which the position of the light receiving element having received light is the position other than where the color to which the received light belongs is identifiable includes a case in which there are two or more light receiving elements having received light and the light receiving elements are adjacent to each other.

### Claim 11 (depends on 10)

The color estimation method according to claim 10, further comprising:
in a case in which there are the light receiving elements having received light and the light receiving elements having received light are adjacent to each other, determining that a plurality of colors is included in the color to which the light belongs and further estimating, based on information of color space including a hue ring as a parameter, the color to which the light belongs.

### Claim 12 (depends on 7)

The color estimation method according to claim 7, further comprising:
identifying, based on a type of a wavelength band of light that passes through a transparent member, color to which the light belongs, the transparent member being included in a color filter in which the transparent member through which light in a wavelength band corresponding to each of three primary colors passes is regularly arranged so as to correspond to each position of the plurality of arranged light receiving elements.

### Claim 13 (depends on 7)

The color estimation method according to claim 7, further comprising:
decoding from the color estimated in the estimating to information for use in a communication system that modulates information to color to communicate.
