# US 2023/0053797 A1 · Information Processing Device, Information Processing System, And Information Processing Method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0053797 A1
- Document ID: US20230053797A1
- Status: Published application
- Kind: A1
- Application number: 17/892,447
- Filed: 2022-08-22
- Published: 2023-02-23
- Earliest claimed: 2021-08-23
- Assignees: Seiko Epson Corporation
- Applicants: Seiko Epson Corporation
- Inventors: Kei KANEMOTO
- Web page: https://patentgrep.com/patent/US20230053797A1

## CPC

- G01J 3/2823: {Imaging spectrometer}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 10/143: Sensing or illuminating at different wavelengths
- G01J 3/26: using multiple reflection, e.g. Fabry-Perot interferometer, variable interference filters
- G01J 3/462: {Computing operations in or between colour spaces; Colour management systems}
- G01N 21/8851: {Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges (G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002)}
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

An information processing device includes an image acquisition unit configured to acquire spectroscopic images for a plurality of spectral wavelengths as a captured image of an imaging target, a spectrum calculation unit configured to calculate an optical spectrum in each of pixels, based on the plurality of spectroscopic images, a feature wavelength detection unit configured to detect a feature wavelength of the optical spectrum in each of the pixels, a color set unit configured to calculate a feature angle corresponding to the feature wavelength in each of the pixels and set, as a feature color of a corresponding pixel, a color in the hue circle corresponding to the feature angle, and an image generation unit configured to generate a feature detection image obtained by converting each of the pixels of the captured image into the feature color corresponding to the pixel.

## Claims

### Claim 1

An information processing device comprising:
an image acquisition unit configured to acquire a plurality of spectroscopic images for a plurality of spectral wavelengths as a captured image of an imaging target;
a spectrum calculation unit configured to calculate an optical spectrum in each of pixels, based on the plurality of spectroscopic images;
a feature wavelength detection unit configured to detect a feature wavelength corresponding to a predetermined feature condition of the optical spectrum in each of the pixels;
a color set unit configured to calculate a feature angle corresponding to the feature wavelength in each of the pixels when a spectral wavelength range including the plurality of spectral wavelengths is allocated to a predetermined angle range of a hue circle, and set, as a feature color of a corresponding pixel, a color in the hue circle corresponding to the feature angle; and
an image generation unit configured to generate a feature detection image obtained by converting each of the pixels of the captured image into the feature color corresponding to the pixel.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the angle range of the hue circle is 270 degrees or smaller.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein
the color set unit sets the feature color, with a shortest wavelength in the spectral wavelength range as a minimum angle in the angle range, and with a longest wavelength in the spectral wavelength range as a maximum angle in the angle range.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein
the color set unit sets the feature color, with a shortest feature wavelength, of the feature wavelengths detected in a plurality of the pixels, as a minimum angle in the angle range, and with a longest feature wavelength as a maximum angle in the angle range.

### Claim 5 (depends on 1)

The information processing device according to claim 1, wherein
the feature wavelength detection unit detects n feature wavelengths corresponding to n feature conditions in each of the pixels and
the color set unit calculates the feature angle, based on each of projection points obtained by projecting feature points on a straight line, the straight line being obtained based on the feature points corresponding to the feature wavelength in each of the pixels and being plotted in an n-dimensional space having each of the n feature conditions as an axis.

### Claim 6 (depends on 5)

The information processing device according to claim 5, wherein
the straight line is a straight line with dispersion of the projection points corresponding to a plurality of the feature points maximized.

### Claim 7 (depends on 5)

The information processing device according to claim 5, wherein
the color set unit sets the feature color, with one of two points most separated away from each other on the straight line as a minimum angle in the angle range and the other one as a maximum angle in the angle range.

### Claim 8 (depends on 1)

The information processing device according to claim 1, wherein
the feature wavelength detection unit detects the feature wavelength, based on a secondary differential waveform of the optical spectrum in each of the pixels.

### Claim 9 (depends on 1)

An information processing system comprising:
the information processing device according to claim 1; and
a spectroscopic camera configured to image the captured image including the plurality of spectroscopic images of the imaging target.

### Claim 10

An information processing method for causing one or a plurality of processors to process image information, the information processing method causing the one or plurality of processors to execute:
acquiring a plurality of spectroscopic images for a plurality of spectral wavelengths as a captured image of an imaging target;
calculating an optical spectrum in each of pixels, based on the plurality of spectroscopic images;
detecting a feature wavelength corresponding to a predetermined feature condition of the optical spectrum in each of the pixels;
calculating a feature angle corresponding to the feature wavelength in each of the pixels when a spectral wavelength range including the plurality of spectral wavelengths is allocated to a predetermined angle range of a hue circle, and setting, as a feature color of a corresponding pixel, a color in the hue circle corresponding to the feature angle; and
generating a feature detection image obtained by converting each of the pixels of the captured image into the feature color corresponding to the pixel.
