# US 10,768,097 B2 · Analyzer, image capturing apparatus that acquires color information, analyzing method, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,768,097 B2 - Document ID: US10768097B2 - Status: Granted - Kind: B2 - Application number: 15/916,758 - Filed: 2018-03-09 - Published: 2018-09-20 - Granted: 2020-09-08 - Earliest claimed: 2017-03-15 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Daisuke Sano; Tsubasa Nakamura; Hironobu Koga - Web page: https://patentgrep.com/patent/US10768097B2 ## CPC - G01N 21/27: using photo-electric detection (G01N21/31 takes precedence){; circuits for computing concentration (logarithmic circuits G06G7/24; photometric circuits in general G01J)} - G01J 3/0208: {using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction} - G01J 3/0297: {Constructional arrangements for removing other types of optical noise or for performing calibration} - G01J 3/42: Absorption spectrometry; Double beam spectrometry; Flicker spectrometry; Reflection spectrometry (beam switching arrangements G01J3/08) - G01J 3/50: using electric radiation detectors - G01J 3/513: {having fixed filter-detector pairs} - G01J 3/524: {Calibration of colorimeters} - G01N 21/274: {Calibration, base line adjustment, drift correction} - G01N 21/33: using ultraviolet light (G01N21/39 takes precedence) - G01N 21/35: using infrared light (G01N21/39 takes precedence) - G06T 7/90: Determination of colour characteristics - G01J 2003/1213: {Filters in general, e.g. dichroic, band} - G01J 2003/1282: {Spectrum tailoring} - G01N 2201/129: Using chemometrical methods - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An analyzer includes an acquirer configured to acquire color information on visible light and at least one of ultraviolet light and infrared light from image data, a memory configured to store reference data on the color information, and a determiner configured to determine characteristic data of an object in the image data based on the color information, the reference data, and an image capturing condition information. The image capturing condition information contains information on a spectral characteristic of illumination light in image capturing, and a spectral sensitivity curve of an image sensor and information on a spectral transmittance of an image capturing optical system. ## Claims ### Claim 1 An analyzer comprising: one or more processors configured to: acquire first color information on visible light and at least one of ultraviolet light and infrared light from first image data, the first image data being obtained by first image capturing using a first image sensor and a first image capturing optical system; acquire second color information on visible light and at least one of ultraviolet light and infrared light from second image data, the second image data being obtained by second image capturing using a second image sensor and a second image capturing optical system; determine first characteristic data relating to material information of an object contained in the first image data based on the first color information, first image capturing condition information, and reference data in which the color information of the object is tagged with the material information; and determine second characteristic data relating to material information of the object contained in the second image data based on the second color information, second image capturing condition information, and the reference data, wherein the first image capturing condition information contains information on a spectral characteristic of illumination light in the first image capturing, information on a spectral sensitivity curve of the first image sensor, and information on a spectral transmittance of the first image capturing optical system, and wherein the second image capturing condition information contains information on a spectral characteristic of illumination light in the second image capturing, information on a spectral sensitivity curve of the second image sensor, and information on a spectral transmittance of the second image capturing optical system. ### Claim 2 (depends on 1) The analyzer according to claim 1, the one or more processors is configured to measure the spectral characteristic of the illumination light. ### Claim 3 (depends on 1) The analyzer according to claim 1, the one or more processors is configured to calculate an object distance, wherein the first and second image capturing condition information contains information on the object distance. ### Claim 4 (depends on 1) The analyzer according to claim 1, wherein the color information is luminance information on the visible light and the at least one of ultraviolet light and infrared light. ### Claim 5 (depends on 1) The analyzer according to claim 1, wherein the color information contains color information on three colors of R, G, and B as the color information on the visible light. ### Claim 6 (depends on 1) The analyzer according to claim 1, wherein the reference data is data on a predetermined dictionary or a multivariate analysis equation. ### Claim 7 (depends on 1) The analyzer according to claim 1, wherein the one or more processors is configured to correct the first and second color information based on the first and second image capturing condition information, and determine the first and second characteristic data based on the corrected first and second color information and the reference data. ### Claim 8 (depends on 1) The analyzer according to claim 1, wherein the one or more processors is configured to correct the reference data based on the first and second image capturing condition information, and calculate the first and second characteristic data based on the first and second color information and the corrected reference data. ### Claim 9 (depends on 1) The analyzer according to claim 1, wherein the first and second characteristic data are different each other when the first and second color information is common. ### Claim 10 (depends on 1) The analyzer according to claim 1, wherein the one or more processors is configured to determine the first and second characteristic data by using the first and second image capturing condition information and the reference data tagged with each other, and a change amount of the first and second image capturing condition information. ### Claim 11 (depends on 1) The analyzer according to claim 1, wherein the first and second image data is obtained through noise reduction processing that is different according to wavelengths of the visible light and the at least one of ultraviolet light and infrared light. ### Claim 12 (depends on 1) The analyzer according to claim 1, further comprising an image generator configured to generate a viewable image based on the first and second color information. ### Claim 13 (depends on 1) An image capturing apparatus comprising: the analyzer according to claim 1; and an image capturer including the first image sensor and the first image capturing optical system, configured to output the first image data. ### Claim 14 (depends on 13) The image capturing apparatus according to claim 13, wherein the information on the first characteristic data contains a parameter used to determine the first characteristic data. ### Claim 15 An analyzing method comprising the steps of: acquiring first color information on visible light and at least one of ultraviolet light and infrared light from first image data, the first image data being obtained by first image capturing using a first image sensor and a first image capturing optical system; acquiring second color information on visible light and at least one of ultraviolet light and infrared light from second image data, the second image data being obtained by second image capturing using a second image sensor and a second image capturing optical system; determining first characteristic data relating to material information of an object contained in the first image data based on the first color information, first image capturing condition information, and reference data in which the color information of the object is tagged with the material information; and determining second characteristic data relating to material information of the object contained in the second image data based on the second color information, second image capturing condition information, and the reference data, wherein the first image capturing condition information contains information on a spectral characteristic of illumination light in the first image capturing, information on a spectral sensitivity curve of the first image sensor, and information on a spectral transmittance of the first image capturing optical system, and wherein the second image capturing condition information contains information on a spectral characteristic of illumination light in the second image capturing, information on a spectral sensitivity curve of the second image sensor, and information on a spectral transmittance of the second image capturing optical system. ### Claim 16 (depends on 15) A non-transitory computer-readable storage medium storing a program that enables a computer to execute the analyzing method according to claim 15.