# US 11,079,277 B2 · Spectral imaging device and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,079,277 B2
- Document ID: US11079277B2
- Status: Granted
- Kind: B2
- Application number: 16/711,110
- Filed: 2019-12-11
- Published: 2021-04-29
- Granted: 2021-08-03
- Earliest claimed: 2019-10-28
- Assignees: National Taiwan University
- Applicants: National Taiwan University
- Inventors: Ching-Fuh Lin
- Web page: https://patentgrep.com/patent/US11079277B2

## CPC

- G01J 3/2823: {Imaging spectrometer}
- G01J 3/0272: {Handheld}
- G01J 3/10: Arrangements of light sources specially adapted for spectrometry or colorimetry
- G01J 3/32: Investigating bands of a spectrum in sequence by a single detector
- G01J 3/501: {Colorimeters using spectrally-selective light sources, e.g. LEDs}
- G02B 21/33: Immersion oils {, or microscope systems or objectives for use with immersion fluids}
- G01J 2003/102: {Plural sources}
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

The present invention provides a spectral imaging apparatus and method featuring in that spectra are obtained from the captured photographs for composition analysis. In addition, the environment can be protected by using to the spectral imaging device and method. Furthermore, a true color photo can also be obtained.

## Claims

### Claim 1

A spectral imaging device, comprising:
a diode array comprising N diodes, wherein N is a positive integer, the N diodes are N light-emitting diodes or N laser diodes, and each of the N diodes emits a light having a wavelength range different from that of other diodes; and
an image sensor continuously capturing N images of an object or a scene having the object over a spectral range, the spectral range being divided into N spectral bands, each of the N diodes corresponding to one of the N spectral bands, wherein for each capture, the image sensor captures an image over one of the N spectral bands, and only the diode corresponding to the one of the N spectral bands emits light to provide a light source for capturing the image, and the remaining diodes do not emit light, and the image sensor further captures an image of the object or the scene having the object on a condition that all of the N diodes do not emit light;
wherein each of the spectral bands has a bandwidth equal to or less than 10 nm.

### Claim 2 (depends on 1)

The spectral imaging device as recited in claim 1, further comprising:
a processor that processes and obtains spectra of individual pixels of the object over the spectral range from the captured N+1 images, and then determines the composition of the object according to the spectra.

### Claim 3 (depends on 2)

The spectral imaging device as recited in claim 2, wherein the N diodes illuminate in turn and the image sensor captures the N images, and the processor subtracts respective intensities of individual pixels of the image captured by the image sensor on the condition that all of the N diodes do not emit light, from respective intensities of individual pixels of the N images, and then the N images are recombined to get a true color photo.

### Claim 4 (depends on 3)

The spectral imaging device as recited in claim 3, wherein the N images are recombined and calibrated by a spectral sensitivity spectrum of human eye and an emission spectrum of a reference light source.

### Claim 5 (depends on 1)

The spectral imaging device as recited in claim 1, wherein one or more diodes of the diode array employ an optical coating to reduce their bandwidth.

### Claim 6 (depends on 1)

The spectral imaging device as recited in claim 1, wherein each of the one or more diodes of the diode array has a bandwidth of 5 nm or 3 nm.

### Claim 7 (depends on 1)

The spectral imaging device as recited in claim 1, wherein one or more diodes of the diode array employ metal nanostructures to reduce their bandwidth.

### Claim 8 (depends on 7)

The spectral imaging device as recited in claim 7, wherein the metal nanostructures comprises periodically arranged metal nanowires.

### Claim 9 (depends on 1)

The spectral imaging device as recited in claim 1, wherein the spectral imaging device is a mobile phone.

### Claim 10 (depends on 9)

The spectral imaging device as recited in claim 9, wherein the diode array is disposed on a device independent of the mobile phone and is electrically connected to the mobile phone.

### Claim 11 (depends on 9)

The spectral imaging device as recited in claim 9, further comprising: an application installed in the mobile phone to control an illuminating order of the diode array.

### Claim 12

A spectral imaging method, comprising the steps of:
providing a diode array that comprising N diodes, wherein N is a positive integer, the N diodes are N light-emitting diodes or N laser diodes, and each of the N diodes emits a light having a wavelength range different from that of other diodes;
continuously capturing N images of an object or a scene having the object over a spectral range, wherein the spectral range is divided into N spectral bands, each of the diodes corresponding to one of the N spectral bands, and wherein for each capture, one image is captured over one of the N spectral bands, and only the diode corresponding to the one of the N spectral bands emits light to provide a light source for capturing the image, and the remaining diodes do not emit light;
capturing an image of the object or the scene having the object on a condition that all of the N diodes do not emit light;
obtaining spectra of individual pixels of the object over the spectral range from the captured N+1 images; and
determining the composition of the object according to the spectra.

### Claim 13 (depends on 12)

The spectral imaging method as recited in claim 12, further comprising:
subtracting respective intensities of individual pixels of the image captured on the condition that all of the N diodes do not emit light, from respective intensities of individual pixels of the N images; and
recombining the N images to form a true color photo.

### Claim 14 (depends on 13)

The spectral imaging method as recited in claim 13, wherein the step of forming the true color photo comprises:
obtaining respective spectra of individual pixels over the spectral range from the captured N images;
calculating chromaticity coordinates of individual pixels of the true color photo, wherein the chromaticity coordinates of individual pixels are obtained by respectively performing a linear combination of the respective spectra of the individual pixels, a spectral sensitivity spectrum of human eye, and a spectrum of a reference light source.

### Claim 15 (depends on 14)

The spectral imaging method as recited in claim 14, wherein the reference light source is a known spectrum.

### Claim 16 (depends on 14)

The spectral imaging method as recited in claim 14, wherein the spectrum of the reference light source is a spectrum of an ambient light at the moment of capturing images.

### Claim 17 (depends on 16)

The spectral imaging method as recited in claim 16, wherein the spectrum of the ambient light at the moment of capturing images is calculated based on: (1) the image captured on the condition that all of the N diodes do not emit light; (2) the captured N images that are calibrated by a spectral response spectrum of an image sensor capturing the N images and further calibrated by respective emission spectra of the N diodes; and (3) the spectral response spectrum of the image sensor, wherein for a certain pixel and a certain wavelength, an intensity (λ) of the ambient light at the moment of capturing images is obtain by the following equation:
Iλ(ambient)−object calibrated spectrum×ambient light (λ)×image sensor(λ),
wherein the ambient light (λ) denotes the intensity (λ) of the ambient light at the moment of capturing the images, Iλ (ambient) denotes the intensity of the certain pixel of the image captured by the image sensor on the condition that all N diodes do not emit light, the object calibrated spectrum denotes the intensity of the certain pixel of the image captured by the image sensor on the condition that only the corresponding diode (λ) emits the light and the intensity is further calibrated according to spectral response (λ) of the image sensor and the emission spectrum of the corresponding diode (λ), and the image sensor (λ) is the spectral response or relative response of the image sensor at the corresponding wavelength (λ).

### Claim 18 (depends on 14)

The spectral imaging method as recited in claim 14, wherein before the linear combination, the respective spectra are further calibrated by a spectral response spectrum of an image sensor that captures the N images.

### Claim 19 (depends on 14)

The spectral imaging method as recited in claim 14, wherein before the linear combination, the respective spectra are further respectively calibrated by a spectrum of the corresponding diode.

### Claim 20 (depends on 12)

The spectral imaging method as recited in claim 12, wherein each of the spectral bands with a bandwidth equal to or less than 10 nm.