# US 2021/0176412 A1 · Dual camera module including hyperspectral camera module, apparatuses including dual camera module, and method of operating the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176412 A1
- Document ID: US20210176412A1
- Status: Published application
- Kind: A1
- Application number: 17/105,103
- Filed: 2020-11-25
- Published: 2021-06-10
- Earliest claimed: 2019-12-05
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Youngzoon YOON; Hyochul KIM
- Web page: https://patentgrep.com/patent/US20210176412A1

## CPC

- G01J 3/0229: {using masks, aperture plates, spatial light modulators or spatial filters, e.g. reflective filters}
- G01J 3/0248: {using a sighting port, e.g. camera or human eye}
- G01J 3/0264: {Electrical interface; User interface}
- G01J 3/0272: {Handheld}
- G01J 3/28: Investigating the spectrum (using colour filters G01J3/51)
- G01J 3/2823: {Imaging spectrometer}
- H04N 9/76: for mixing of colour signals (H04N9/75 takes precedence)
- H04N 23/11: for generating image signals from visible and infrared light wavelengths
- H04N 23/13: with multiple sensors
- H04N 23/841: {to modify gamut}
- H04N 25/135: {based on four or more different wavelength filter elements}
- G01J 2003/2826: {Multispectral imaging, e.g. filter imaging}
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A dual camera module including a hyperspectral camera module, an apparatus including the same, and a method of operating the apparatus are provided. The dual camera module includes a hyperspectral camera module configured to provide a hyperspectral image of a subject; and an RGB camera module configured to provide an image of the subject, and obtain an RGB correction value applied to correction of the hyperspectral image.

## Claims

### Claim 1

A dual camera module providing a corrected image of a hyperspectral image, the dual camera module comprising:
a hyperspectral camera module configured to provide a hyperspectral image of a subject; and
an RGB camera module configured to:
provide an image of the subject, and
obtain an RGB correction value applied to correction of the hyperspectral image.

### Claim 2 (depends on 1)

The dual camera module of claim 1, wherein the image of the subject provided by the RGB camera module comprises an RGB image obtained by using red light, green light, and blue light as a main light, or an image obtained by using infrared light together with red light, green light, and blue light as the main light.

### Claim 3 (depends on 2)

The dual camera module of claim 2, wherein the main light further includes ultraviolet light.

### Claim 4 (depends on 1)

The dual camera module of claim 1, wherein the RGB camera module comprises:
a first optical guide module; and
a first image sensor configured to sense the image of the subject.

### Claim 5 (depends on 4)

The dual camera module of claim 4, wherein the first image sensor comprises a plurality of pixels, and each pixel of the plurality of pixels comprises four different sub-pixels.

### Claim 6 (depends on 4)

The dual camera module of claim 4, wherein the first image sensor comprises a plurality of pixels, and each pixel of the plurality of pixels comprises six sub-pixels.

### Claim 7 (depends on 6)

The dual camera module of claim 6, wherein five sub-pixels of the six sub-pixels are different from each other.

### Claim 8 (depends on 1)

The dual camera module of claim 1, wherein the hyperspectral camera module comprises:
a second optical guide module;
a hyperspectral filter configured to generate the hyperspectral image; and
a second image sensor configured to sense the hyperspectral image.

### Claim 9 (depends on 8)

The dual camera module of claim 8, further comprising a low pass filter provided between the second optical guide module and the hyperspectral filter.

### Claim 10

An electronic apparatus comprising:
a display on which an image of a subject is displayed;
a dual camera module configured to provide a corrected image of a hyperspectral image of the subject;
a driving control circuit unit configured to control the dual camera module; and
a battery that provides power to the dual camera module,
wherein the dual camera module comprises:
a hyperspectral camera module configured to provide the hyperspectral image of the subject; and
an RGB camera module configured to provide the image of the subject and obtain an RGB correction value applied to correction of the hyperspectral image.

### Claim 11 (depends on 10)

The electronic apparatus of claim 10, further comprising a light source configured to illuminate the subject.

### Claim 12

A mirror-type display apparatus comprising:
a mirror-type display;
a light source provided around the mirror-type display;
a first camera module that provides a first image of a subject; and
a second camera module that provides a second image of the subject,
wherein the first image have first spectral characteristics and the second image have second spectral characteristics which are different from the second spectral characteristics.

### Claim 13 (depends on 12)

The mirror-type display apparatus of claim 12, wherein one of the first camera module and the second camera module comprises a hyperspectral camera module.

### Claim 14

A method of operating an apparatus comprising a dual camera module, the method comprising:
acquiring, by a first camera module, a first image comprising first spectral information;
acquiring, by a second camera module different from the first camera module, a second image comprising second spectral information, an amount of the second spectral information being greater than an amount of the first spectral information; and
increasing a resolution of the second image by using the first spectral information of the first image.

### Claim 15 (depends on 14)

The method of claim 14, wherein the first image is an RGB image having a resolution that is higher than the resolution of the second image.

### Claim 16 (depends on 14)

The method of claim 14, wherein the second image is a hyperspectral image.

### Claim 17 (depends on 14)

The method of claim 14, wherein the increasing of the resolution of the second image comprises:
obtaining a first average value and a deviation of the first spectral information of the first image;
obtaining a second average value of the second spectral information of the second image; and
adding the deviation to the second average value.

### Claim 18 (depends on 17)

The method of claim 17, wherein the obtaining of the first average value and the deviation comprises:
obtaining a first average R value, a first average G value, and a first average B value of a plurality of pixels included in a first image sensor by which the first image is sensed; and
obtaining, for each pixel of the plurality of pixels, deviations between the first average R value, the first average G value, and the first average B value and a respective R value, G value, and B value of the pixel.

### Claim 19 (depends on 18)

The method of claim 18, wherein the obtaining of the second average value comprises:
dividing a unit pixel of a second image sensor, by which the second image is sensed, into a plurality of spectral pixels, wherein each spectral pixel from among the plurality of spectral pixels includes a plurality of channels; and
obtaining a second average R value, a second average G value, and a second average B value for the plurality of spectral pixels,
wherein a number of the plurality of spectral pixels is less than a number of the plurality of channels, and
wherein the number of the plurality of spectral pixels varies depending on a number of sub-pixels included in each pixel from among the plurality of pixels included in the first image sensor.

### Claim 20 (depends on 19)

The method of claim 19, wherein the number of sub-pixels is four or six.

### Claim 21

A hyperspectral camera module providing a corrected hyperspectral image, the hyperspectral camera module comprising:
a first camera module configured to provide a first image of a subject; and
a second camera module configured to provide a second image of the subject, wherein the second image is different from the first image.

### Claim 22 (depends on 21)

The hyperspectral camera module of claim 21, wherein the first image comprises an RGB image.

### Claim 23 (depends on 21)

The hyperspectral camera module of claim 21, wherein the first image comprises an image obtained by using red light, green light, blue light, and infrared light as main light.

### Claim 24 (depends on 21)

The hyperspectral camera module of claim 21, wherein the first image comprises an image obtained by using red light, green light, blue light, and UV light as main light.

### Claim 25 (depends on 21)

The hyperspectral camera module of claim 21, wherein the first image comprises an image obtained by using red light, green light, blue light, infrared light, and UV light as main light.

### Claim 26 (depends on 21)

The hyperspectral camera module of claim 21, wherein the hyperspectral camera module is configured to obtain an RGB correction value based on the first image and to obtain a hyperspectral image based on the RGB correction value.

### Claim 27 (depends on 21)

The hyperspectral camera module of claim 21, wherein the second image comprises an uncorrected hyperspectral image.
