# US 10,321,070 B2 · Electronic device with self-image capturing function and self-image capturing method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,321,070 B2
- Document ID: US10321070B2
- Status: Granted
- Kind: B2
- Application number: 15/602,124
- Filed: 2017-05-23
- Published: 2017-11-30
- Granted: 2019-06-11
- Earliest claimed: 2016-05-25
- Assignees: Hongfujin Precision Electronics (Zhengzhou) Co., Ltd.; Hon Hai Precision Industry Co., Ltd.
- Applicants: Hongfujin Precision Electronics (Zhengzhou) Co., Ltd.; Hon Hai Precision Industry Co., Ltd.
- Inventors: Jun-Wei Zhang; Tsung-Jen Chuang; Sen Fan
- Web page: https://patentgrep.com/patent/US10321070B2

## CPC

- H04N 5/265: Mixing
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure}
- H04N 5/907: using static stores, e.g. storage tubes or semiconductor memories (H04N5/91 takes precedence)
- H04N 23/20: for generating image signals from infrared radiation only
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T 2207/10024: Color image
- G06T 2207/10048: Infrared image
- G06T 2207/20221: Image fusion; Image merging
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A self-image capturing method includes a user activating a capturing device, controlling a light detecting device to detect ambient light intensity around an electronic device, determining whether the light intensity detected by the light detecting device is less than a predetermined value, activating the infrared capturing device when determining that the light intensity detected by the light detecting device is less than the predetermined value, controlling the capturing device to capture a selfie image of the user in response to an operation from the user, controlling the infrared capturing device to capture an infrared selfie image, and synthesizing the two captured images into a single selfie image.

## Claims

### Claim 1

An electronic device with a self-image capturing function comprising:
at least one processor;
a light detecting device electrically coupled to the at least one processor;
a capturing device electrically coupled to the at least one processor;
an infrared capturing device electrically coupled to the at least one processor;
a storage device comprising an image folder electrically coupled to the at least one processor and storing instructions for execution by the at least one processor to cause the at least one processor to:
activate the capturing device in response to an activating operation from a user;
control the light detecting device to detect ambient light intensity around the electronic device;
determine, when the capturing device is activated, whether the light intensity detected by the light detecting device is less than a predetermined value;
activate the infrared capturing device when determined the light intensity detected by the light detecting device is less than the predetermined value;
control the capturing device to capture a selfie image of the user in response to an operation from the user;
control, when the capturing device is capturing the image of the user, the infrared capturing device to capture an infrared selfie image of the user;
synthesize the selfie image captured by the capturing device and the infrared selfie image captured by the infrared capturing device to a single selfie image; and
store the selfie image captured by the capturing device, the infrared selfie image captured by the infrared capturing device, and the synthesized selfie image into the image folder.

### Claim 2 (depends on 1)

The electronic device according to claim 1, wherein the at least one processor is further caused to:
store the selfie image captured by the capturing device, the infrared selfie image captured by the infrared capturing device, and the synthesized selfie image into the storage device.

### Claim 3 (depends on 1)

The electronic device according to claim 1, wherein the at least one processor is further caused to:
synthesize the selfie image captured by the capturing device and the infrared selfie image captured by the infrared capturing device to the selfie image through image fusion technology.

### Claim 4 (depends on 3)

The electronic device according to claim 3, wherein the at least one processor is further caused to:
preprocess the selfie image and the infrared selfie image;
acquire luminance components of the selfie image and the infrared selfie image by means of color space converting;
extract marginal information of the luminance components of the selfie image;
fuse the marginal information of the selfie image and the luminance components of the infrared selfie image to fused luminance components;
assign a pseudo color to the infrared selfie image to generate a pseudo color infrared image;
acquire hue components and saturation components of the pseudo color infrared image by means of color space converting; and
acquire a fused image with the pseudo color according to the fused luminance components, the hue components, and the saturation components by means of color space inverse converting.

### Claim 5 (depends on 1)

The electronic device according to claim 1, wherein the infrared capturing device is an infrared camera.

### Claim 6

A self-image capturing method comprising:
activating a capturing device in response to an activating operation from a user;
controlling a light detecting device to detect ambient light intensity around an electronic device;
determining whether the light intensity detected by the light detecting device is less than a predetermined value when the capturing device is activated;
activating the infrared capturing device when determined the light intensity detected by the light detecting device is less than the predetermined value;
controlling the capturing device to capture a selfie image of the user in response to an operation from the user;
controlling the infrared capturing device to capture an infrared selfie image of the user when the capturing device is capturing the image of the user;
synthesizing the selfie image captured by the capturing device and the infrared selfie image captured by the infrared capturing device to a single selfie image; and
storing the selfie image captured by the capturing device, the infrared selfie image captured by the infrared capturing device, and the synthesized selfie image into an image folder of the storage device.

### Claim 7 (depends on 6)

The self-image capturing according to claim 6, further comprising:
storing the selfie image captured by the capturing device, the infrared selfie image captured by the infrared capturing device, and the synthesized selfie image into a storage device.

### Claim 8 (depends on 6)

The self-image capturing method according to claim 6, wherein the selfie image is synthesized through an image fusion method.

### Claim 9 (depends on 8)

The self-image capturing method according to claim 8, wherein the image fusion method comprising:
preprocessing the selfie image and the infrared selfie image;
acquiring luminance components of the selfie image and the infrared selfie image by means of color space converting;
extracting marginal information of the luminance components of the selfie image;
fusing the marginal information of the selfie image and the luminance components of the infrared selfie image to fused luminance components;
assigning a pseudo color to the infrared selfie image to generate a pseudo color infrared image;
acquiring hue components and saturation components of the pseudo color infrared image by means of color space converting; and
acquiring a fused image with the pseudo color according to the fused luminance components, the hue components, and the saturation components by means of color space inverse converting.