# US 2012/0249855 A1 · Image Capture Using Display Device as Light Source

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249855 A1
- Document ID: US20120249855A1
- Status: Published application
- Kind: A1
- Application number: 13/493,837
- Filed: 2012-06-11
- Published: 2012-10-04
- Earliest claimed: 2005-10-11
- Assignees: Apple Inc.
- Inventors: Jean-Pierre Ciudad; Alexandre Aybes; Peter Westen; Gregory N. Christie; Scott Forstall
- Web page: https://patentgrep.com/patent/US20120249855A1

## CPC

- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 7/141: {between two video terminals, e.g. videophone (telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085)}
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 23/56: provided with illuminating means
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A digital image capture system and method uses a display device to illuminate a target with light for improved image capture under poor lighting conditions. Various characteristics of the flash (e.g., brightness, color, duration, etc.) can be adjusted to improve image capture. Users are provided with feedback (e.g., live video feed, audio and/or visual countdowns, etc.) to assist them in preparing for image capture. The captured images are seamlessly integrated with existing applications (e.g., video conferencing, instant text messaging, etc.).

## Claims

### Claim 1

A method of capturing digital images, comprising:
measuring, by a mobile device, ambient light of a target environment, the measuring comprising averaging pixel intensities of a video image of the target environment;
determining, by the mobile device, a flash brightness based on the measured ambient light;
illuminating a target in the target environment with light emitted from a device configured to emit the light at the flash brightness; and
capturing, by the mobile device, a digital image of the illuminated target.

### Claim 2 (depends on 1)

The method of claim 1, wherein illuminating the target includes:
determining a flash duration, the flash duration including a rise time, a sustain time, and a fall time; and
emitting the light for the flash duration.

### Claim 3 (depends on 2)

The method of claim 2, wherein capturing the digital image includes capturing the digital image at an image capture time, the image capture time determined based on the rise time, the sustain time, and a frame latency.

### Claim 4 (depends on 3)

The method of claim 3, wherein:
the device configured to emit the light is a display device of the mobile device, and
the frame latency is determined by a difference between an image timestamp provided by an image capturing device and a time when the video image is displayed on the display device.

### Claim 5

A system, comprising:
a mobile device configured to perform operations of capturing digital images, the operations comprising:
measuring, by the mobile device, ambient light of a target environment, the measuring comprising averaging pixel intensities of a video image of the target environment;
determining, by the mobile device, a flash brightness based on the measured ambient light;
illuminating a target in the target environment with light emitted from a device configured to emit the light at the flash brightness; and
capturing, by the mobile device, a digital image of the illuminated target.

### Claim 6 (depends on 5)

The system of claim 5, wherein illuminating the target includes:
determining a flash duration, the flash duration including a rise time, a sustain time, and a fall time; and
emitting the light for the flash duration.

### Claim 7 (depends on 6)

The system of claim 6, wherein capturing the digital image includes capturing the digital image at an image capture time, the image capture time determined based on the rise time, the sustain time, and a frame latency.

### Claim 8 (depends on 7)

The system of claim 7, wherein:
the device configured to emit the light is a display device of the mobile device, and
the frame latency is determined by a difference between an image timestamp provided by an image capturing device and a time when the video image is displayed on the display device.

### Claim 9

A non-transitory computer readable medium having stored thereon instructions operable to cause a data processing apparatus to perform operations of capturing digital images, the operations comprising:
measuring, by a mobile device, ambient light of a target environment, the measuring comprising averaging pixel intensities of a video image of the target environment;
determining, by the mobile device, a flash brightness based on the measured ambient light;
illuminating a target in the target environment with light emitted from a device configured to emit the light at the flash brightness; and
capturing, by the mobile device, a digital image of the illuminated target.

### Claim 10 (depends on 9)

The medium of claim 9, wherein illuminating the target includes:
determining a flash duration, the flash duration including a rise time, a sustain time, and a fall time; and
emitting the light for the flash duration.

### Claim 11 (depends on 10)

The medium of claim 10, wherein capturing the digital image includes capturing the digital image at an image capture time, the image capture time determined based on the rise time, the sustain time, and a frame latency.

### Claim 12 (depends on 11)

The medium of claim 11, wherein:
the device configured to emit the light is a display device of the mobile device, and
the frame latency is determined by a difference between an image timestamp provided by an image capturing device and a time when the video image is displayed on the display device.

### Claim 13

A method of capturing digital images, comprising:
computing, by a mobile device, a color balance of a target environment, the computing comprising evaluating a quality of an image of the target environment based on pixel intensity distribution of the image of the target environment;
determining, by the mobile device, a flash color based on the computed color balance;
illuminating a target in the target environment with light emitted from a device configured to emit the light at the flash color; and
capturing, by the mobile device, a digital image of the illuminated target.

### Claim 14 (depends on 13)

The method of claim 13, wherein the device configured to emit the light at the flash color is a display screen of the mobile device.

### Claim 15 (depends on 14)

The method of claim 14, comprising changing a color of the display screen to a complementary color of a color of the target before illuminating the target.

### Claim 16 (depends on 13)

The method of claim 13, wherein computing the color balance comprises computing a histogram that represents a color distribution of the image of the target environment.

### Claim 17 (depends on 16)

The method of claim 16, wherein computing the histogram comprises at least one of:
computing a histogram that represent a color distribution of a nonmoving portion of the image of the target environment; or
computing a histogram that represent a color distribution of a moving portion of the image of the target environment for correcting skin tone exposure.

### Claim 18

A system, comprising:
a mobile device configured to perform operations comprising:
computing, by a mobile device, a color balance of a target environment, the computing comprising evaluating a quality of an image of the target environment based on pixel intensity distribution of the image of the target environment;
determining, by the mobile device, a flash color based on the computed color balance;
illuminating a target in the target environment with light emitted from a device configured to emit the light at the flash color; and
capturing, by the mobile device, a digital image of the illuminated target.

### Claim 19 (depends on 18)

The system of claim 18, wherein the device configured to emit the light at the flash color is a display screen of the mobile device.

### Claim 20 (depends on 19)

The system of claim 19, comprising changing a color of the display screen to a complementary color of a color of the target before illuminating the target.

### Claim 21 (depends on 18)

The system of claim 18, wherein computing the color balance comprises computing a histogram that represents a color distribution of the image of the target environment.

### Claim 22 (depends on 21)

The system of claim 21, wherein computing the histogram comprises at least one of:
computing a histogram that represent a color distribution of a nonmoving portion of the image of the target environment; or
computing a histogram that represent a color distribution of a moving portion of the image of the target environment for correcting skin tone exposure.

### Claim 23

A non-transitory computer readable medium having stored thereon instructions operable to cause a data processing apparatus to perform operations comprising:
computing, by a mobile device, a color balance of a target environment, the computing comprising evaluating a quality of an image of the target environment based on pixel intensity distribution of the image of the target environment;
determining, by the mobile device, a flash color based on the computed color balance;
illuminating a target in the target environment with light emitted from a device configured to emit the light at the flash color; and
capturing, by the mobile device, a digital image of the illuminated target.

### Claim 24 (depends on 23)

The medium of claim 23, wherein the device configured to emit the light at the flash color is a display screen of the mobile device.

### Claim 25 (depends on 24)

The medium of claim 24, comprising changing a color of the display screen to a complementary color of a color of the target before illuminating the target.

### Claim 26 (depends on 23)

The medium of claim 23, wherein computing the color balance comprises computing a histogram that represents a color distribution of the image of the target environment.

### Claim 27 (depends on 26)

The medium of claim 26, wherein computing the histogram comprises at least one of:
computing a histogram that represent a color distribution of a nonmoving portion of the image of the target environment; or
computing a histogram that represent a color distribution of a moving portion of the image of the target environment for correcting skin tone exposure.
