# US 10,375,314 B1 · Using a display as a light source

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,314 B1
- Document ID: US10375314B1
- Status: Granted
- Kind: B1
- Application number: 15/459,289
- Filed: 2017-03-15
- Granted: 2019-08-06
- Earliest claimed: 2015-12-30
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Dhruv Bakshi; Jakob Nicolaus Foerster
- Web page: https://patentgrep.com/patent/US10375314B1

## CPC

- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N 7/141: {between two video terminals, e.g. videophone (telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085)}
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 9/12: Picture reproducers (H04N9/11 takes precedence)
- H04N 9/76: for mixing of colour signals (H04N9/75 takes precedence)
- H04N 23/56: provided with illuminating means
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/71: Circuitry for evaluating the brightness variation
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In general, the subject matter can be embodied in methods, systems, and program products for using a display of a computing device as a light source. The computing device receives a first image that was captured by a camera of the computing device, determines a brightness of at least part of the first image, selects an intensity of a light source that is to be presented by the display of the computing device, the intensity of the light source being selected based on the determined brightness of the at least part of the image, presents the light source by the display of the computing device, the presented light source having the selected intensity, and receives a second image that is captured by the camera of the computing device while the computing device is presenting the light source on the display using the selected intensity.

## Claims

### Claim 1

A computer-implemented method, comprising:
presenting, by a display of a computing device, a user interface;
receiving, by the computing device, a request to capture an image that includes a subject in a physical environment of the computing device, using a camera of the computing device;
determining, by the computing device, a color mix of the user interface that illuminates the subject in the physical environment during the capture of the image, wherein determining the color mix of the user interface includes the computing device analyzing the user interface to determine an average or dominant color of the user interface;
determining, by the computing device, a complementary color for a light source that includes a graphical interface element generated by the display to illuminate the subject in the physical environment during the capture of the image and to compensate for the color mix of the user interface, wherein determining the complementary color includes determining a color that is complementary to the color mix of the user interface;
concurrently presenting by the computing device on the display,
the color mix of the user interface and the light source having the complementary color such that the user interface and the light source both illuminate the subject in the physical environment, and the complementary color of the light source reduces a color effect on the subject from the color mix of the user interface illuminating the subject; and
receiving, by the computing device, the image that is captured by the camera of the computing device while the computing device is concurrently presenting the light source having the complementary color and the user interface having the color mix.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the light source is provided within the user interface.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the light source is provided at a first location on the user interface, wherein the method further comprises:
receiving, by the computing device, user input that moves the light source from the first location on the user interface to a second location on the user interface; and
providing, by the computing device and in response to having received the user input that moves the light source from the first location on the user interface to the second location on the user interface, the light source at the second location on the user interface.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the user input that moves the light source from the first location on the user interface to the second location on the user interface includes (i) a touch input selection of the light source at the first location on the user interface, and (ii) a dragging gesture across the user interface from the first location on the user interface to the second location on the user interface.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the light source is provided at a perimeter of the user interface.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the light source includes multiple different light sources evenly distributed and displayed throughout the user interface, each of the multiple different light sources having a same size.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the complementary color that is presented by the light source is complementary to the average or dominant color of the user interface based on a color wheel.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, further comprising:
transmitting, by the computing device, the image for display on a second computing device.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, further comprising:
removing, by the computing device and in response to having received the image, the light source having the complementary color; and
presenting, by the display of the computing device, another image that is captured by the camera of the computing device, after the light source having the complementary color has been removed.

### Claim 10

A computing system, comprising:
one or more processors; and
one or more non-transitory computer-readable devices including instructions that, when executed by the one or more processors, cause performance of operations including:
presenting, by a display of a computing device, a user interface;
receiving, by the computing device, a request to capture an image that includes a subject in a physical environment of the computing device, using a camera of the computing device;
determining, by the computing device, a color mix of the user interface that illuminates the subject in the physical environment during the capture of the image, wherein determining the color mix of the user interface includes the computing device analyzing the user interface to determine an average or dominant color of the user interface;
determining, by the computing device, a complementary color for a light source that includes a graphical interface element generated by the display to illuminate the subject in the physical environment during the capture of the image and to compensate for the color mix of-the user interface illuminating the subject in the physical environment, wherein determining the complementary color includes determining a color that is complementary to the color mix of the user interface;
concurrently presenting by the computing device on the display,
the user interface having the color mix and the light source emitting the complementary color such that the user interface and the light source both illuminate the subject in the physical environment, and the complementary color of the light source reduces a color effect on the subject from the color mix of the user interface illuminating the subject; and
receiving, by the computing device, the image that is captured by the camera of the computing device while the computing device is concurrently presenting on the display the light source having the complementary color and the user interface having the color mix.

### Claim 11 (depends on 10)

The computing system of claim 10, wherein the light source is provided within the user interface.

### Claim 12 (depends on 11)

The computing system of claim 11, wherein the light source is provided at a first location on the user interface, wherein the operations further comprise:
receiving, by the computing device, user input that moves the light source from the first location on the user interface to a second location on the user interface; and
providing, by the computing device and in response to having received the user input that moves the light source from the first location on the user interface to the second location on the user interface, the light source at the second location on the user interface.

### Claim 13 (depends on 12)

The computing system of claim 12, wherein the user input that moves the light source from the first location on the user interface to the second location on the user interface includes (i) a touch input selection of the light source at the first location on the user interface, and (ii) a dragging gesture across the user interface from the first location on the user interface to the second location on the user interface.

### Claim 14 (depends on 10)

The computing system of claim 10, wherein the light source is provided at a perimeter of the user interface.

### Claim 15 (depends on 10)

The computing system of claim 10, wherein the light source includes multiple different light sources evenly distributed and displayed throughout the user interface, each of the multiple different light sources having a same size.

### Claim 16 (depends on 10)

The computing system of claim 10, wherein the complementary color that is presented by the light source is complementary to the average or dominant color of the user interface.

### Claim 17 (depends on 10)

The computing system of claim 10, the operations further comprising:
transmitting, by the computing device, the image for display on a second computing device.

### Claim 18 (depends on 10)

The computing system of claim 10, the operations further comprising:
removing, by the computing device and in response to having received the image, the light source having the complementary color; and
presenting, by the display of the computing device, another image that is captured by the camera of the computing device, after the light source having the complementary color has been removed.

### Claim 19 (depends on 1)

The computer-implemented method of claim 1, further comprising automatically resizing the light source, by the computing device.

### Claim 20 (depends on 10)

The computing system of claim 10, the operations further comprising automatically resizing the light source, by the computing device.
