# US 2019/0356837 A1 · Using a Display as a Light Source

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356837 A1
- Document ID: US20190356837A1
- Status: Published application
- Kind: A1
- Application number: 16/530,914
- Filed: 2019-08-02
- Published: 2019-11-21
- Earliest claimed: 2015-12-30
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Dhruv Bakshi; Jakob Nicolaus Foerster
- Web page: https://patentgrep.com/patent/US20190356837A1

## CPC

- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N 7/141: {between two video terminals, e.g. videophone (telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085)}
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 9/12: Picture reproducers (H04N9/11 takes precedence)
- H04N 9/76: for mixing of colour signals (H04N9/75 takes precedence)
- H04N 23/56: provided with illuminating means
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/71: Circuitry for evaluating the brightness variation
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In general, the subject matter can be embodied in methods, systems, and program products for using a display of a computing device as a light source. The computing device receives a first image that was captured by a camera of the computing device, determines a brightness of at least part of the first image, selects an intensity of a light source that is to be presented by the display of the computing device, the intensity of the light source being selected based on the determined brightness of the at least part of the image, presents the light source by the display of the computing device, the presented light source having the selected intensity, and receives a second image that is captured by the camera of the computing device while the computing device is presenting the light source on the display using the selected intensity.

## Claims

### Claim 1

(canceled)

### Claim 2

A computer-implemented method, comprising:
capturing, by a computing device, a first image that includes a first subject in a physical environment of the computing device using a camera of the computing device;
determining, by the computing device, a brightness of the first subject in the first image, wherein during capture of the first image, the first subject is illuminated, at least in part, by a light source at a first location on the display;
determining, by the computing device, an intensity for the light source based on the determined brightness of the first subject in the first image;
detecting, by the computing device, a change event of the display that results, or would result, in the light source interfering with presenting of a user interface on the display, wherein the change event involves at least one of a change in the user interface or a change in the light source;
in response, at least in part, to the change event, automatically relocating, by the computing device, the light source to a second location on the display; and
capturing, by the computing device, a second image including the first subject illuminated by the light source relocated to the second location on the display.

### Claim 3 (depends on 2)

The computer implemented method of claim 2, wherein the light source includes a graphical element and relocating the light source includes presenting the graphical element at the second location on the display.

### Claim 4 (depends on 2)

The method of claim 2, wherein the change event includes at least one of moving or resizing the user interface or determining that the user interface is to be moved or resized.

### Claim 5 (depends on 2)

The method of claim 2, wherein the change event includes resizing of the light source or determining that the light source is to be resized.

### Claim 6 (depends on 2)

The method of claim 2, further comprising:
receiving, by the computing device, a video stream of images from a second computing device, wherein the received video stream of images is presented on the user interface concurrent with the light source.

### Claim 7 (depends on 2)

The method of claim 2, wherein interfering of the light source with the presenting of the user interface includes the light source obscuring a particular portion of the user interface and wherein the second location is away from the particular portion of the user interface.

### Claim 8 (depends on 7)

The method of claim 7, further comprising detecting a second subject in the particular portion of the user interface, wherein the automatically relocating of the light source to the second location is further in response to detecting the second subject in the particular portion of the user interface.

### Claim 9

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
capturing, by a computing device, a first image that includes a first subject in a physical environment of the computing device using a camera of the computing device;
determining, by the computing device, a brightness of the first subject in the first image, wherein during capture of the first image, the first subject is illuminated, at least in part, by a light source at a first location on the display;
determining, by the computing device, an intensity for the light source based on the determined brightness of the first subject in the first image;
detecting, by the computing device, a change event of the display that results, or would result, in the light source interfering with presenting of a user interface on the display, wherein the change event involves at least one of a change in the user interface or a change in the light source;
in response, at least in part, to the change event, automatically relocating, by the computing device, the light source to a second location on the display; and
capturing, by the computing device, a second image including the first subject illuminated by the light source relocated to the second location on the display.

### Claim 10 (depends on 9)

The computer-readable medium of claim 9, wherein the light source includes a graphical element and relocating the light source includes presenting the graphical element at the second location on the display.

### Claim 11 (depends on 9)

The computer-readable medium of claim 9, wherein the change event includes at least one of moving or resizing the user interface or determining that the user interface is to be moved or resized.

### Claim 12 (depends on 9)

The computer-readable medium of claim 9, wherein the change event includes resizing of the light source or determining that the light source is to be resized.

### Claim 13 (depends on 9)

The computer-readable medium of claim 9, wherein the operations further comprise:
receiving, by the computing device, a video stream of images from a second computing device, wherein the received video stream of images is presented on the user interface concurrent with the light source.

### Claim 14 (depends on 9)

The computer-readable medium of claim 9, wherein interfering of the light source with the presenting of the user interface includes the light source obscuring a particular portion of the user interface and wherein the second location is away from the particular portion of the user interface.

### Claim 15 (depends on 14)

The computer-readable medium of claim 14, wherein the operations further comprise detecting a second subject in the particular portion of the user interface, wherein the automatically relocating of the light source to the second location is further in response to detecting the second subject in the particular portion of the user interface.

### Claim 16

A system comprising:
one or more processors; and
one or more computer-readable media having instructions stored thereon that, when executed by the one or more processors, cause performance of operations comprising:
capturing, by a computing device, a first image that includes a first subject in a physical environment of the computing device using a camera of the computing device;
determining, by the computing device, a brightness of the first subject in the first image, wherein during capture of the first image, the first subject is illuminated, at least in part, by a light source at a first location on the display;
determining, by the computing device, an intensity for the light source based on the determined brightness of the first subject in the first image;
detecting, by the computing device, a change event of the display that results, or would result, in the light source interfering with presenting of a user interface on the display, wherein the change event involves at least one of a change in the user interface or a change in the light source;
in response, at least in part, to the change event, automatically relocating, by the computing device, the light source to a second location on the display; and
capturing, by the computing device, a second image including the first subject illuminated by the light source relocated to the second location on the display.

### Claim 17 (depends on 16)

The system of claim 16, wherein the light source includes a graphical element and relocating the light source includes presenting the graphical element at the second location on the display.

### Claim 18 (depends on 16)

The system of claim 16, wherein the change event includes at least one of moving or resizing the user interface or determining that the user interface is to be moved or resized.

### Claim 19 (depends on 16)

The system of claim 16, wherein the change event includes resizing of the light source or determining that the light source is to be resized.

### Claim 20 (depends on 16)

The system of claim 16, wherein interfering of the light source with the presenting of the user interface includes the light source obscuring a particular portion of the user interface and wherein the second location is away from the particular portion of the user interface.

### Claim 21 (depends on 20)

The system of claim 20, wherein the operations further comprise detecting a second subject in the particular portion of the user interface, wherein the automatically relocating of the light source to the second location is further in response to detecting the second subject in the particular portion of the user interface.
