# US 2021/0243346 A1 · Intelligent image capture mode for images involving reflective surfaces

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243346 A1
- Document ID: US20210243346A1
- Status: Published application
- Kind: A1
- Application number: 16/779,316
- Filed: 2020-01-31
- Published: 2021-08-05
- Earliest claimed: 2020-01-31
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Palak BHATIA; Venkata Naga Poleswara Rao KARUCHULA
- Web page: https://patentgrep.com/patent/US20210243346A1

## CPC

- G09G 5/10: Intensity circuits
- G06F 18/2413: based on distances to training or reference patterns
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06V 10/141: Control of illumination
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/74: by influencing the scene brightness using illuminating means
- G09G 2320/0626: for control of overall brightness
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods for capturing one or more images include a smart capture mode for detecting one or more reflective objects in an image to be captured by a device, and determining whether a display provided in the device will cause a disturbance when the image is captured, the disturbance based on one or more reflections of the display on the one or more reflective objects. A brightness of the display is adjusted prior to capturing the image based on determining that the display will cause the disturbance, where adjusting the brightness of the display reduces the disturbance in the image when the image is captured. The brightness of the display can be adjusted by dimming or turning off the display. The display can be returned to a previous state upon capturing the image, the previous state being prior to the brightness of the display being adjusted.

## Claims

### Claim 1

A method for capturing one or more images, the method comprising:
detecting, by a computing device, one or more reflective objects in a scene;
determining whether a display provided in the computing device will cause a disturbance when an image of the scene is captured by the computing device, the disturbance being based on one or more reflections of the display on the one or more reflective objects; and
adjusting a brightness of the display prior to capturing the image based on determining that the display will cause the disturbance.

### Claim 2 (depends on 1)

The method of claim 1, wherein adjusting the brightness of the display prior to capturing the image comprises dimming the display or turning off the display.

### Claim 3 (depends on 1)

The method of claim 1, wherein adjusting the brightness of the display prior to capturing the image comprises displaying a dark light or black light.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
returning the display to a previous state upon capturing the image, the previous state being prior to the brightness of the display being adjusted.

### Claim 5 (depends on 4)

The method of claim 4, wherein the previous state comprises a preview of the scene displayed on the display.

### Claim 6 (depends on 1)

The method of claim 1, wherein detecting the one or more reflective objects comprises using one or more machine learning operations for recognizing the one or more reflective objects.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining whether the display will cause the disturbance when the image is captured comprises using one or more machine learning operations for determining whether one or more factors associated with the display and the one or more reflective objects will cause the disturbance in the image.

### Claim 8 (depends on 7)

The method of claim 7, wherein the one or more factors comprise one or more relative positions between the display and the one or more reflective objects, ambient light, brightness of the display, or shapes of the one or more reflective objects.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining whether the display will cause the disturbance when the image is captured comprises using one or more machine learning operations for recognizing a reflection of the display in the scene.

### Claim 10 (depends on 1)

The method of claim 1, wherein capturing the image comprises capturing a self-portrait using a front facing camera of the computing device, the front facing camera oriented in a direction aligned with the display.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
retaining the brightness of the display while capturing the image upon determining that the display will not cause the disturbance.

### Claim 12 (depends on 1)

The method of claim 1, wherein the one or more reflective objects comprise one or more spectacles, helmet visors, reflective wearable devices, or reflective background surfaces.

### Claim 13 (depends on 1)

The method of claim 1, wherein detecting one or more reflective objects in the scene comprises detecting one or more reflective objects in a preview of the scene displayed on the display.

### Claim 14 (depends on 1)

The method of claim 1, wherein the disturbance comprises one or more reflections of the display being present in the image of the scene captured by the computing device.

### Claim 15

An apparatus for capturing one or more images, the apparatus comprising:
a memory; and
a processor implemented in circuitry and configured to:
detect one or more reflective objects in a scene;
determine whether a display provided in the apparatus will cause a disturbance when an image of the scene is captured by the apparatus, the disturbance being based on one or more reflections of the display on the one or more reflective objects; and
adjust a brightness of the display prior to capturing the image based on determining that the display will cause the disturbance.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein adjusting the brightness of the display prior to capturing the image comprises dimming the display or turning off the display.

### Claim 17 (depends on 15)

The apparatus of claim 15, wherein adjusting the brightness of the display prior to capturing the image comprises displaying a dark light or black light.

### Claim 18 (depends on 15)

The apparatus of claim 15, wherein the processor is further configured to:
return the display to a previous state upon capturing the image, the previous state being prior to the brightness of the display being adjusted.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the previous state comprises a preview of the scene displayed on the display.

### Claim 20 (depends on 15)

The apparatus of claim 15, wherein detecting the one or more reflective objects comprises using one or more machine learning operations for recognizing the one or more reflective objects.

### Claim 21 (depends on 15)

The apparatus of claim 15, wherein determining whether the display will cause the disturbance when the image is captured comprises using one or more machine learning operations for determining whether one or more factors associated with the display and the one or more reflective objects will cause the disturbance in the image.

### Claim 22 (depends on 21)

The apparatus of claim 21, wherein the one or more factors comprise one or more relative positions between the display and the one or more reflective objects, ambient light, brightness of the display, or shapes of the one or more reflective objects.

### Claim 23 (depends on 15)

The apparatus of claim 15, wherein determining whether the display will cause the disturbance when the image is captured comprises using one or more machine learning operations for recognizing a reflection of the display in the scene.

### Claim 24 (depends on 15)

The apparatus of claim 15, wherein capturing the image comprises capturing a self-portrait using a front facing camera of the apparatus, the front facing camera oriented in a direction aligned with the display.

### Claim 25 (depends on 15)

The apparatus of claim 15, wherein the processor is further configured to:
retain the brightness of the display while capturing the image upon determining that the display will not cause the disturbance.

### Claim 26 (depends on 15)

The apparatus of claim 15, wherein the one or more reflective objects comprise one or more spectacles, helmet visors, reflective wearable devices, or reflective background surfaces.

### Claim 27 (depends on 15)

The apparatus of claim 15, wherein the disturbance comprises one or more reflections of the display being present in the image of the scene captured by the apparatus.

### Claim 28 (depends on 15)

The apparatus of claim 15, wherein the apparatus comprises a mobile device with at least one camera for capturing one or more images.

### Claim 29

A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:
detect one or more reflective objects in a scene;
determine whether a display provided in a computing device will cause a disturbance when an image of the scene is captured by the computing device, the disturbance being based on one or more reflections of the display on the one or more reflective objects; and
adjust a brightness of the display prior to capturing the image based on determining that the display will cause the disturbance.

### Claim 30

An apparatus for capturing one or more images, the apparatus comprising:
means for detecting one or more reflective objects in a scene;
means for determining whether a display provided in the apparatus will cause a disturbance when an image of the scene is captured by the apparatus, the disturbance being based on one or more reflections of the display on the one or more reflective objects; and
means for adjusting a brightness of the display prior to capturing the image based on determining that the display will cause the disturbance.
