# US 2026/0087308 A1 · Systems and Methods for Providing Feedback for Artificial Intelligence-Based Image Capture Devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087308 A1
- Document ID: US20260087308A1
- Status: Published application
- Kind: A1
- Application number: 19/340,388
- Filed: 2025-09-25
- Published: 2026-03-26
- Earliest claimed: 2018-10-08
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Aaron Michael Donsbach; Christopher Breithaupt; Li Zhang; Arushan Rajasekaram; Navid Shiee
- Web page: https://patentgrep.com/patent/US20260087308A1

## CPC

- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure provides systems and methods that provide feedback to a user of an image capture device that includes an artificial intelligence system that analyzes incoming image frames to, for example, determine whether to automatically capture and store the incoming frames. An example system can also, in the viewfinder portion of a user interface presented on a display, a graphical intelligence feedback indicator in association with a live video stream. The graphical intelligence feedback indicator can graphically indicate, for each of a plurality of image frames as such image frame is presented within the viewfinder portion of the user interface, a respective measure of one or more attributes of the respective scene depicted by the image frame output by the artificial intelligence system.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A computing system, comprising:
one or more processors; and
one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
receiving a live media stream generated by a camera;
analyzing the live media stream using one or more machine-learned models to detect at least one attribute associated with at least one object depicted in at least one image from among the live media stream and to generate at least one real-time measure associated with the at least one attribute;
generating a notification comprising one or more feedback suggestions to improve the at least one image based at least in part on the at least one real-time measure;
causing output of the notification comprising the one or more feedback suggestions to a user operating the camera;
processing at least one modification of at least one scene depicted in the live media stream using the one or more machine-learned models to generate a trigger; and
automatically causing activation of a camera shutter in response to the generating of the trigger.

### Claim 22 (depends on 21)

The computing system of claim 21, wherein the one or more machine-learned models comprise at least one of a machine-learned pose detection model or a machine-learned facial expression model,
wherein the operations further comprise:
analyzing the live media stream using the at least one of the machine-learned pose detection model or the machine-learned facial expression model to generate at least one of a pose measure or an expression measure; and
dynamically adjusting a size and a color of an indicator associated with the live media stream based at least in part on the at least one of the pose measure or the expression measure, in real-time.

### Claim 23 (depends on 21)

The computing system of claim 21, wherein the operations further comprise:
displaying a graphical intelligence feedback indicator in association with the live media stream,
wherein the at least one real-time measure is determined based at least in part on non-face visual features detected by a visual feature extractor model, and
wherein the graphical intelligence feedback indicator is configured to display textual feedback providing a suggestion related to one of the non-face visual features.

### Claim 24 (depends on 21)

The computing system of claim 21, wherein the operations further comprise:
operating the one or more machine-learned models on a low-resolution version of the at least one image generated by a scaler, and
wherein the low-resolution version is stored in a buffer for analysis.

### Claim 25 (depends on 21)

The computing system of claim 21, wherein the operations further comprise:
calculating the at least one real-time measure based in part on a photo quality score generated by a photo quality model that takes as input a semantic feature vector and a visual feature vector derived from the at least one image.

### Claim 26 (depends on 21)

The computing system of claim 21, wherein the operations further comprise:
automatically storing the at least one image in a temporary image buffer;
retrieving the at least one image from the temporary image buffer; and
writing the at least one image to a non-volatile memory after the at least one real-time measure meets a threshold.

### Claim 27 (depends on 21)

The computing system of claim 21, wherein the operations further comprise:
automatically storing a non-temporary copy of the at least one image;
after automatically storing the non-temporary copy, operating the computing system in a refractory mode based at least in part on the stored non-temporary copy including a number of faces greater than or equal to a minimum count.

### Claim 28

A computing system, comprising:
one or more processors; and
one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
receiving a live media stream generated by a camera of a computing device;
causing presentation, in a user interface presented on a display of the computing device, of the live media stream depicting at least a portion of a current field of view of the camera;
analyzing the live media stream using one or more machine-learned models to generate at least one real-time measure associated with at least one scene depicted in at least one image frame;
generating one or more feedback notifications to modify the at least one scene in response to the generating of the at least one real-time measure;
causing output by the computing device of the one or more feedback notifications;
processing at least one modification of the at least one scene depicted in the live media stream using the one or more machine-learned models to output instructions utilized to control a camera shutter of the computing device; and
automatically causing operation of the camera in response to the instructions output by the one or more machine-learned models.

### Claim 29 (depends on 28)

The computing system of claim 28, wherein the operations further comprise:
displaying a graphical intelligence feedback indicator in association with the live media stream; and
dynamically adjusting the graphical intelligence feedback indicator from a graphical bar to a graphical shape that is filled radially in response to the at least one real-time measure exceeding a threshold.

### Claim 30 (depends on 28)

The computing system of claim 28, wherein the operations further comprise:
displaying a graphical intelligence feedback indicator in association with the live media stream,
wherein the at least one real-time measure is determined based at least in part on non-face visual features detected by a visual feature extractor model, and
wherein the graphical intelligence feedback indicator is configured to display textual feedback providing a suggestion related to one of the non-face visual features.

### Claim 31 (depends on 28)

The computing system of claim 28, wherein the operations further comprise:
operating the one or more machine-learned models on a low-resolution version of the at least one image frame generated by a scaler, and
wherein the low-resolution version is stored in a buffer for analysis.

### Claim 32 (depends on 28)

The computing system of claim 28, wherein the operations further comprise:
automatically storing a non-temporary copy of the at least one image frame;
after automatically storing the non-temporary copy, operating the computing system in a refractory mode based at least in part on successive image frames that comprise the at least one image frame not differing substantially from the non-temporary copy.

### Claim 33 (depends on 28)

The computing system of claim 28, wherein the output caused by the computing device of the one or more feedback notifications comprises auditory or haptic feedback.

### Claim 34 (depends on 28)

The computing system of claim 28, wherein the operations further comprise:
automatically storing a non-temporary copy of the at least one image frame; and
after automatically storing the non-temporary copy, operating the computing system in a refractory mode based at least in part on a presence of a specific facial expression in the stored non-temporary copy.

### Claim 35

A method, comprising:
receiving a live media stream generated by a camera;
analyzing the live media stream using one or more machine-learned models to detect at least one attribute associated with at least one object depicted in at least one image from among the live media stream and to generate at least one real-time measure associated with the at least one attribute;
generating a notification comprising one or more feedback suggestions to improve the at least one image based at least in part on the at least one real-time measure;
causing output of the notification comprising the one or more feedback suggestions to a user operating the camera;
processing at least one modification of at least one scene depicted in the live media stream using the one or more machine-learned models to generate a trigger; and
automatically causing activation of a camera shutter in response to the generating of the trigger.

### Claim 36 (depends on 35)

The method of claim 35, wherein the one or more machine-learned models comprise a machine-learned pose detection model and a machine-learned facial expression model,
further comprising:
analyzing the live media stream using the machine-learned pose detection model and the machine-learned facial expression model to generate a pose measure and an expression measure; and
dynamically adjusting a size and a color of an indicator associated with the live media stream based at least in part on the pose measure and the expression measure.

### Claim 37 (depends on 35)

The method of claim 35, further comprising:
determining the at least one real-time measure based at least in part on non-face visual features detected by a visual feature extractor model; and
configuring a graphical intelligence feedback indicator to display textual feedback providing a suggestion related to one of the non-face visual features.

### Claim 38 (depends on 35)

The method of claim 35, further comprising:
operating the one or more machine-learned models on a low-resolution version of the at least one image generated by a scaler, and
wherein the low-resolution version is stored in a buffer for analysis.

### Claim 39 (depends on 35)

The method of claim 35, further comprising:
calculating the at least one real-time measure based in part on a photo quality score generated by a photo quality model that takes as input a semantic feature vector and a visual feature vector derived from the at least one image.

### Claim 40 (depends on 35)

The method of claim 35, further comprising:
automatically storing the at least one image in a temporary image buffer, retrieving the at least one image from the temporary image buffer; and
writing the at least one image to a non-volatile memory after the at least one real-time measure meets a threshold.
