# US 2020/0396367 A1 · Systems and methods for controlling exposure settings based on motion characteristics associated with an image sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0396367 A1
- Document ID: US20200396367A1
- Status: Published application
- Kind: A1
- Application number: 16/438,359
- Filed: 2019-06-11
- Published: 2020-12-17
- Earliest claimed: 2019-06-11
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Loic Francois SEGAPELLI; Wenbin WANG; Zuguang XIAO
- Web page: https://patentgrep.com/patent/US20200396367A1

## CPC

- H04N 23/61: based on recognised objects
- H04N 23/73: by influencing the exposure time
- H04N 23/681: {Motion detection}
- H04N 23/72: Combination of two or more compensation controls
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods for processing one or more images include determining one or more current exposure settings for a current image of a current scene at a current time. One or more motion characteristics associated with an image sensor are determined. Based on the one or more motion characteristics, a location of a portion of the current image to use for determining one or more future exposure settings for the image sensor are determined, the one or more future exposure settings for capturing a future image of a future scene at a future time, the future time being subsequent to the current time. The one or more future exposure settings are determined based on the predicted portion of the current image.

## Claims

### Claim 1

A method of processing one or more images, the method comprising:
determining one or more current exposure settings for a current image of a current scene at a current time;
processing the current image using the one or more current exposure settings;
determining one or more motion characteristics associated with an image sensor;
determining, based on the one or more motion characteristics, a portion of the current image to use for determining one or more future exposure settings for the image sensor, the one or more future exposure settings for capturing a future image of a future scene at a future time, the future time being subsequent to the current time; and
determining the one or more future exposure settings based on the determined portion of the current image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining the one or more future exposure settings before a field of view of the image sensor reaches the future scene.

### Claim 3 (depends on 1)

The method of claim 1, further comprising identifying the portion of the current image to use for determining the one or more future exposure settings comprises excluding a region of the current image from being used for determining the one or more future exposure settings.

### Claim 4 (depends on 1)

The method of claim 1, wherein the one or more motion characteristics comprise one or more of a speed or a direction of travel of the image sensor.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
determining the one or more motion characteristics based at least in part on one or more of an inertial sensor or input to a steering system in communication with the image sensor.

### Claim 6 (depends on 4)

The method of claim 4, further comprising:
determining the one or more motion characteristics based at least in part on one or more regions of interest of the current image.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the one or more future exposure settings based on the determined portion of the current image comprises:
determining one or more regions of interest of the future image in the determined portion; and
adjusting exposure settings for the one or more regions of interest.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
determining a grid comprising one or more grid elements associated with one or more regions of the future image in the determined portion; and
determining weights for the one or more grid elements, wherein the one or more future exposure settings are based on the weights.

### Claim 9 (depends on 1)

The method of claim 1, wherein the one or more future exposure settings include a variation in one or more current exposure settings of the current image.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
capturing the future image by the image sensor, based on the one or more future exposure settings.

### Claim 11

An apparatus for processing one or more images, the apparatus comprising:
a memory configured to store the one or more images; and
a processor implemented in circuitry and configured to:
determine one or more current exposure settings for a current image of a current scene at a current time;
process the current image using the one or more current exposure settings;
determine one or more motion characteristics associated with an image sensor;
determine, based on the one or more motion characteristics, a portion of the current image to use for determining one or more future exposure settings for the image sensor, the one or more future exposure settings for capturing a future image of a future scene at a future time, the future time being subsequent to the current time; and
determine the one or more future exposure settings based on the determined portion of the current image.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the processor is further configured to:
determine the one or more future exposure settings before a field of view of the image sensor reaches the future scene.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein determining the portion of the current image to use for determining the one or more future exposure settings comprises excluding a region of the current image from being used for determining the one or more future exposure settings.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the one or more motion characteristics comprise one or more of a speed or a direction of travel of the image sensor.

### Claim 15 (depends on 11)

The apparatus of claim 11, wherein the processor is further configured to:
determine the one or more motion characteristics based at least in part on one or more of an inertial sensor or input to a steering system in communication with the image sensor.

### Claim 16 (depends on 11)

The apparatus of claim 11, wherein the processor is further configured to:
determine the one or more motion characteristics based at least in part on one or more regions of interest of the current image.

### Claim 17 (depends on 11)

The apparatus of claim 11, wherein determining the one or more future exposure settings based on the determined portion of the current image comprises:
determining one or more regions of interest of the future image in the determined portion; and
adjusting exposure settings for the one or more regions of interest.

### Claim 18 (depends on 11)

The apparatus of claim 11, wherein the processor is further configured to: determine a grid comprising one or more grid elements associated with one or more regions of the future image in the determined portion; and
determine weights for the one or more grid elements, wherein the one or more future exposure settings are based on the weights.

### Claim 19 (depends on 11)

The apparatus of claim 11, wherein the one or more future exposure settings include a variation in one or more current exposure settings of the current image.

### Claim 20 (depends on 11)

The apparatus of claim 11, wherein the processor is further configured to:
capture the future image by the image sensor, based on the one or more future exposure settings.

### Claim 21 (depends on 11)

The apparatus of claim 11, further comprising a camera for capturing one or more images.

### Claim 22 (depends on 11)

The apparatus of claim 11, wherein the apparatus comprises a mobile device with a camera for capturing one or more images.

### Claim 23 (depends on 11)

The apparatus of claim 11, further comprising a display for displaying one or more images.

### Claim 24

A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:
determine one or more current exposure settings for a current image of a current scene at a current time;
process the current image using the one or more current exposure settings determine one or more motion characteristics associated with an image sensor;
determine, based on the one or more motion characteristics, a portion of the current image to use for determining one or more future exposure settings for the image sensor, the one or more future exposure settings for capturing a future image of a future scene at a future time, the future time being subsequent to the current time; and
determine the one or more future exposure settings based on the determined portion of the current image.

### Claim 25 (depends on 24)

The non-transitory computer-readable medium of claim 24, further comprising instructions that, when executed by the one or more processors, cause the one or more processor to:
determine the one or more future exposure settings before a field of view of the image sensor reaches the future scene.

### Claim 26 (depends on 24)

The non-transitory computer-readable medium of claim 24, wherein determining the portion of the current image to use for determining the one or more future exposure settings comprises excluding a region of the current image from being used for determining the one or more future exposure settings.

### Claim 27 (depends on 24)

The non-transitory computer-readable medium of claim 24, further comprising instructions that, when executed by the one or more processors, cause the one or more processor to:
determine the one or more motion characteristics based at least in part on one or more of an inertial sensor or input to a steering system in communication with the image sensor.

### Claim 28 (depends on 24)

The non-transitory computer-readable medium of claim 24, further comprising instructions that, when executed by the one or more processors, cause the one or more processor to:
determine the one or more motion characteristics based at least in part on input to a steering system in communication with the image sensor.

### Claim 29

An apparatus for processing one or more images, the apparatus comprising:
means for determining one or more current exposure settings for a current image of a current scene at a current time;
means for processing the current image using the one or more current exposure settings means for determining one or more motion characteristics associated with an image sensor;
means for determining, based on the one or more motion characteristics, a portion of the current image to use for determining one or more future exposure settings for the image sensor, the one or more future exposure settings for capturing a future image of a future scene at a future time, the future time being subsequent to the current time; and
means for determining the one or more future exposure settings based on the determined portion of the current image.

### Claim 30 (depends on 29)

The apparatus of claim 29, wherein determining the portion of the current image to use for determining the one or more future exposure settings comprises excluding a region of the current image from being used for determining the one or more future exposure settings.

### Claim 31 (depends on 1)

The method of claim 1, further comprising predicting a location of the portion of the current image based on the one or more motion characteristics of the image sensor.

### Claim 32 (depends on 11)

The apparatus of claim 11, wherein the processor is configured to predict a location of the portion of the current image based on the one or more motion characteristics of the image sensor.
