# US 2022/0284550 A1 · System and method for increasing sharpness of image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284550 A1
- Document ID: US20220284550A1
- Status: Published application
- Kind: A1
- Application number: 17/827,412
- Filed: 2022-05-27
- Published: 2022-09-08
- Earliest claimed: 2019-10-02
- Assignees: Pony Al Inc.
- Applicants: Pony Al Inc.
- Inventors: Peter G. Diehl; Robert Dingli; Cyrus Abari; Yui-Hong Matthias Tan
- Web page: https://patentgrep.com/patent/US20220284550A1

## CPC

- G06T 5/73: Deblurring; Sharpening
- H04N 23/58: Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
- B60K 31/0008: {including means for detecting potential obstacles in vehicle path}
- B60W 40/112: Roll movement
- G06T 5/20: using local operators
- G06T 7/11: Region-based segmentation
- H04N 23/61: based on recognised objects
- H04N 23/672: {based on the phase difference signals}
- B60Y 2400/301: for position or displacement
- B60Y 2400/302: Temperature sensors
- B60Y 2400/306: Pressure sensors
- G06T 2207/30261: Obstacle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60Y: INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY

## Abstract

Provided herein is a system and method that acquires data and determines a driving action based on the data. The system comprises a sensor, one or more processors, and a memory storing instructions that, when executed by the one or more processors, causes the system to perform, determining data of interest comprising an object, feature, or region of interest, determining whether a sharpness of the data of interest exceeds a threshold, in response to determining that the sharpness does not exceed a threshold, operating the sensor to increase the sharpness of the data of interest until the sharpness exceeds the threshold, in response to the sharpness exceeding the threshold, determining a driving action of a vehicle based on the data of interest, and performing the driving action

## Claims

### Claim 1

A system comprising:
a sensor;
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, causes the system to perform:
determining data of interest, wherein the data of interest comprises an object or feature, and the determination of the data of interest is based on a rate of change of the object or the feature;
determining whether a sharpness of the data of interest exceeds a threshold sharpness; and
in response to determining that the sharpness does not exceed the threshold sharpness, operating the sensor to increase the sharpness of the data of interest until the sharpness exceeds the threshold.

### Claim 2 (depends on 1)

The system of claim 1, wherein the operating of the sensor comprises performing, on a lens of the sensor, one or more operations selected from a group consisting of: an azimuth rotation, a tilt, and a translation.

### Claim 3 (depends on 1)

The system of claim 1, wherein the operating the sensor comprises determining which one of an azimuth rotation, a tilt, and a translation to perform on a lens of a sensor based on a difference between the sharpness of the data and the threshold sharpness.

### Claim 4 (depends on 1)

The system of claim 1, wherein the determining data of interest comprises determining the object or the feature to be data of interest in response to a difference between a first temperature, a first barometric pressure, a first pollution level, or a first smog level of a region in which the object or the feature is situated and a second temperature, a second barometric pressure, a second pollution level, or a second smog level of a surrounding region exceeding a threshold difference.

### Claim 5 (depends on 1)

The system of claim 1, wherein the determining data of interest comprises predicting an existence of an object or feature based on another object or feature being present at a same location.

### Claim 6 (depends on 1)

The system of claim 1, wherein the determining data of interest comprises predicting an existence of an object or feature based on a road condition or terrain.

### Claim 7 (depends on 1)

The system of claim 1, wherein the threshold sharpness is determined based on a weather condition, an air condition, or a time of day.

### Claim 8 (depends on 1)

The system of claim 1, wherein the instructions further cause the system to perform: in response to the sharpness of the data of interest exceeding the threshold sharpness, sending the data of interest to a vehicle.

### Claim 9 (depends on 1)

The system of claim 1, wherein the instructions further cause the system to perform: in response to the sharpness of the data of interest exceeding the threshold sharpness, sending the data of interest to a vehicle.

### Claim 10

A method implemented by a computing system including one or more processors and storage media storing machine-readable instructions, wherein the method is performed using the one or more processors, the method comprising:
determining data of interest, wherein the data of interest comprises an object, feature, or region of interest and the determination of the data of interest is based on a rate of change of the object, feature, or region of interest;
determining whether a sharpness of the data of interest exceeds a threshold sharpness; and
in response to determining that the sharpness does not exceed the threshold sharpness, operating the sensor to increase the sharpness of the data of interest until the sharpness exceeds the threshold.

### Claim 11 (depends on 10)

The method of claim 10, wherein the operating of the sensor comprises performing, on a lens of the sensor, one or more operations selected from a group consisting of: an azimuth rotation, a tilt, and a translation.

### Claim 12 (depends on 10)

The method of claim 10, wherein the operating the sensor comprises determining which one of an azimuth rotation, a tilt, and a translation to perform on a lens of a sensor based on a difference between the sharpness of the data and the threshold sharpness.

### Claim 13 (depends on 10)

The method of claim 10, wherein the determining data of interest comprises determining the object or the feature to be data of interest in response to a difference between a first temperature, a first barometric pressure, a first pollution level, or a first smog level of a region in which the object or the feature is situated and a second temperature, a second barometric pressure, a second pollution level, or a second smog level of a surrounding region exceeding a threshold difference.

### Claim 14 (depends on 10)

The method of claim 10, wherein the determining data of interest comprises predicting an existence of an object or feature based on another object or feature being present at a same location.

### Claim 15 (depends on 10)

The method of claim 10, wherein the determining data of interest comprises predicting an existence of an object or feature based on a road condition or terrain.

### Claim 16 (depends on 10)

The method of claim 10, wherein the threshold sharpness is determined based on a weather condition, an air condition, or a time of day.

### Claim 17 (depends on 10)

The method of claim 10, wherein the determining data of interest comprises predicting an existence of an object or feature based on a road condition or terrain.

### Claim 18 (depends on 10)

The method of claim 10, further comprising:
in response to the sharpness of the data of interest exceeding the threshold sharpness, sending the data of interest to a vehicle.

### Claim 19

A system comprising:
a sensor;
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, causes the system to perform:
determining data of interest, wherein the data of interest comprises an object or feature, and the determination of the data of interest comprises predicting an existence of the object or the feature based on another object or another feature being present at a same location;
determining whether a sharpness of the data of interest exceeds a threshold sharpness;
in response to determining that the sharpness does not exceed the threshold sharpness, operating the sensor to increase the sharpness of the data of interest until the sharpness exceeds the threshold.

### Claim 20 (depends on 19)

The system of claim 19, wherein the determining of the data of interest comprises predicting an existence of the object or the feature based on a road condition or terrain.
