# US 2026/0203934 A1 · Brightness invariant sub-pixel estimation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0203934 A1
- Document ID: US20260203934A1
- Status: Published application
- Kind: A1
- Application number: 19/022,977
- Filed: 2025-01-15
- Published: 2026-07-16
- Earliest claimed: 2025-01-15
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Aashish KUMAR; Bhargava Venkata CHINTALAPATI; Pushkar GORUR SHESHAGIRI; Gerhard REITMAYR; Ajit Deepak GUPTE
- Web page: https://patentgrep.com/patent/US20260203934A1

## CPC

- G06T 7/74: {involving reference images or patches}
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/248: {involving reference images or patches}
- G06T 7/269: using gradient-based methods
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06T 2207/10016: Video; Image sequence
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Certain aspects of the present disclosure provide techniques for performing sub-pixel estimation. In some aspects, certain techniques may include obtaining a reference image patch; obtaining an image depicting an edge feature; performing matching between pixels of the image and the reference image patch to determine an initial location as a location of a target image patch, corresponding to the reference image patch, in the image; estimating one or more brightness variance parameters corresponding to a brightness variance between the reference image patch and the target image patch; estimating, based on the reference image patch and the target image patch based on the initial location, a motion vector that estimates location difference of the edge feature between the reference image patch and the target image patch; and determining an updated location as the location of the target image patch.

## Claims

### Claim 1

An apparatus configured for sub-pixel estimation, comprising:
a hardware circuit configured to:
obtain a reference image patch depicting an edge feature;
obtain an image depicting the edge feature;
perform matching between pixels of the image and the reference image patch to determine an initial location as a location of a target image patch, corresponding to the reference image patch, in the image;
estimate, based on the reference image patch and the target image patch based on the initial location, one or more brightness variance parameters corresponding to a brightness variance between the reference image patch and the target image patch;
estimate, based on the reference image patch and the target image patch based on the initial location, a motion vector based on the initial location and an intensity difference between the reference image patch and the target image patch;
determine, based on the motion vector, an updated location as the location of the target image patch; and
determine, based on the one or more brightness variance parameters, whether to further update the location of the target image patch.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein:
the hardware circuit is configured to determine an edge gradient direction of the edge feature based on the target image patch based on the initial location; and
to estimate the motion vector, the hardware circuit is configured to estimate the motion vector further based on constraint of a direction of the motion vector based on the edge gradient direction.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein:
the initial location is a pixel level location; and
the updated location is a sub-pixel level location.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein:
to estimate the motion vector, the hardware circuit is configured to estimate the motion vector further based on motion estimation.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the motion estimation comprises Lucas-Kanade optical flow estimation or efficient second-order minimization (ESM).

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein to determine, based on the one or more brightness variance parameters, whether to further update the location of the target image patch, the hardware circuit is configured to:
determine whether a difference in intensity values between the reference image patch and a corrected target image patch can be further reduced, wherein the corrected target image patch is based on the target image patch at the updated location and the one or more brightness variance parameters.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein to estimate the one or more brightness variance parameters and the motion vector, the hardware circuit is configured to estimate the one or more brightness variance parameters and the motion vector jointly.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein to estimate the one or more brightness variance parameters and the motion vector, the hardware circuit is configured to:
estimate the one or more brightness variance parameters;
determine a corrected target image patch at the initial location based on the target image patch at the initial location and the one or more brightness variance parameters; and
estimate the motion vector based on the reference image patch and the corrected target image patch at the initial location.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the hardware circuit is configured to:
determine, for each of a plurality of locations for the target image patch in the image, a corresponding correlation score, of a plurality of correlation scores, between the reference image patch and the target image patch at the corresponding location;
fit a parabola to the plurality of correlation scores; and
determine a new location as the location of the target image patch based on a maxima of the parabola.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the plurality of correlation scores are estimated at a plurality of locations, on one or both sides of the initial location, along a direction perpendicular to the edge feature.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein:
the hardware circuit is configured to determine the new location is outside a range; and
to estimate the one or more brightness variance parameters and the motion vector, the hardware circuit is configured to estimate the one or more brightness variance parameters and the motion vector in response to the determination the new location is outside the range.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein based on the updated location of the target image patch, the hardware circuit is configured to perform at least one of the following:
perform object recognition based on the location of the edge feature in the target image patch;
determine a motion trajectory of the edge feature;
generate a mapping of an environment based on a motion trajectory of the edge feature;
estimate a relative location of an object in the target image patch; or
enhance an alignment accuracy for subsequent image processing tasks.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the hardware circuit is configured to estimate the motion vector using at least one sub-pixel estimation technique based on at least one of a power consumption threshold or an accuracy threshold.

### Claim 14

A method for sub-pixel estimation, comprising:
obtaining a reference image patch depicting an edge feature;
obtaining an image depicting the edge feature;
performing matching between pixels of the image and the reference image patch to determine an initial location as a location of a target image patch, corresponding to the reference image patch, in the image;
estimating, based on the reference image patch and the target image patch based on the initial location, one or more brightness variance parameters corresponding to a brightness variance between the reference image patch and the target image patch;
estimating, based on the reference image patch and the target image patch based on the initial location, a motion vector based on the initial location and an intensity difference between the reference image patch and the target image patch;
determining, based on the motion vector, an updated location as the location of the target image patch; and
determining, based on the one or more brightness variance parameters, whether to further update the location of the target image patch.

### Claim 15 (depends on 14)

The method of claim 14, furthering comprising:
determining an edge gradient direction of the edge feature based on the target image patch based on the initial location, wherein estimating the motion vector comprises estimating the motion vector based on constraint of a direction of the motion vector based on the edge gradient direction.

### Claim 16 (depends on 14)

The method of claim 14, wherein:
the initial location is a pixel level location; and
the updated location is a sub-pixel level location.

### Claim 17 (depends on 14)

The method of claim 14, wherein estimating the motion vector comprises estimating the motion vector further based on motion estimation.

### Claim 18 (depends on 14)

The method of claim 14, wherein determining, based on the one or more brightness variance parameters, whether to further update the location of the target image patch, comprises determining whether a difference in intensity values between the reference image patch and a corrected target image patch can be further reduced, wherein the corrected target image patch is based on the target image patch at the updated location and the one or more brightness variance parameters.

### Claim 19 (depends on 14)

The method of claim 14, wherein estimating the one or more brightness variance parameters and the motion vector comprises estimating the one or more brightness variance parameters and the motion vector jointly.

### Claim 20 (depends on 14)

The method of claim 14, further comprising:
determining, for each of a plurality of locations for the target image patch in the image, a corresponding correlation score of a plurality of correlation scores, between the reference image patch and the target image patch at the corresponding location;
fitting a parabola to the plurality of correlation scores; and
determining a new location as the location of the target image patch based on a maxima of the parabola.
