# US 2025/0095201 A1 · Machine-learning based object localization from images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095201 A1
- Document ID: US20250095201A1
- Status: Published application
- Kind: A1
- Application number: 18/467,993
- Filed: 2023-09-15
- Published: 2025-03-20
- Earliest claimed: 2023-09-15
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Ori Shental; Ashwin Sampath; Michael Dimare; Junyi Li; Thomas Joseph Richardson; Muhammad Nazmul Islam; Michael Ethan Berkowitz
- Web page: https://patentgrep.com/patent/US20250095201A1

## CPC

- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/74: {involving reference images or patches}
- G06T 7/11: Region-based segmentation
- G06T 7/50: Depth or shape recovery
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method includes retrieving a plurality of images containing one or more objects of interest and generating, with one or more processors, using a machine learning model, a bounding box around each of the one or more objects of interest for each of the plurality of images. The method also includes determining, with the one or more processors, a geographical position of each of the one or more objects of interest based on a position of the bounding box.

## Claims

### Claim 1

A method comprising:
retrieving a plurality of images containing one or more objects of interest;
generating, with one or more processors, using a machine learning model, a bounding box around each of the one or more objects of interest for each of the plurality of images; and
determining, with the one or more processors, a geographical position of each of the one or more objects of interest based on a position of the bounding box.

### Claim 2 (depends on 1)

The method of claim 1, wherein the plurality of images include at least: one or more street-level images of the one or more objects of interest and one or more aerial view images of the one or more objects of interest.

### Claim 3 (depends on 2)

The method of claim 2, wherein generating the bounding box further comprises generating, with the one or more processors, the bounding box around each of the one or more objects of interest for a grid of selected locations for the one or more aerial view images.

### Claim 4 (depends on 3)

The method of claim 3, wherein generating the bounding box around each of the one or more objects of interest for the grid of selected locations further comprises identifying, with the one or more processors, one or more aerial imagery providers that have the one or more aerial view images of the selected locations.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining the geographical position of each of the one or more objects of interest further comprises determining, with the one or more processors, geographical coordinates of each of the one or more objects of interest.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining the geographical position of each of the one or more objects of interest further comprises triangulating, with the one or more processors, positions of a plurality of bounding boxes associated with two or more street-level images of the one or more objects of interest.

### Claim 7 (depends on 6)

The method of claim 6, wherein triangulating the positions of the plurality of bounding boxes further comprises matching, with the one or more processors, the plurality of bounding boxes across the two or more street-level images.

### Claim 8 (depends on 1)

The method of claim 1, wherein the machine learning model comprises a pre-trained single stage detection model.

### Claim 9 (depends on 8)

The method of claim 8, wherein the machine learning model comprises a You Only Look Once (YOLO) model.

### Claim 10 (depends on 1)

The method of claim 1, wherein the one or more objects of interest comprise one or more virtual representations of one or more physical objects.

### Claim 11 (depends on 1)

The method of claim 1, wherein determining the geographical position of each of the one or more objects of interest further comprises determining, with the one or more processors, using a single street-level image, a distance between each of the one or more objects of interest and a camera used to capture the single street-level image.

### Claim 12 (depends on 1)

The method of claim 1, wherein determining the geographical position of each of the one or more object of interest further comprises:
determining, with the one or more processors, a horizontal adjustment to the geographical position; and
determining, with the one or more processors, a vertical adjustment to the geographical position.

### Claim 13

An apparatus for object localization, the apparatus comprising:
a memory for storing a plurality of images containing one or more objects of interest; and
processing circuitry in communication with the memory, wherein the processing circuitry is configured to:
retrieve the plurality of images containing the one or more objects of interest;
generate, using a machine learning model, a bounding box around each of the one or more objects of interest for each of the plurality of images; and
determine a geographical position of each of the one or more objects of interest based on a position of the bounding box.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the plurality of images include at least: one or more street-level images of the one or more objects of interest and one or more aerial view images of the one or more objects of interest.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the processing circuitry configured to generate the bounding box is further configured to generate the bounding box around each of the one or more objects of interest for a grid of selected locations for the one or more aerial view images.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the processing circuitry configured to generate the bounding box around each of the one or more objects of interest for the grid of selected locations is further configured to identify one or more aerial imagery providers that have the one or more aerial view images of the selected locations.

### Claim 17 (depends on 13)

The apparatus of claim 13, wherein the processing circuitry configured to determine the geographical position of each of the one or more objects of interest is further configured to determine geographical coordinates of each of the one or more objects of interest.

### Claim 18 (depends on 13)

The apparatus of claim 13, wherein the processing circuitry configured to determine the geographical position of each of the one or more objects of interest is further configured to triangulate positions of a plurality of bounding boxes associated with two or more street-level images of the one or more objects of interest.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the processing circuitry configured to triangulate the positions of the plurality of bounding boxes is further configured to match the plurality of bounding boxes across the two or more street-level images.

### Claim 20

A computer-readable medium storing instructions that, when applied by processing circuitry, causes the processing circuitry to:
retrieve the plurality of images containing the one or more objects of interest;
generate, using a machine learning model, a bounding box around each of the one or more objects of interest for each of the plurality of images; and
determine a geographical position of each of the one or more objects of interest based on a position of the bounding box.
