# US 2025/0095379 A1 · Position data extraction from arbitrary camera configurations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095379 A1
- Document ID: US20250095379A1
- Status: Published application
- Kind: A1
- Application number: 18/468,399
- Filed: 2023-09-15
- Published: 2025-03-20
- Earliest claimed: 2023-09-15
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Madhumitha Sakthi; Louis Joseph Kerofsky; Senthil Kumar Yogamani
- Web page: https://patentgrep.com/patent/US20250095379A1

## CPC

- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/579: from motion
- G06T 7/593: from stereo images
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06V 2201/07: Target detection
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

This disclosure provides systems, methods, and devices for vehicle driving assistance systems that support image processing. In a first aspect, a method includes receiving a first image frame from the first camera and a second image frame from the second camera. The method may also include determining a first set of optical flows between the first image frame and the second image frame and determining a second set of optical flows based on the first set of optical flows and positions of the first camera and the second camera on the vehicle. Position data may be determined for objects in an area surrounding the vehicle based on the second set of optical flows. Other aspects and features are also claimed and described.

## Claims

### Claim 1

A method for image processing for use in a vehicle assistance system, comprising:
receiving a first image frame from a first camera and a second image frame from a second camera, wherein the first camera and the second camera are located on a vehicle;
determining a first set of optical flows between the first image frame and the second image frame;
determining a second set of optical flows based on the first set of optical flows and positions of the first camera and the second camera on the vehicle; and
determining position data for objects in an area surrounding the vehicle based on the second set of optical flows.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining epipolar lines between the first camera and the second camera; and
determining the second set of optical flows by projecting the first set of optical flows onto the epipolar lines.

### Claim 3 (depends on 2)

The method of claim 2, wherein the first set of optical flows comprises a first optical flow for the first image frame and a second optical flow for the second image frame,
wherein the epipolar lines comprise a first epipolar line for the first image frame and a second epipolar line for the second image frame, and
wherein determining the second set of optical flows comprises:
projecting a first optical flow for the first image frame onto the first epipolar line; and
projecting a second optical flow for the second image frame onto the second epipolar line.

### Claim 4 (depends on 3)

The method of claim 3, wherein the first optical flow is projected onto the first epipolar line in a direction determined based on a position of the first camera relative to the second camera, and
wherein the second optical flow is projected onto the second epipolar line based on a position of the second camera relative to the first camera.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
determining, based on the second set of optical flows, corresponding pixels between the first image frame and the second image frame; and
determining the position data based on at least a subset of the corresponding pixels.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
determining consistency measures for the corresponding pixels; and
determining the position data based on at least a subset of the corresponding pixels with consistency measures that satisfy a predetermined threshold.

### Claim 7 (depends on 6)

The method of claim 6, wherein the consistency measure is determined based on differences in value between at least a first corresponding pixel from the first image frame and a second corresponding pixel from the second image frame.

### Claim 8 (depends on 5)

The method of claim 5, wherein determining the position data comprises triangulating the position data based on at least a subset of the corresponding pixels.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first camera and the second camera have fields of view greater than 170 degrees, and where an overlapping region is less than 50 degrees.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first camera and the second camera have different fields of view and a non-parallel optical axis.

### Claim 11 (depends on 1)

The method of claim 1, further comprising determining, based on the position data, vehicle control instructions for the vehicle.

### Claim 12

An apparatus, comprising:
a memory storing processor-readable code; and
at least one processor coupled to the memory, the at least one processor configured to execute the processor-readable code to cause the at least one processor to perform operations including:
receiving a first image frame from a first camera and a second image frame from a second camera, wherein the first camera and the second camera are located on a vehicle;
determining a first set of optical flows between the first image frame and the second image frame;
determining a second set of optical flows based on the first set of optical flows and positions of the first camera and the second camera on the vehicle; and
determining position data for objects in an area surrounding the vehicle based on the second set of optical flows.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the operations further comprise:
determining epipolar lines between the first camera and the second camera; and
determining the second set of optical flows by projecting the first set of optical flows onto the epipolar lines.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the first set of optical flows comprises a first optical flow for the first image frame and a second optical flow for the second image frame,
wherein the epipolar lines comprise a first epipolar line for the first image frame and a second epipolar line for the second image frame, and
wherein determining the second set of optical flows comprises:
projecting a first optical flow for the first image frame onto the first epipolar line; and
projecting a second optical flow for the second image frame onto the second epipolar line.

### Claim 15 (depends on 12)

The apparatus of claim 12, wherein the operations further comprise:
determining, based on the second set of optical flows, corresponding pixels between the first image frame and the second image frame; and
determining the position data based on at least a subset of the corresponding pixels.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the operations further comprise:
determining consistency measures for the corresponding pixels; and
determining the position data based on at least a subset of the corresponding pixels with consistency measures that satisfy a predetermined threshold.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the consistency measure is determined based on differences in value between at least a first corresponding pixel from the first image frame and a second corresponding pixel from the second image frame.

### Claim 18 (depends on 15)

The apparatus of claim 15, wherein determining the position data comprises triangulating the position data based on at least a subset of the corresponding pixels.

### Claim 19 (depends on 12)

The apparatus of claim 12, wherein the first camera and the second camera have fields of view greater than 170 degrees, and where an overlapping region is less than 50 degrees.

### Claim 20 (depends on 12)

The apparatus of claim 12, wherein the first camera and the second camera have different fields of view and a non-parallel optical axis.

### Claim 21 (depends on 12)

The apparatus of claim 12, wherein the operations further comprise determining, based on the position data, vehicle control instructions for the vehicle.

### Claim 22

A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
receiving a first image frame from a first camera and a second image frame from a second camera, wherein the first camera and the second camera are located on a vehicle;
determining a first set of optical flows between the first image frame and the second image frame;
determining a second set of optical flows based on the first set of optical flows and positions of the first camera and the second camera on the vehicle; and
determining position data for objects in an area surrounding the vehicle based on the second set of optical flows.

### Claim 23 (depends on 22)

The non-transitory computer-readable medium of claim 22, wherein the operations further comprise:
determining epipolar lines between the first camera and the second camera; and
determining the second set of optical flows by projecting the first set of optical flows onto the epipolar lines.

### Claim 24 (depends on 22)

The non-transitory computer-readable medium of claim 22, wherein the operations further comprise:
determining, based on the second set of optical flows, corresponding pixels between the first image frame and the second image frame; and
determining the position data based on at least a subset of the corresponding pixels.

### Claim 25 (depends on 24)

The non-transitory computer-readable medium of claim 24, wherein the operations further comprise:
determining consistency measures for the corresponding pixels; and
determining the position data based on at least a subset of the corresponding pixels with consistency measures that satisfy a predetermined threshold.

### Claim 26 (depends on 24)

The non-transitory computer-readable medium of claim 24, wherein determining the position data comprises triangulating the position data based on at least a subset of the corresponding pixels.

### Claim 27

A vehicle, comprising:
a first camera;
a second camera;
a memory storing processor-readable code; and
at least one processor coupled to the memory, the first camera, and the second camera, the at least one processor configured to execute the processor-readable code to cause the at least one processor to perform operations including:
receiving a first image frame from the first camera and a second image frame from the second camera, wherein the first camera and the second camera are located on a vehicle;
determining a first set of optical flows between the first image frame and the second image frame;
determining a second set of optical flows based on the first set of optical flows and positions of the first camera and the second camera on the vehicle; and
determining position data for objects in an area surrounding the vehicle based on the second set of optical flows.

### Claim 28 (depends on 27)

The vehicle of claim 27, wherein the operations further comprise:
determining epipolar lines between the first camera and the second camera; and
determining the second set of optical flows by projecting the first set of optical flows onto the epipolar lines.

### Claim 29 (depends on 27)

The vehicle of claim 27, wherein the operations further comprise:
determining, based on the second set of optical flows, corresponding pixels between the first image frame and the second image frame; and
determining the position data based on at least a subset of the corresponding pixels.

### Claim 30 (depends on 29)

The vehicle of claim 29, wherein the operations further comprise:
determining consistency measures for the corresponding pixels; and
determining the position data based on at least a subset of the corresponding pixels with consistency measures that satisfy a predetermined threshold.
