# US 2025/0148779 A1 · Systems and methods for low-cost height above ground level and terrain data generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148779 A1
- Document ID: US20250148779A1
- Status: Published application
- Kind: A1
- Application number: 18/404,654
- Filed: 2024-01-04
- Published: 2025-05-08
- Earliest claimed: 2023-11-07
- Assignees: Honeywell International Inc.
- Applicants: Honeywell International Inc.
- Inventors: Avni Rajpal; Romi Srivastava; Ashwin Ganapathy; Arjun Bindu Jyothikumar
- Web page: https://patentgrep.com/patent/US20250148779A1

## CPC

- G06V 20/17: taken from planes or by drones
- G08G 5/74: for monitoring terrain
- G06V 2201/07: Target detection
- G06V 2201/12: Acquisition of 3D measurements of objects
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

Systems and methods for low-cost HAGL measurement and terrain database updates are provided. In one example, a system includes an image capturing device configured to capture first and second images and a navigation system configured to generate pose data. The system further includes processor(s) communicatively coupled to the image capturing device and the navigation system and a non-transitory, computer-readable medium communicatively coupled to the processor(s) that stores instruction(s) which, when executed by the processor(s), cause the processor(s) to: estimate optical flow between the first and second images; determine rigid flow per image for each depth bin of a group of depth bins based on the pose data, wherein each depth bin corresponds to a particular depth range; and generate a dense depth map by determining a depth bin, for each pixel, that minimizes a difference between the estimated optical flow and the determined rigid flow for the respective pixel.

## Claims

### Claim 1

A system, comprising:
an image capturing device configured to capture a first image and a second image;
a navigation system configured to generate pose data;
one more processors communicatively coupled to the image capturing device and the navigation system; and
a non-transitory, computer readable medium communicatively coupled to the one or more processors, wherein the non-transitory, computer readable medium stores one or more instructions which, when executed by the one or more processors, cause one or more processors to:
estimate an optical flow between the first image and the second image;
determine a rigid flow per image for each depth bin of a group of depth bins based on the pose data, wherein each depth bin corresponds to a particular depth range; and
generate a dense depth map by determining a depth bin for each pixel that minimizes a difference between the estimated optical flow and the determined rigid flow for the respective pixel.

### Claim 2 (depends on 1)

The system of claim 1, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to generate an image-based height above ground level measurement based on the dense depth map and the pose data by transforming the dense depth map from a camera frame to a body frame coordinate system.

### Claim 3 (depends on 1)

The system of claim 1, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to generate terrain data based on the dense depth map and the pose data.

### Claim 4 (depends on 3)

The system of claim 3, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to update terrain data in a terrain database in real-time for situational awareness, path planning, obstacle avoidance, and/or emergency landing.

### Claim 5 (depends on 1)

The system of claim 1, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to select the group of depth bins based on a previous height above ground level measurement.

### Claim 6 (depends on 2)

The system of claim 2, wherein the system further comprises an altimeter or other height above ground level sensor configured to determine a second height above ground level measurement;
wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
combine the image-based height above ground level measurement and the second height above ground level measurement; and/or
compare the image-based height above ground level measurement and the second height above ground level measurement.

### Claim 7 (depends on 1)

The system of claim 1, wherein the image capturing device, the navigation system, the one or more processors, and the non-transitory computer readable medium are positioned on a vehicle.

### Claim 8 (depends on 7)

The system of claim 7, wherein a sample rate of the image capturing device is adjusted based on a speed of the vehicle, a location of the vehicle, and/or a phase of travel.

### Claim 9 (depends on 1)

The system of claim 1, wherein the image capturing device is further configured to capture a third image;
wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
generate a second dense depth map based on a second optical flow and a second rigid flow determined using the first image, the third image, and pose data corresponding to the first image and the third image;
comparing depth estimations for particular points in the dense depth map and the second dense depth map; and
deleting or verifying or judiciously combining the depth estimations based on the comparison.

### Claim 10 (depends on 1)

The system of claim 1, wherein the one or more processors are configured to determine respective depth bins for at least two pixels in parallel.

### Claim 11

A system, comprising:
one or more inputs communicatively coupled to an image capturing device and a navigation system;
one or more processors; and
a non-transitory, computer readable medium communicatively coupled to the one or more processors, wherein the non-transitory, computer readable medium stores one or more instructions which, when executed by the one or more processors, cause one or more processors to:
estimate an optical flow between a first image and a second image received from the image capturing device;
determine a rigid flow per image for each depth bin of a group of depth bins based on pose data received from the navigation system, wherein each depth bin corresponds to a particular depth range;
determine a depth bin for each pixel that minimizes a difference between the estimated optical flow and the determined rigid flow for the respective pixel; and
generate a dense depth map based on the depth bin determined for each pixel.

### Claim 12 (depends on 11)

The system of claim 11, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to generate an image-based height above ground level measurement based on the dense depth map and the pose data by transforming the dense depth map from a camera frame to a body frame coordinate system.

### Claim 13 (depends on 11)

The system of claim 11, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to generate terrain data based on the dense depth map and the pose data.

### Claim 14 (depends on 11)

The system of claim 11, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to select the group of depth bins based on a previous height above ground level measurement.

### Claim 15 (depends on 11)

The system of claim 11, wherein the one or more processors are configured to determine respective depth bins for at least two pixels in parallel.

### Claim 16

A method, comprising:
capturing a first image and a second image;
generating first pose data corresponding to the first image and second pose data corresponding to the second image;
estimating an optical flow between the first image and the second image;
determining a rigid flow per image for each depth bin of a plurality of depth bins;
determining a depth bin of the plurality of depth bins for each respective pixel of a plurality of pixels that minimizes a difference between the estimated optical flow and the determined rigid flow for the respective pixel; and
generating a dense depth map based on the determined depth bin for the plurality of pixels.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
determining a difference between the first pose data corresponding to the first image and the second pose data corresponding to the second image;
dividing a depth range into the plurality of depth bins; and
determining the rigid flow per image for each depth bin of a plurality of depth bins based on the determined difference between the first pose data corresponding to the first image and the second pose data corresponding to the second image.

### Claim 18 (depends on 16)

The method of claim 16, wherein the dense depth map is generated in a frame of an image capturing device, the method further comprising:
translating the dense depth map from the frame of the image capturing device to a frame of a body of a vehicle to generate a translated dense depth map; and
determining a depth bin for a center pixel of the translated dense depth map.

### Claim 19 (depends on 16)

The method of claim 16, further comprising adjusting a sample rate for capturing a first image and a second image based on a speed of a vehicle, a location of the vehicle, and/or a phase of travel.

### Claim 20 (depends on 16)

The method of claim 16, further comprising updating terrain data in a terrain database based on the dense depth map.
