# US 2008/0189036 A1 · Method and system for three-dimensional obstacle mapping for navigation of autonomous vehicles

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0189036 A1
- Document ID: US20080189036A1
- Status: Published application
- Kind: A1
- Application number: 11/671,755
- Filed: 2007-02-06
- Published: 2008-08-07
- Earliest claimed: 2007-02-06
- Assignees: Honeywell International Inc.
- Inventors: Michael R. Elgersma
- Web page: https://patentgrep.com/patent/US20080189036A1

## CPC

- G06T 7/571: from focus
- G05D 1/106: {Change initiated in response to external conditions, e.g. avoidance of elevated terrain or of no-fly zones}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

A method and system for obstacle mapping for navigation of an autonomous vehicle is disclosed. The method comprises providing an autonomous vehicle with an image capturing device, and focusing the image capturing device at a predetermined number of different specified distances to capture an image at each of the specified distances. The method further comprises identifying which regions in the captured images are in focus, and assigning a corresponding lens-focus distance to each of the regions that are in focus. A composite image is formed from the captured images, with each of the regions labeled with the corresponding lens-focus distance. A three-dimensional obstacle map is then produced from the composite image. The three-dimensional obstacle map has an x, y, z coordinate system, with x being proportional to pixel horizontal position, y being proportional to pixel vertical position, and z being the lens-focus distance.

## Claims

### Claim 1

A method of obstacle mapping for navigation of an autonomous vehicle, the method comprising:
providing an autonomous vehicle with an image capturing device;
focusing the image capturing device at a predetermined number of different specified distances to capture an image at each of the specified distances;
identifying which regions in each captured image are in focus;
assigning a corresponding lens-focus distance to each of the regions that are in focus;
forming a composite image based on each captured image, with each of the regions labeled with the corresponding lens-focus distance; and
producing a three-dimensional obstacle map from the composite image, wherein the three-dimensional obstacle map has an x, y, z coordinate system, with x being proportional to pixel horizontal position, y being proportional to pixel vertical position, and z being the lens-focus distance.

### Claim 2 (depends on 1)

The method of claim 1, further comprising employing the three-dimensional obstacle map in an obstacle avoidance algorithm.

### Claim 3 (depends on 2)

The method of claim 2, wherein the obstacle avoidance algorithm comprises a Laplacian path planning algorithm.

### Claim 4 (depends on 1)

The method of claim 1, further comprising producing a two-dimensional array of ranges for each of the regions prior to producing the three-dimensional obstacle map.

### Claim 5 (depends on 1)

The method of claim 1, wherein the autonomous vehicle comprises an unmanned aerial vehicle.

### Claim 6 (depends on 5)

The method of claim 5, wherein the unmanned aerial vehicle comprise a micro air vehicle, or an organic air vehicle.

### Claim 7 (depends on 1)

The method of claim 1, wherein the image capturing device comprises a digital camera.

### Claim 8 (depends on 1)

The method of claim 1, wherein the digital camera provides seven range bins for an obstacle distance from about 7 m to about 52 m.

### Claim 9

An obstacle detection and mapping system, comprising:
an image capturing device configured to focus at a predetermined number of different specified distances to capture an image at each of the specified distances;
a mapping module in operative communication with the image capturing device, wherein the mapping module has instructions to:
identify which regions in each captured image are in focus;
assign a corresponding lens-focus distance to each of the regions that are in focus;
form a composite image based on each captured image, with each of the regions labeled with the corresponding lens-focus distance; and
produce a three-dimensional obstacle map from the composite image, wherein the three-dimensional obstacle map has an x, y, z coordinate system, with x being proportional to pixel horizontal position, y being proportional to pixel vertical position, and z being the lens-focus distance; and
an obstacle avoidance module in operative communication with the mapping module.

### Claim 10 (depends on 9)

The system of claim 9, wherein the image capturing device comprises a digital camera.

### Claim 11 (depends on 10)

The system of claim 10, wherein the digital camera is configured to provide seven range bins for an obstacle distance from about 7 m to about 52 m.

### Claim 12 (depends on 9)

The system of claim 9, wherein the obstacle avoidance module has instructions to employ the three-dimensional obstacle map in an obstacle avoidance algorithm.

### Claim 13 (depends on 12)

The system of claim 12, wherein the obstacle avoidance algorithm comprises a Laplacian path planning algorithm.

### Claim 14 (depends on 9)

An autonomous vehicle comprising the obstacle detection system according to claim 9.

### Claim 15 (depends on 14)

The autonomous vehicle of claim 14, wherein the vehicle comprises an unmanned aerial vehicle.

### Claim 16 (depends on 15)

The autonomous vehicle of claim 15, wherein the unmanned aerial vehicle comprises a micro air vehicle, or an organic air vehicle.

### Claim 17

A computer readable medium having instructions stored thereon for a method of obstacle mapping for navigation of an autonomous vehicle, the method comprising:
focusing an image capturing device at a predetermined number of different specified distances from an autonomous vehicle to capture an image at each of the specified distances;
identifying which regions in each captured image are in focus;
assigning a corresponding lens-focus distance to each of the regions that are in focus;
forming a composite image based on each captured image, with each of the regions labeled with the corresponding lens-focus distance; and
producing a three-dimensional obstacle map from the composite image, wherein the three-dimensional obstacle map has an x, y, z coordinate system, with x being proportional to pixel horizontal position, y being proportional to pixel vertical position, and z being the lens-focus distance.

### Claim 18 (depends on 17)

The computer readable medium of claim 17, wherein the method further comprises employing the three-dimensional obstacle map in an obstacle avoidance algorithm.

### Claim 19 (depends on 18)

The computer readable medium of claim 18, wherein the obstacle avoidance algorithm comprises a Laplacian path planning algorithm.

### Claim 20 (depends on 17)

The computer readable medium of claim 17, wherein the method further comprises producing a two-dimensional array of ranges for each of the regions prior to producing the three-dimensional obstacle map.
