# US 2021/0174542 A1 · Method for environmental acquisition, data processing unit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174542 A1
- Document ID: US20210174542A1
- Status: Published application
- Kind: A1
- Application number: 17/110,886
- Filed: 2020-12-03
- Published: 2021-06-10
- Earliest claimed: 2019-12-10
- Assignees: Robert Bosch GmbH
- Applicants: Robert Bosch GmbH
- Inventors: Fabian Gigengack; Joern Jachalsky
- Web page: https://patentgrep.com/patent/US20210174542A1

## CPC

- G06T 7/564: from contours
- G01S 13/89: for mapping or imaging
- G01S 13/931: of land vehicles
- G01S 17/89: for mapping or imaging
- G01S 17/931: of land vehicles
- G06T 7/73: using feature-based methods
- G06T 7/74: {involving reference images or patches}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces}
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for environmental acquisition for acquiring the surrounding environment of a vehicle. Using a plurality of cameras and/or sensor devices, from at least two positions, images of the surrounding environment are produced, and on the basis of the images a free surface, as well as a contour bounding the free surface, are ascertained. Separately for each image and the contour determined on the basis of this image, for a multiplicity of points along the contour, feature vectors are calculated and entered into a one-dimensional array. Through matching of the one-dimensional arrays, correspondences are sought for which the three-dimensional position is subsequently ascertained by triangulation. A computing unit for carrying out at least individual method steps of the method is also described.

## Claims

### Claim 1

A method for environmental acquisition for acquiring a surrounding environment of a vehicle, the method comprising the following steps:
using a plurality of cameras and/or sensor devices, from at least two positions, producing images of the surrounding environment, and ascertaining, based each of the images, a respective free surface and a respective contour bounding the respective free surface;
separately, for each of the images, for a multiplicity of points along the respective contour, calculating feature vectors and entering the features vectors into a respective one-dimensional array;
determining correspondences by matching the respective one-dimensional arrays; and
ascertaining, based on the correspondences, a three-dimensional position using triangulation.

### Claim 2 (depends on 1)

The method as recited in claim 1, wherein the ascertained three-dimensional position is stored in an environment model using a specified reference point.

### Claim 3 (depends on 2)

The method as recited in claim 2, wherein the specified reference point is a vehicle reference point.

### Claim 4 (depends on 1)

The method as recited in claim 1, wherein the images of the surrounding environment are produced using a set of calibrated cameras and/or sensor devices.

### Claim 5 (depends on 1)

The method as recited in claim 1, wherein at least one sensor is used to ascertain the free surface.

### Claim 6 (depends on 5)

The method as recited in claim 5, wherein the sensor is a radar sensor or a lidar sensor.

### Claim 7 (depends on 1)

The method as recited in claim 1, wherein from the images of the surrounding environment and/or sensor data, information is derived about a local surrounding environment of a point, and is stored as additional information.

### Claim 8 (depends on 1)

The method as recited in claim 1, wherein a number of points along each respective contour that bounds the respective free surface is quantified.

### Claim 9 (depends on 1)

The method as recited in claim 1, wherein a number of points along each respective contour that bounds the respective free surface is quantified by horizontal view rays configured at the same angular distance from one another.

### Claim 10 (depends on 1)

The method as recited in claim 1, wherein in the matching of the respective one-dimensional arrays, epipolar geometry is used in the form of an epipolar line.

### Claim 11 (depends on 1)

The method as recited in claim 1, wherein, for error correction, a post-estimation is carried out in a local surrounding environment of a found correspondence.

### Claim 12 (depends on 1)

The method as recited in claim 1, wherein in the determining of the correspondences, a previously defined ground plane is used as a starting point.

### Claim 13 (depends on 1)

The method as recited in claim 1, wherein, to distinguish between static and dynamic objects in the surrounding environment, it is investigated whether the three-dimensional position in the environment model, derived from the correspondences, remains constant over time.

### Claim 14

A data processing unit configured for environmental acquisition for acquiring a surrounding environment of a vehicle, the data processing unit configured to:
using a plurality of cameras and/or sensor devices, from at least two positions, produce images of the surrounding environment, and ascertain, based each of the images, a respective free surface and a respective contour bounding the respective free surface;
separately, for each of the images, for a multiplicity of points along the respective contour, calculate feature vectors and entering the features vectors into a respective one-dimensional array;
determine correspondences by matching the respective one-dimensional arrays; and
ascertain, based on the correspondences, a three-dimensional position using triangulation;
wherein the data processing unit is connected to or capable of being connected to, at least one camera and/or sensor device in such a way as to communicate data.
