# US 2021/0341310 A1 · Method for estimating the quality of localisation in the self-localisation of a vehicle, device for carrying out the steps of the method, vehicle, and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0341310 A1
- Document ID: US20210341310A1
- Status: Published application
- Kind: A1
- Application number: 17/262,315
- Filed: 2019-07-25
- Published: 2021-11-04
- Earliest claimed: 2018-07-27
- Assignees: Volkswagen Aktiengesellschaft
- Applicants: Volkswagen Aktiengesellschaft; Man Truck & Bus SE
- Inventors: Daniel WILBERS; Christian MERFELS; Bernd RECH; Thilo SCHAPER; Niklas KOCH; Stefan JÜRGENS; David PERDOMO LOPEZ; Constanze HUNGAR
- Web page: https://patentgrep.com/patent/US20210341310A1

## CPC

- G01C 21/26: specially adapted for navigation in a road network
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G01C 21/30: Map- or contour-matching
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

A method for estimating the quality of localization using sensor detection, wherein the vehicle detects dynamic objects on the road and in the direct surroundings of the road and estimates the dimensions of the objects. The movement of these objects in the near future is estimated. The outer casings of these objects are entered into a map of the surroundings. From the perspective of the sensors used to detect the features in the surroundings, the limitations of the fields of view and the predicted temporal development thereof resulting from the movement of the transportation vehicle and the predicted movements of the objects are entered into the map of the surroundings. The surrounding features that have been entered into the map of the surroundings and which may at visible in the near future are determined. An upper limit for a measure of the quality of localization is estimated.

## Claims

### Claim 1

A method for estimating the quality of localization in the self-localization of a transportation vehicle in which a map of the surrounding area is used for the self-localization, the map being used in controlling the transportation vehicle, the method comprising:
a transportation vehicle, when driving on a road, attempting to detect a number of landmarks recorded in the map of the surrounding area using sensors;
determining, by the transportation vehicle, the position of the transportation vehicle from the position of the number of landmarks;
determining the future visibility of landmarks in the transportation vehicle; and
estimating, by the transportation vehicle, the quality of localization in the self-localization of the transportation vehicle based on the visibility of the landmarks.

### Claim 2 (depends on 1)

The method of claim 1, further comprising detecting obstacles which restrict the visibility of landmarks is to determine the future visibility of the landmarks.

### Claim 3 (depends on 2)

The method of claim 2, wherein detecting the obstacles uses sensors of moving obstacles on the roadway and in the surrounding area of the roadway.

### Claim 4 (depends on 2)

The method of claim 2, wherein determining the future visibility of landmarks further comprise estimating movements trajectories of the moving obstacles.

### Claim 5 (depends on 4)

The method of claim 4, wherein determining the future visibility of landmarks further comprises recording the projected positions of the moving obstacles in the map of the surrounding area.

### Claim 6 (depends on 5)

The method of claim 5, wherein the recording the projected positions of the moving obstacles in the map of the surrounding area comprises recording the spatial extent of the moving obstacles.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the future visibility of landmarks further comprises estimating the future visibility range of a sensor of the transportation vehicle.

### Claim 8 (depends on 7)

The method of claim 7, further comprising determining the landmarks to be observed in future based on the determined future visibility ranges.

### Claim 9 (depends on 8)

The method of claim 8, wherein the quality of localization in the self-localization of the transportation vehicle is determined based on the number of landmarks to be observed in the future.

### Claim 10 (depends on 8)

The method of claim 8, wherein the quality of localization is determined through statistical evaluation of the landmarks to be observed in the future, taking account of the position of the landmarks in relation to one another.

### Claim 11 (depends on 10)

The method of claim 10, wherein the covariance of the positions of the landmarks which are to be observed in relation to one another is calculated for the statistical evaluation of the landmarks to be observed in the future.

### Claim 12

A device for estimating the quality of localization in the self-localization of a transportation vehicle in which a map of the surrounding area is used for the self-localization, the map being used in controlling the transportation vehicle, wherein the device comprises:
at least one processor device configured to carry out a method comprising:
while a transportation vehicle is driving on a road, attempting to detect a number of landmarks recorded in the map of the surrounding area using sensors;
determining the position of the transportation vehicle from the position of the number of landmarks;
determining the future visibility of landmarks in the transportation vehicle; and
estimating the quality of localization in the self-localization of the transportation vehicle based on the visibility of the landmarks.

### Claim 13 (depends on 12)

A transportation vehicle, comprising the device of claim 12.

### Claim 14 (depends on 1)

A non-transitory computer readable medium including computer program code which, when executed in a processor device, carries out the method of claim 1.

### Claim 15 (depends on 1)

The device of claim 1, wherein the detection of obstacles which restrict the visibility of landmarks is performed to determine the future visibility of the landmarks.

### Claim 16 (depends on 15)

The device of claim 15, wherein detection of the obstacles uses sensors of moving obstacles on the roadway and in the surrounding area of the roadway.

### Claim 17 (depends on 15)

The device of claim 15, wherein determination of the future visibility of landmarks further comprises estimating movements trajectories of the moving obstacles.

### Claim 18 (depends on 17)

The device of claim 17, wherein determination of the future visibility of landmarks further comprises recording the projected positions of the moving obstacles in the map of the surrounding area.

### Claim 19 (depends on 18)

The device of claim 18, wherein recordation of the projected positions of the moving obstacles in the map of the surrounding area comprises recording the spatial extent of the moving obstacles.

### Claim 20 (depends on 1)

The device of claim 1, wherein determination of the future visibility of landmarks further comprises estimating the future visibility range of a sensor of the transportation vehicle.

### Claim 21 (depends on 20)

The device of claim 20, wherein the at least one processor is further configured to determine to be observed in future based on the determined future visibility ranges.

### Claim 22 (depends on 21)

The device of claim 21, wherein the quality of localization in the self-localization of the transportation vehicle is determined based on the number of landmarks to be observed in the future.

### Claim 23 (depends on 21)

The device of claim 21, wherein the quality of localization is determined through statistical evaluation of the landmarks to be observed in the future, taking account of the position of the landmarks in relation to one another.

### Claim 24 (depends on 23)

The device of claim 23, wherein the covariance of the positions of the landmarks which are to be observed in relation to one another is calculated for the statistical evaluation of the landmarks to be observed in the future.
