# US 2024/0069150 A1 · Generation and use of hd maps

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0069150 A1
- Document ID: US20240069150A1
- Status: Published application
- Kind: A1
- Application number: 18/504,020
- Filed: 2023-11-07
- Published: 2024-02-29
- Earliest claimed: 2017-01-05
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Kim MAHLER; Thomas HAUSTEIN; Marcus GROSSMANN; Kei SAKAGUCHI
- Web page: https://patentgrep.com/patent/US20240069150A1

## CPC

- G01S 7/003: {Transmission of data between radar, sonar or lidar systems and remote stations}
- G01C 21/367: {Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker}
- G01C 21/3694: {Output thereof on a road map}
- G01C 21/3841: {Data obtained from two or more sources, e.g. probe vehicles}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 17/89: for mapping or imaging
- G01S 17/931: of land vehicles
- G06F 18/25: Fusion techniques
- G06V 20/64: Three-dimensional [3D] objects
- G08C 21/00: Systems for transmitting the position of an object with respect to a predetermined reference system, e.g. tele-autographic system
- H04Q 9/00: Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
- G01S 2013/9316: {combined with communication equipment with other vehicles or with base stations}
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- H04Q: SELECTING (switches, relays, selectors H01H; wireless communication networks H04W)

## Abstract

An apparatus including a processor unit configured to provide a first high-definition map, a sensor unit configured for providing sensor data representing an environmental condition in a periphery of the apparatus and a receiver unit configured to receive data representing a second high-definition map. The processor unit is configured to fuse the second high-definition map and the sensor data so as to provide the first high-definition map. The apparatus further includes a transmitter unit configured for transmitting a result of fusing the second high-definition map and the sensor data, and includes a command generator unit configured to generate a command signal representing a vehicle control command for a vehicle carrying the apparatus based on the first high-definition map.

## Claims

### Claim at position 1

-44. (canceled)

### Claim 45

An apparatus comprising:
a receiver unit configured to receive data representing a second high-definition map;
a processor unit is configured for obtaining sensor data representing an environmental condition in a periphery of a device; the sensor data comprising information about a size, a speed and/or a position of an object in the periphery; and is configured to fuse the second high-definition map and the sensor data so as to provide a first high-definition map;
a transmitter unit configured for transmitting a result of fusing the second high-definition map and the sensor data.

### Claim 46 (depends on 45)

The apparatus if claim 45, comprising:
a command generator unit configured to generate a command signal representing a vehicle control command for a vehicle carrying the apparatus based on the first high-definition map.

### Claim 47 (depends on 45)

The apparatus of claim 45, wherein the second high-definition map is a map with a high information resolution and enables a vehicle to be driven autonomously and covers an area that is wider or larger when compared to a range being sensed with the sensor unit.

### Claim 48 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured for renewing or updating data of the received second high-definition map in the first high-definition map by the sensor data with the fusing.

### Claim 49 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured for renewing or updating data of the received second high-definition map in the first high-definition map by the sensor data with the fusing, and wherein the processor unit is configured to update or to refresh only such areas or data objects in the second high-definition map for which sensor data is available.

### Claim 50 (depends on 45)

The apparatus of claim 45, configured to communicate to a conventional V2X network and/or a backhaul network that receives and/or transmits information indicating a speed for nodes in the network.

### Claim 51 (depends on 45)

The apparatus of claim 45, wherein the receiver unit is configured to receive data representing at least a third high-definition map;
wherein the processor unit is configured to fuse the second high-definition map, the third high-definition map and the sensor data so as to provide the first high-definition map.

### Claim 52 (depends on 45)

The apparatus of claim 45, wherein an area of the first high-definition map is greater than an area of the periphery.

### Claim 53 (depends on 45)

The apparatus of claim 45, wherein the receiver unit is configured to receive the second high-definition map using a millimeter-wavelength signal and/or to transmit the first high-definition map using the millimeter-wavelength signal.

### Claim 54 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured to receive information indicating a region of interest in the first high-definition map and to provide the first high-definition map to comprise a first degree of resolution in the region of interest and so as to comprise a second degree of resolution in a region outside the region of interest, wherein the first degree of resolution is higher than the second degree of resolution.

### Claim 55 (depends on 54)

The apparatus of claim 54, wherein the first degree is higher than the second degree by a factor of at least 2.

### Claim 56 (depends on 54)

The apparatus of claim 54, wherein the region of interest comprises a portion of at most 50% of the high-definition map.

### Claim 57 (depends on 45)

The apparatus of claim 45, wherein the transmitter unit is configured for transmitting the first high-definition map with a bitrate that is at least 2 Gbps.

### Claim 58 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured to generate the first high-definition map as a frame of the first high-definition map, wherein the processor unit is configured to generate a plurality of frames of the first high-definition map, wherein the processor unit is configured to generate the plurality of frames with a distance in time that is at most 10 ms.

### Claim 59 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured to generate the first high-definition map comprising a data size that is at least 2.75 Mbyte.

### Claim 60 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured to generate the first high-definition map so as to comprise map information within a radius of at least 300 m around the apparatus.

### Claim 61 (depends on 45)

The apparatus of claim 45, wherein the sensor unit is configured to scan the periphery of the apparatus using an imaging technique for providing the sensor data, wherein the environmental condition is a distance to detected objects within the periphery.

### Claim 62 (depends on 45)

The apparatus of claim 45, wherein the sensor unit comprises a LiDAR sensor.

### Claim 63 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured to determine a portion of details of the first high-definition map relating to a traffic parameter of the apparatus in the first high-definition map, wherein the apparatus comprises a legacy interface configured to transmit the portion of details according to a legacy V2V or V2X communication scheme.

### Claim 64 (depends on 45)

The apparatus of claim 45;
wherein the sensor unit is configured to scan the periphery of the apparatus using a LiDAR sensor, wherein the environmental condition is a distance to detected objects within the periphery;
wherein the second high-definition map is a map received from a further apparatus, the second high-definition map comprising information relating to objects in an area of the second high-definition map generated by the further apparatus; and
wherein the processor unit is configured to adapt the information relating to the objects using the distance between the apparatus and the objects detected by the sensor unit and using an actual position of the apparatus.

### Claim 65 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured to generate the first high-definition map to comprise a same coordinate system when compared to the second high-definition map.

### Claim 66 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured to fuse the second high-definition map, the sensor data and a static map so as to provide the first high-definition map, wherein the apparatus is configured to not transmit the static map when transmitting a result of fusing the second high-definition map and the sensor data.

### Claim 67 (depends on 45)

The apparatus of claim 45, wherein the processor unit is configured to generate the first high-definition map so as to comprise information indicating an age of information of the first high-definition map, wherein the processor unit is configured to discount aged information in the second high-definition map when providing the first high-definition map, the aged information comprising an age above a threshold value.

### Claim 68

Method for generating fusing sensor data and a first high-definition map, the method comprising:
providing a first high-definition map;
providing sensor data with a sensor unit, the sensor data representing an environmental condition in a periphery of an apparatus, the sensor data comprising information about a size, a speed and/or a position of an object in the periphery;
receiving data representing a second high-definition map;
fusing the second high-definition map and the sensor data so as to provide the first high-definition map;
transmitting a result of fusing the second high-definition map and the sensor data.
