# US 2021/0061064 A1 · System and method for generating map data associated with road objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0061064 A1
- Document ID: US20210061064A1
- Status: Published application
- Kind: A1
- Application number: 16/555,670
- Filed: 2019-08-29
- Published: 2021-03-04
- Earliest claimed: 2019-08-29
- Assignees: HERE Global B.V.
- Applicants: Here Global B.V.
- Inventors: Abhilshit SONI
- Web page: https://patentgrep.com/patent/US20210061064A1

## CPC

- B60H 1/00771: {the input being a vehicle position or surrounding, e.g. GPS-based position or tunnel}
- G01C 21/32: Structuring or formatting of map data
- G01C 21/3644: {Landmark guidance, e.g. using POIs or conspicuous other objects}
- G01C 21/367: {Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker}
- G01C 21/3815: {Road data}
- G06T 1/0007: {Image acquisition}
- G06T 7/11: Region-based segmentation
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20036: Morphological image processing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- B60H: ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A method, a system, and a computer program product may be provided for generating map data associated with one or more objects in a region. The method includes receiving point cloud data associated with the region. The method further includes generating a georeferenced top down raster image of the region, based on the point cloud data. The georeferenced top down raster image is indicative of a top surface of each of the one or more objects. The method further includes determining boundary data of the top surface of each of the one or more objects, based on the georeferenced top down raster image and generating the map data associated with the one or more objects, based on the boundary data of the top surface of each of the one or more objects.

## Claims

### Claim 1

A system for generating map data associated with one or more objects in a region, the system comprising:
a memory configured to store instructions;
one or more processors configured to execute the instructions to:
receive point cloud data associated with the region;
generate a georeferenced top down raster image of the region, based on the point cloud data, wherein the georeferenced top down raster image is indicative of a top surface of each of the one or more objects;
determine boundary data of the top surface of each of the one or more objects, based on the georeferenced top down raster image; and
generate the map data associated with the one or more objects, based on the boundary data of the top surface of each of the one or more objects.

### Claim 2 (depends on 1)

The system of claim 1, wherein to generate the georeferenced top down raster image of the region, the one or more processors are further configured to:
filter one or more points of the point cloud data falling below a threshold height from a ground level to obtain height filtered point cloud data; and
generate the georeferenced top down raster image, based on the height filtered point cloud data.

### Claim 3 (depends on 1)

The system of claim 1, wherein to determine the boundary data of the top surface of each of the one or more objects, the one or more processors are further configured to identify, a boundary of the top surface of each of the one or more objects from the georeferenced top down raster image, based on one or more of a semantic image segmentation deep learning model or at least one standard computer vision filtering technique.

### Claim 4 (depends on 1)

The system of claim 1, wherein to generate the map data associated with each of the one or more objects, the one or more processors are further configured to determine a median of the top surface of each of the one or more objects.

### Claim 5 (depends on 4)

The system of claim 4, wherein the one or more processors are further configured to determine one or more of a centerline geometry, a start point, or an end point of the top surface of each of the one or more objects, based on the median.

### Claim 6 (depends on 1)

The system of claim 1, wherein the one or more processors are further configured to:
receive GPS probe data associated with each of the one or more objects;
determine a trace of one or more devices within the boundary data associated with each of the one or more objects, based on the GPS probe data; and
determine a direction of travel associated with each of the one or more objects, based on the trace of the one or more devices.

### Claim 7 (depends on 6)

The system of claim 6, wherein the one or more processors are further configured to determine a speed limit associated with each of the one or more objects based on speed data captured in the GPS probe data.

### Claim 8 (depends on 1)

The system of claim 1, wherein the one or more objects include one or more of a tunnel, a divider, a bridge, a flyover, or a roundabout.

### Claim 9 (depends on 1)

The system of claim 1, wherein the one or more processors are further configured to:
obtain map data associated with the region; and
update the map data of the region with the generated map data of the one or more objects.

### Claim 10

A method for generating map data associated with one or more objects in a region, the method comprising:
receiving point cloud data associated with the region;
generating a georeferenced top down raster image of the region, based on the point cloud data, wherein the georeferenced top down raster image is indicative of a top surface of each of the one or more objects;
determining boundary data of the top surface of each of the one or more objects, based on the georeferenced top down raster image; and
generating the map data associated with the one or more objects, based on the boundary data of the top surface of each of the one or more objects.

### Claim 11 (depends on 10)

The method of claim 10, wherein generating the georeferenced top down raster image of the region further comprises:
filtering, one or more points of the point cloud data falling below a threshold height from a ground level, to obtain height filtered point cloud data; and
generating the georeferenced top down raster image, based on the height filtered point cloud data.

### Claim 12 (depends on 10)

The method of claim 10, wherein determining the boundary data of the top surface of each of the one or more objects further comprises identifying, a boundary of the top surface of each of the one or more objects from the georeferenced top down raster image, based on one or more of a semantic image segmentation deep learning model or at least one standard computer vision filtering technique.

### Claim 13 (depends on 10)

The method of claim 10, wherein generating the map data associated with each of the one or more objects further comprises determining a median of the top surface of each of the one or more objects.

### Claim 14 (depends on 13)

The method of claim 13, further comprising determining one or more of a centerline geometry, a start point, or an end point of the top surface of each of the one or more objects, based on the median.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
receiving GPS probe data associated with each of the one or more objects;
determining a trace of one or more devices within the boundary data associated with each of the one or more objects, based on the GPS probe data; and
determining a direction of travel associated with each of the one or more objects, based on the trace of the one or more devices.

### Claim 16 (depends on 15)

The method of claim 15, further comprising determining a speed limit associated with each of the one or more objects based on speed data captured in the GPS probe data.

### Claim 17 (depends on 10)

The method of claim 10, wherein the one or more objects include one or more of a tunnel, a divider, a bridge, a flyover, or a roundabout.

### Claim 18 (depends on 10)

The method of claim 10, further comprising:
obtaining map data of the region; and
updating the map data of the region with the generated map data of the one or more objects.

### Claim 19

A non-transitory computer readable medium having stored thereon, computer-executable instructions for causing a computer to execute operations for generating map data associated with one or more objects in a region, the operations comprising:
receiving point cloud data associated with the region;
generating a georeferenced top down raster image of the region, based on the point cloud data, wherein the georeferenced top down raster image is indicative of a top surface of each of the one or more objects;
determining boundary data of the top surface of each of the one or more objects, based on the georeferenced top down raster image; and
generating the map data associated with the one or more objects, based on the boundary data of the top surface of each of the one or more objects.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein for generating the georeferenced top down raster image of the region, the operations further comprise:
filtering, one or more points of the point cloud data falling below a threshold height from a ground level, to obtain height filtered point cloud data; and
generating the georeferenced top down raster image, based on the height filtered point cloud data.
