# US 2021/0172756 A1 · Lane line creation for high definition maps for autonomous vehicles

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0172756 A1
- Document ID: US20210172756A1
- Status: Published application
- Kind: A1
- Application number: 17/115,576
- Filed: 2020-12-08
- Published: 2021-06-10
- Earliest claimed: 2016-12-30
- Assignees: Deepmap Inc.
- Applicants: DeepMap Inc.
- Inventors: Mark Damon Wheeler; Lin Yang; Dongzhen Piao; Yu Zhang
- Web page: https://patentgrep.com/patent/US20210172756A1

## CPC

- G01C 21/3638: {including 3D objects and buildings (three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05)}
- B60W 40/04: Traffic conditions
- G01C 21/3635: {Guidance using 3D or perspective road maps}
- G01C 21/3811: {Point data, e.g. Point of Interest [POI]}
- G01C 21/3867: {Geometry of map features, e.g. shape points, polygons or for simplified maps}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 17/05: Geographic models
- G06V 10/34: Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
- G06V 10/457: {by analysing connectivity, e.g. edge linking, connected component analysis or slices}
- G06V 20/582: {of traffic signs}
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2420/408: Radar; Laser, e.g. lidar
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An HD map system represents landmarks on a high definition map for autonomous vehicle navigation, including describing spatial location of lanes of a road and semantic information about each lane, and along with traffic signs and landmarks. The system generates lane lines designating lanes of roads based on, for example, mapping of camera image pixels with high probability of being on lane lines into a three-dimensional space, and locating/connecting center lines of the lane lines. The system builds a large connected network of lane elements and their connections as a lane element graph. The system also represents traffic signs based on camera images and detection and ranging sensor depth maps. These landmarks are used in building a high definition map that allows autonomous vehicles to safely navigate through their environments.

## Claims

### Claim 1

A method for generating lane lines in a high definition map comprising:
receiving image data captured by sensors of autonomous vehicles driving on a road, the image data representing a portion of the road;
classifying pixels of the image to determine whether a particular pixel is on a lane line segment;
identifying a set of points that lie on at least one of the lane line segments based on the classification;
grouping the set of points into clusters based on their proximity, wherein each cluster is determined to be associated with a lane line segment;
locating a center line for each cluster of points associated with a lane line segment;
determining a lane line by connecting a plurality of center lines, the connection associating endpoints of two center lines; and
generating a high definition map based on the lane lines, the high definition map for use in driving of autonomous vehicles.
