# US 2018/0024568 A1 · Crowdsourcing a sparse map for autonomous vehicle navigation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024568 A1
- Document ID: US20180024568A1
- Status: Published application
- Kind: A1
- Application number: 15/656,223
- Filed: 2017-07-21
- Published: 2018-01-25
- Earliest claimed: 2016-07-21
- Assignees: Mobileye Vision Technologies Ltd.
- Applicants: Mobileye Vision Technologies Ltd.
- Inventors: Ofer Fridman
- Web page: https://patentgrep.com/patent/US20180024568A1

## CPC

- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- B60W 60/0016: {of the vehicle or its occupants}
- G01C 21/28: with correlation of data from several navigational instruments
- G01C 21/3822: {Road feature data, e.g. slope data}
- G01C 21/3848: {Data obtained from both position sensors and additional sensors}
- G01C 21/3852: {Data derived from aerial or satellite images}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G05D 1/0251: {extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision (stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593)}
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G05D 1/0278: {using satellite positioning signals, e.g. GPS}
- G05D 1/2435: {Extracting 3D information}
- G05D 1/246: using environment maps, e.g. simultaneous localisation and mapping [SLAM]
- G05D 1/248: generated by satellites, e.g. GPS
- G05D 1/249: from positioning sensors located off-board the vehicle, e.g. from cameras
- G06T 7/11: Region-based segmentation
- G06T 7/12: Edge-based segmentation
- G06T 7/337: {involving reference images or patches}
- G06T 7/37: using transform domain methods
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/74: {involving reference images or patches}
- G06T 11/65: on geographic maps
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- G08G 1/096708: {where the received information might be used to generate an automatic action on the vehicle control}
- G08G 1/096725: {where the received information generates an automatic action on the vehicle control}
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2552/10: Number of lanes
- B60W 2552/25: Road altitude
- B60W 2552/30: Road curve radius
- B60W 2552/35: Road bumpiness, e.g. potholes
- B60W 2552/50: Barriers
- B60W 2552/53: Road markings, e.g. lane marker or crosswalk
- B60W 2554/20: Static objects
- B60W 2554/4026: Cycles
- B60W 2554/4029: Pedestrians
- B60W 2554/4041: Position
- B60W 2554/60: Traversable objects, e.g. speed bumps or curbs
- B60W 2554/802: Longitudinal distance
- B60W 2554/804: Relative longitudinal speed
- G05D 1/0231: {using optical position detecting means (position-fixing by using electromagnetic waves other than radio waves, e.g. optical position detecting means G01S5/16)}
- G06T 2207/10024: Color image
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/30256: Lane; Road marking
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

Systems and methods are provided for crowdsourcing a sparse map for autonomous vehicle navigation. In one implementation, a non-transitory computer-readable medium may include a sparse map for autonomous vehicle navigation along a road segment. The sparse map may include at least one line representation of a road surface feature extending along the road segment, each line representation representing a path along the road segment substantially corresponding with the road surface feature, and wherein the road surface feature is identified through image analysis of a plurality of images acquired as one or more vehicles traverse the road segment and a plurality of landmarks associated with the road segment.

## Claims

### Claim 1

A non-transitory computer-readable medium including a sparse map for autonomous vehicle navigation along a road segment, the sparse map comprising:
at least one line representation of a road surface feature extending along the road segment, each line representation representing a path along the road segment substantially corresponding with the road surface feature, and wherein the road surface feature is identified through image analysis of a plurality of images acquired as one or more vehicles traverse the road segment; and
a plurality of landmarks associated with the road segment.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the road surface feature includes at least one of a road edge or a lane marking.

### Claim 3 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein at least one of the plurality of landmarks includes a road sign.

### Claim 4 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the plurality of landmarks are spaced apart by an average distance in the map of at least 50 m.

### Claim 5 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the sparse map has a data density of no more than 1 megabyte per kilometer.

### Claim 6 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the at least one line representation of the road surface feature includes a spline, a polynomial representation, or a curve.

### Claim 7 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the plurality of landmarks are identified through image analysis of the plurality of images acquired as one or more vehicles traverse the road segment.

### Claim 8 (depends on 7)

The non-transitory computer-readable medium of claim 7, wherein the image analysis to identify the plurality of landmarks includes accepting potential landmarks when a ratio of images in which the landmark does appear to images in which the landmark does not appear exceeds a threshold.

### Claim 9 (depends on 7)

The non-transitory computer-readable medium of claim 7, wherein the image analysis to identify the plurality of landmarks includes rejecting potential landmarks when a ratio of images in which the landmark does not appear to images in which the landmark does appear exceeds a threshold.

### Claim 10

A system for generating a sparse map for autonomous vehicle navigation along a road segment, comprising:
at least one processing device configured to:
receive a plurality of images acquired as one or more vehicles traverse the road segment;
identify, based on the plurality of images, at least one line representation of a road surface feature extending along the road segment, each line representation representing a path along the road segment substantially corresponding with the road surface feature; and
identify, based on the plurality of images, a plurality of landmarks associated with the road segment.

### Claim 11 (depends on 10)

The system of claim 10, wherein the road surface feature includes at least one of a road edge or a lane marking.

### Claim 12 (depends on 10)

The system of claim 10, wherein at least one of the plurality of landmarks includes a road sign.

### Claim 13 (depends on 10)

The system of claim 10, wherein the at least one line representation of the road surface feature includes a spline, a polynomial representation, or a curve.

### Claim 14 (depends on 10)

The system of claim 10, wherein identifying the plurality of landmarks includes analyzing the plurality of images acquired as one or more vehicles traverse the road segment.

### Claim 15 (depends on 14)

The system of claim 14, wherein analyzing the plurality of images to identify the plurality of landmarks includes accepting potential landmarks when a ratio of images in which the landmark does appear to images in which the landmark does not appear exceeds a threshold.

### Claim 16 (depends on 14)

The system of claim 14, wherein analyzing the plurality of images to identify the plurality of landmarks includes rejecting potential landmarks when a ratio of images in which the landmark does not appear to images in which the landmark does appear exceeds a threshold.

### Claim 17

A method for generating a sparse map for autonomous vehicle navigation along a road segment, comprising:
receiving a plurality of images acquired as one or more vehicles traverse the road segment;
identifying, based on the plurality of images, at least one line representation of a road surface feature extending along the road segment, each line representation representing a path along the road segment substantially corresponding with the road surface feature; and
identifying, based on the plurality of images, a plurality of landmarks associated with the road segment.

### Claim 18 (depends on 17)

The method of claim 17, wherein identifying the plurality of landmarks includes analyzing the plurality of images acquired as one or more vehicles traverse the road segment.

### Claim 19 (depends on 18)

The method of claim 18, wherein analyzing the plurality of images to identify the plurality of landmarks includes accepting potential landmarks when a ratio of images in which the landmark does appear to images in which the landmark does not appear exceeds a threshold.

### Claim 20 (depends on 18)

The method of claim 18, wherein analyzing the plurality of images to identify the plurality of landmarks includes rejecting potential landmarks when a ratio of images in which the landmark does not appear to images in which the landmark does appear exceeds a threshold.
