# US 2023/0271607 A1 · Vehicle lane marking detection system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0271607 A1
- Document ID: US20230271607A1
- Status: Published application
- Kind: A1
- Application number: 17/683,156
- Filed: 2022-02-28
- Published: 2023-08-31
- Earliest claimed: 2022-02-28
- Assignees: Nissan North America, Inc.
- Applicants: Nissan North America, Inc.
- Inventors: Atsuhide KOBASHI; Christopher OSTAFEW
- Web page: https://patentgrep.com/patent/US20230271607A1

## CPC

- B60W 30/12: Lane keeping
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G01S 7/4817: {relating to scanning}
- G01S 7/4868: {Controlling received signal intensity or exposure of sensor}
- G01S 7/51: Display arrangements
- G01S 17/08: for measuring distance only (indirect measurement G01S17/46; active triangulation systems G01S17/48)
- G01S 17/89: for mapping or imaging
- G01S 17/931: of land vehicles
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60W 2050/146: {Display means}
- B60W 2420/408: Radar; Laser, e.g. lidar
- B60W 2552/53: Road markings, e.g. lane marker or crosswalk
- B60W 2554/4041: Position
- B60W 2554/80: Spatial relation or speed relative to objects
- B60W 2554/802: Longitudinal distance
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A vehicle lane marking detection system includes a 3D sensor, a driver assist component and an electronic controller. The 3D sensor is installed to a vehicle and is configured to scan physical objects around the vehicle outputting a plurality of data points each corresponding to a surface point of a physical feature. Each data point being defined by distance, direction, intensity and vertical location relative to the vehicle. The electronic controller is connected to the 3D sensor and the driver assist component. The electronic controller evaluates a point cloud defined by the data points identifying lane markings based on the intensity of the data points. The data points having intensities greater than a predetermined level are determined to correspond to lane marking and are provided to the driver assist component with the lane markings for use thereby.

## Claims

### Claim 1

A vehicle lane marking detection system, comprising:
a vehicle;
at least one 3D sensor installed to the vehicle being configured to scan physical objects forward of and along lateral sides of the vehicle outputting point cloud that includes a plurality of data points, each data point of the point cloud corresponding to a surface point of a physical feature, each data point being defined by distance, direction, intensity and vertical location relative to the vehicle;
at least one driver assist component; and
an electronic controller connected to the at least one 3D sensor and the at least one driver assist component, the electronic controller evaluating the point cloud from the 3D sensor, evaluate each the point clouds identifying ground features forward and along lateral sides of the vehicle, removing all data points from the point cloud with vertical locations above a predetermined height of ground, identifying data points related to roadway lane markings based on intensity of the data points, evaluating the data points having intensities greater than a predetermined level, further evaluating the data points having intensities greater than the predetermined level to geometric shapes corresponding to lane marking models identifying lane markings and providing the at least one driver assist component with the lane markings for use thereby.

### Claim 2 (depends on 1)

The vehicle lane marking detection system according to claim 1, wherein
the at least one 3D sensor is configured to repeatedly scan physical objects forward of and along lateral sides of the vehicle while the vehicle is in motion producing a corresponding plurality of point clouds, and
the electronic controller is further configured to evaluate each of the corresponding plurality of point clouds, identify further lane markings and provide the further lane markings to the at least one driver assist component with the lane markings for use thereby.

### Claim 3 (depends on 1)

The vehicle lane marking detection system according to claim 1, wherein
the at least one driver assist component includes at least one of the following components: a navigation unit, a collision avoidance application, a lane departure preventing application and a parking assistant.

### Claim 4 (depends on 1)

The vehicle lane marking detection system according to claim 1, further comprising
an electronic display within the vehicle connected to the electronic controller, the electronic controller providing the electronic display with the digital lane markings for display thereon.

### Claim 5 (depends on 1)

The vehicle lane marking detection system according to claim 1, wherein
the at least one driver assist component includes a navigation unit, and
the electronic controller is configured to align navigation data from the navigation unit with the digital lane markings.

### Claim 6 (depends on 1)

The vehicle lane marking detection system according to claim 1, wherein
the at least one driver assist component includes a collision avoidance application, and
the electronic controller is configured to detect and determine location of obstacles ahead of the vehicle relative to the digital lane markings and provide distance and location of obstacles to the collision avoidance application.

### Claim 7 (depends on 1)

The vehicle lane marking detection system according to claim 1, wherein
the at least one driver assist component includes a lane departure preventing application, and
the electronic controller is configured to assist the lane departure preventing application in determining location of the vehicle relative to the digital lane markings.

### Claim 8 (depends on 1)

The vehicle lane marking detection system according to claim 1, wherein
the at least one driver assist component includes a parking assistant, and
the electronic controller is configured to provide the parking assistant with location and distance to the digital lane markings and extracted data points corresponding to curb-like vertical surfaces proximate the vehicle during a parking maneuver controlled by the parking assistant.

### Claim 9 (depends on 1)

The vehicle lane marking detection system according to claim 1, wherein
the electronic controller is configured to evaluate the data from the 3D sensor and create a point cloud that includes data points representing vertical obstacles and non-vertical obstacles.

### Claim 10 (depends on 1)

The vehicle lane marking detection system according to claim 1, wherein
at least one 3D sensor is a LIDAR device installed on the vehicle proximate a central area of a roof of the vehicle oriented to scan areas forward and along lateral sides of the vehicle.

### Claim 11 (depends on 10)

The vehicle lane marking detection system according to claim 10, wherein
the intensity of each of the data points evaluated by the electronic controller corresponds to an intensity of laser signals from the LIDAR device reflected off surfaces forward of or along lateral sides of the vehicle that are detected by the LIDAR device.

### Claim 12 (depends on 10)

The vehicle lane marking detection system according to claim 10, wherein
the vehicle includes a second LIDAR device positioned on the vehicle to scan areas rearward of the vehicle and scan areas that are along rearward lateral sides of the vehicle.

### Claim 13

A method for detecting lane markings on a roadway, comprising:
scanning areas forward and along lateral sides of a vehicle using at least one 3D sensor thereby generating data;
pre-processing the data from the at least one 3D sensor to produce a point cloud having a plurality of data points, each data point representing distance, height, intensity and direction of features relative to the vehicle;
evaluating the point cloud identifying ground surfaces around the vehicle eliminating groups of data points above a predetermined height;
evaluating light intensity of each of the plurality of data points of the data cloud and eliminating all data points below a predetermined intensity threshold;
comparing groups data points to stored geometric patterns identifying lane markings of a road surface; and
providing the location and distance of identified lane markings to at least one driver assist component for driving related actions in accordance with the at least one driver assist component.

### Claim 14 (depends on 13)

The method for detecting lane markings on a roadway according to claim 13, wherein
repeating the scanning of areas while vehicle is in motion, and
repeating the pre-processing of the data, the evaluating of the point cloud, evaluating the light intensity, the comparing groups of data points and providing identified lane markings to the at least one driver assist components.

### Claim 15 (depends on 13)

The method for detecting lane markings on a roadway according to claim 13, wherein
the scanning is performed by a first LIDAR device fixed to the vehicle.

### Claim 16 (depends on 15)

The method for detecting lane markings on a roadway according to claim 15, further comprising
scanning areas rearward and along rearward lateral sides of a vehicle using a second 3D sensor thereby generating data.

### Claim 17 (depends on 16)

The method for detecting lane markings on a roadway according to claim 16, wherein
the scanning of areas rearward and along rearward lateral sides of the vehicle is performed by a second LIDAR device fixed to the vehicle.

### Claim 18 (depends on 13)

The method for detecting lane markings on a roadway according to claim 13, wherein
the scanning is performed by a first LIDAR device.
