# US 2019/0318175 A1 · Street marking color recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318175 A1
- Document ID: US20190318175A1
- Status: Published application
- Kind: A1
- Application number: 16/369,914
- Filed: 2019-03-29
- Published: 2019-10-17
- Earliest claimed: 2018-04-16
- Assignees: Aptiv Technologies AG
- Applicants: Aptiv Technologies Limited
- Inventors: Kun Zhao; Yu Su
- Web page: https://patentgrep.com/patent/US20190318175A1

## CPC

- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
- G06T 7/90: Determination of colour characteristics
- B60R 2300/804: for lane monitoring
- B60R 2300/8053: for bad weather conditions or night vision
- G06T 2207/30256: Lane; Road marking
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present invention relates to a method and an image processing system for determining the color of a street marking, by: capturing an image of a street, detecting a street marking as a set of pixels provided by the image, wherein the pixels include at least two different pieces of color information, determining a color score for the street marking by comparing said at least two different pieces of color information, and determining the color of the street marking by comparing the color score to at least one threshold value.

## Claims

### Claim 1

A method for determining the color of a street marking, comprising:
capturing an image of a street;
detecting a street marking as a set of pixels provided by the image, wherein the pixels include at least two different pieces of color information;
determining a color score for the street marking by comparing said at least two different pieces of color information; and
determining the color of the street marking by comparing the color score to at least one threshold value.

### Claim 2 (depends on 1)

The method of claim 1, wherein a red-clear camera is used for capturing the image such that the image has pixels with red color information and clear color information, wherein the clear color information corresponds to pixels having no red, green or blue color distinction.

### Claim 3 (depends on 1)

The method of claim 1, wherein the color score is determined by calculating proportions based on a comparison of the at least two different pieces of color information.

### Claim 4 (depends on 3)

The method of claim 3, wherein the color score is determined by using a training-based classifier.

### Claim 5 (depends on 1)

The method of any of claim 1, further comprising:
gathering the color scores determined for a plurality of street markings; and
determining the at least one threshold value based on the statistical distribution of the color scores.

### Claim 6 (depends on 5)

The method of claim 5, wherein the color scores are gathered based on a plurality of street markings detected in a plurality of images, wherein the color scores are gathered and the at least one threshold value is determined during capturing of the video stream taken from a vehicle.

### Claim 7 (depends on 5)

The method of claim 5, wherein the threshold value is determined based on the statistical distribution being modelled as a superposition of a plurality of statistical color distributions, wherein each of the statistical color distributions corresponds to a color of a street marking, wherein the statistical distribution is modelled as a superposition of a plurality of Gaussian statistical color distributions.

### Claim 8 (depends on 1)

The method of claim 1, wherein the color of the street marking is determined to correspond to a first color if the color score is greater than a threshold value, and the color of the street marking is determined to correspond to a second color if the color score is smaller than the threshold value.

### Claim 9 (depends on 8)

The method of claim 8, wherein the first color and the second color correspond to the colors of a street lane, wherein the first color and the second color correspond to the colors yellow and white, or white and yellow, respectively.

### Claim 10

An image processing system, comprising:
a camera adapted to capture an image of a street;
an image processing means coupled to the camera;
wherein the image processing means:
detects a street marking as a set of pixels provided by the image, wherein the pixels include at least two different pieces of color information;
determines a color score for the street marking by comparing said at least two different pieces of color information; and
determines the color of the street marking by comparing the color score to at least one threshold value.

### Claim 11 (depends on 10)

The image processing system of claim 10, wherein the camera is a red-clear camera for capturing images having pixels with red color information and clear color information, wherein the clear color information corresponds to pixels having no red, green or blue color distinction.

### Claim 12 (depends on 10)

The image processing system of claim 10, wherein the image processing means is adapted to gather the color scores determined for a plurality of street markings, and to determine the at least one threshold value based on the statistical distribution of the color scores

### Claim 13 (depends on 12)

The image processing system of claim 12, wherein the image processing means is adapted to gather the color scores based on a plurality of street markings detected in a plurality of images captured by the camera, wherein the color scores are gathered and the at least one threshold value is determined during capturing of the video stream taken from a vehicle.

### Claim 14 (depends on 12)

The image processing system of claim 12, wherein the image processing means is adapted to determine the at least one threshold value based on modelling the statistical distribution as a superposition of a plurality of statistical color distributions, wherein each of the statistical color distributions corresponds to a color of a street marking, wherein the statistical distribution is modelled as a superposition of a plurality of Gaussian statistical color distributions.

### Claim 15 (depends on 10)

The image processing system of claim 10, wherein the image processing means is adapted to determine that the color of the street marking corresponds to a first color if the color score is greater than the threshold value, and to determine that the color of the street marking corresponds to a second color if the color score is smaller than the threshold value

### Claim 16 (depends on 15)

The image processing system of claim 15, wherein the first color and the second color correspond to the colors yellow and white, or white and yellow, respectively.

### Claim 17 (depends on 10)

The image processing system of claim 10, wherein the camera is configured to be mounted on a vehicle.

### Claim 18 (depends on 10)

The image processing system of claim 10, wherein the color of a street marking is the color of a street lane marking

### Claim 19 (depends on 18)

The image processing system of claim 18, wherein the color of a street marking is a yellow color or a white color.
