# US 12,002,270 B2 · Enhanced detection using special road coloring

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,002,270 B2
- Document ID: US12002270B2
- Status: Granted
- Kind: B2
- Application number: 17/372,659
- Filed: 2021-07-12
- Published: 2022-09-08
- Granted: 2024-06-04
- Earliest claimed: 2021-03-04
- Assignees: NEC Corporation Of America
- Applicants: NEC Corporation Of America
- Inventors: Tsvi Lev
- Web page: https://patentgrep.com/patent/US12002270B2

## CPC

- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- E01C 23/16: Devices for marking-out, applying, or forming traffic or like markings on finished paving (E01C23/14 takes precedence; inserting or forming in not-yet hardened paving E01C23/02, in recesses formed in fully-set paving E01C23/09; marking-out playing courts or playgrounds A63C19/06; applying liquids or other fluent materials to surfaces in general B05; road surface markings per se E01F9/50); Protecting fresh markings
- E01F 9/30: Arrangements interacting with transmitters or receivers otherwise than by visible means, e.g. using radar reflectors or radio transmitters (E01F11/00 takes precedence)
- E01F 9/506: characterised by the road surface marking material, e.g. comprising additives for improving friction or reflectivity; Methods of forming, installing or applying markings in, on or to road surfaces
- G06T 7/11: Region-based segmentation
- G06V 10/143: Sensing or illuminating at different wavelengths
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N 23/11: for generating image signals from visible and infrared light wavelengths
- H04N 23/20: for generating image signals from infrared radiation only
- G06T 2207/30256: Lane; Road marking
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- E01C: CONSTRUCTION OF, OR SURFACES FOR, ROADS, SPORTS GROUNDS, OR THE LIKE; MACHINES OR AUXILIARY TOOLS FOR CONSTRUCTION OR REPAIR (forming roads or like surfaces by compacting or grading snow or ice E01H)
- E01F: ADDITIONAL WORK, SUCH AS EQUIPPING ROADS OR THE CONSTRUCTION OF PLATFORMS, HELICOPTER LANDING STAGES, SIGNS, SNOW FENCES, OR THE LIKE
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed herein are methods and systems for detecting dynamic objects using road painted patterns perceptible in infrared spectral range, comprising receiving images captured in one or more infrared spectral ranges depicting a road segment painted with background patterns which are highly imperceptible in visible light spectrum while highly visible in one or more infrared spectral ranges, analyzing the images to detecting one or more dynamic objects located in front of the background patterns. The light reflected by the one or more dynamic objects in the one or more infrared spectral ranges deviating from the light reflected by the one or more background pattern and computing a location of the one or more identified objects. Further disclosed are methods and systems for calibration of systems and/or sensors based on reference markings which are highly imperceptible in visible light spectrum while highly visible in the infrared spectral range(s).

## Claims

### Claim 1

A method of detecting dynamic objects using road painted patterns perceptible in infrared spectral range, comprising:
using at least one processor for:
receiving at least one infrared image depicting, in at least one infrared spectral range, at least one surface of at least one road segment painted with at least one background pattern using at least one paint material characterized by: (1) reflecting light in visible light spectral range deviating less than a first value from the light reflected by the at least one surface, and (2) reflecting light in the at least one infrared spectral range deviating more than a second value from the light reflected by the at least one surface;
analyzing the at least one infrared image to detecting at least one dynamic object located in front of the at least one background pattern, the light reflected by the at least one dynamic object in the infrared spectral range deviating from the light reflected by the at least one background pattern; and
computing a location of the at least one identified object.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least one dynamic object is a member of a group consisting of: a vehicle and a pedestrian.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first value equals 20% and the second value equals 25%.

### Claim 4 (depends on 1)

The method of claim 1, wherein the at least one infrared spectral range is a member of a group consisting of: near infrared (NIR) having a wavelength in a range of 750-1400 nanometer, and short wave infrared (SWIR) having a wavelength in a range of 1400-3000 nanometer.

### Claim 5 (depends on 1)

The method of claim 1, further comprising a plurality of background patterns are painted on the at least one surface suing a plurality of paint material such as the at least one paint material which are further characterized by reflecting light in the at least one infrared spectral range deviating from each other by more than a third value, the third value equals 25%.

### Claim 6 (depends on 1)

The method of claim 1, further comprising the second value of the at least one paint material characterizes the at least one paint material to transfer more than a fourth value of light in the infrared spectral range thus exposing the at least one background pattern painted beneath the at least one paint material, the fourth value equals 85%.

### Claim 7 (depends on 1)

The method of claim 1, further comprising analyzing the at least one image to compute at least one attribute of the at least one identified object, the at least one attribute is a member of a group consisting of: a size, a length, a width, a height, a speed, an acceleration and a movement direction.

### Claim 8 (depends on 1)

The method of claim 1, wherein the at least one surface on which the at least one background pattern is painted comprises at least one member of a group consisting of: a road surface, a sidewalk surface and a transportation infrastructure object surface.

### Claim 9 (depends on 1)

The method of claim 1, wherein the at least one background pattern is applied over the at least one surface which is already painted with at least one paint material perceptible in the visible light range.

### Claim 10 (depends on 1)

The method of claim 1, wherein the at least one background pattern is painted according to instructions computed automatically based on at least one image of the at least one road segment.

### Claim 11

A method of calibrating imaging sensors deployed to monitor roads traffic according to infrared visible reference markings, comprising:
using at least one processor for:
receiving at least one at least one infrared image captured by at least one imaging sensor depicting, in at least one infrared spectral range, at least one surface of at least one road segment painted with at least one reference markings using at least one paint material characterized by: (1) reflecting light in visible light spectral range deviating less than a first value from the light reflected by the at least one surface, and (2) reflecting light in at least one infrared spectral range deviating more than a second value from the light reflected by the at least one surface;
analyzing the at least one infrared image to determine a position of the at least one reference markings; and
calibrating the at least one imaging sensor according to the computed position of the at least one reference markings.

### Claim 12 (depends on 11)

The method of claim 11, wherein the at least one reference markings further comprising an identifier of the at least one road segment.

### Claim 13 (depends on 11)

The method of claim 11, wherein the first value equals 20% and the second value equals 25%.

### Claim 14 (depends on 11)

The method of claim 11, wherein the at least one infrared spectral range is a member of a group consisting of near infrared (NIR) having a wavelength in a range of 750-1400 nanometer, and short wave infrared (SWIR) having a wavelength in a range of 1400-3000 nanometer.

### Claim 15 (depends on 11)

The method of claim 11, further comprising the second value of the at least one paint material characterizes the at least one paint material to transfer more than a fourth value of light in the infrared spectral range thus exposing the at least one reference markings painted beneath the at least one paint material, the fourth value equals 85%.

### Claim 16 (depends on 11)

The method of claim 11, wherein the surface on which the at least one reference markings are painted comprises at least one member of a group consisting of: a road surface, a sidewalk surface and a transportation infrastructure object surface.

### Claim 17 (depends on 11)

The method of claim 11, wherein the at least one reference markings are applied over the at least one surface which is already painted with at least one paint material perceptible in the visible light range.

### Claim 18 (depends on 11)

The method of claim 11, wherein the at least one reference markings is painted according to instructions computed automatically based on at least one image of the at least one road segment.
