# US 2019/0318177 A1 · Detecting Objects Based on Reflectivity Fingerprints

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318177 A1
- Document ID: US20190318177A1
- Status: Published application
- Kind: A1
- Application number: 16/456,942
- Filed: 2019-06-28
- Published: 2019-10-17
- Earliest claimed: 2011-02-10
- Assignees: Innoviz Technologies Ltd.
- Applicants: Innoviz Technologies Ltd.
- Inventors: Amit STEINBERG; David ELOOZ; Omer David KEILAF; Oren BUSKILA; Oren ROSENZWEIG
- Web page: https://patentgrep.com/patent/US20190318177A1

## CPC

- G01S 7/026: {involving the transmission of elliptically or circularly polarised waves}
- A01C 5/04: Machines for making or covering holes for sowing or planting
- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 7/4815: {using multiple transmitters}
- G01S 7/4816: {of receivers alone}
- G01S 7/4817: {relating to scanning}
- G01S 7/484: Transmitters
- G01S 7/4873: {by deriving and controlling a threshold value}
- G01S 17/04: Systems determining the presence of a target
- G01S 17/58: Velocity or trajectory determination systems; Sense-of-movement determination systems
- G01S 17/89: for mapping or imaging
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G01S 17/931: of land vehicles
- G06F 18/24: Classification techniques
- G06F 18/256: {of results relating to different input data, e.g. multimodal recognition}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/141: Control of illumination
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 10/82: using neural networks
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60W 2420/403: Image sensing, e.g. optical camera
- G06F 18/2414: {Smoothing the distance, e.g. radial basis function networks [RBFN]}
- G06T 2207/30256: Lane; Road marking
- G06V 20/625: {License plates}
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- A01C: PLANTING; SOWING; FERTILISING (parts, details or accessories of agricultural machines or implements, in general A01B51/00 - A01B75/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

A LIDAR system for detecting a vehicle may include a processor configured to: scan a field of view (FOV) by controlling movement of at least one deflector at which at least one light source is directed; receive from at least one sensor signals indicative of light reflected from a particular object in the FOV; detect, based on time of flight in the received signals, portions of the particular object in the FOV that are similarly spaced from the light source; determine, based on the detected portions, at least a first portion having a first reflectivity corresponding to a license plate, and at least two additional spaced-apart portions corresponding to locations on the particular object other than a location of the first portion; and based on a spatial relationship and a reflectivity relationship between the first portion and the at least two additional portions, classify the particular object as a vehicle.

## Claims

### Claim 1

A LIDAR system for detecting a vehicle based on license plate reflectivity, the system comprising:
at least one processor configured to:
scan a field of view by controlling movement of at least one deflector at which at least one light source is directed;
receive from at least one sensor signals indicative of light reflected from a particular object in the field of view;
detect, based on time of flight in the received signals, portions of the particular object in the field of view that are similarly spaced from the light source;
determine, based on the detected portions, at least a first portion having a first reflectivity corresponding to a license plate, and at least two additional spaced-apart portions corresponding to locations on the particular object other than a location of the first portion, and wherein the at least two additional portions have reflectivity substantially lower than the first reflectivity; and
based on a spatial relationship and a reflectivity relationship between the first portion and the at least two additional portions, classify the particular object as a vehicle.

### Claim 2 (depends on 1)

The LIDAR system of claim 1, wherein the at least one processor is further configured to control the at least one light source in a manner enabling light flux of light projected from the at least one light source to vary during scanning of the field of view.

### Claim 3 (depends on 2)

The LIDAR system of claim 2, wherein the at least one processor is further configured to control the at least one light source in a manner enabling modulating the projected light and distinguishing between light reflected from objects in the field of view and light emitted by objects in the field of view.

### Claim 4 (depends on 1)

The LIDAR system of claim 1, wherein the at least one processor is further configured to determine a distance to the particular object and to classify the particular object based on the determined distance and the spatial relationship between the first portion and the at least two additional portions.

### Claim 5 (depends on 1)

The LIDAR system of claim 1, wherein the at least one processor is further configured to determine an angle of at least one surface associated with the particular object and to classify the particular object further based on the determined angle and the reflectivity relationship between the first portion and the at least two additional portions.

### Claim 6 (depends on 1)

The LIDAR system of claim 1, wherein the at least one processor is further configured to determine confidence levels for the reflectivity of the first portion and for the at least two additional portions and to classify the particular object further based on the determined confidence level and the reflectivity relationship between the first portion and the at least two additional portions.

### Claim 7 (depends on 1)

The LIDAR system of claim 1, wherein the at least one processor is further configured to determine distances of the first portion and the at least two additional portions of the particular object, and to account for determined distances when classifying the particular object.

### Claim 8 (depends on 1)

The LIDAR system of claim 1, wherein upon classifying the particular object as a vehicle, the at least one processor is further configured to direct more light in a subsequent scanning cycle towards the particular object.

### Claim 9 (depends on 1)

The LIDAR system of claim 1, wherein the at least one processor is further configured to classify at least one additional object as being an object other than a vehicle, based on a determined reflectivity fingerprint of the at least one additional object.

### Claim 10 (depends on 1)

The LIDAR system of claim 1, wherein the at least one processor is further configured to:
determine a reflectivity fingerprint of the particular object based on the reflectivity of the detected portions;
access memory that stores a plurality of indicators of fingerprints of various objects;
compare the reflectivity fingerprint of the particular object with the indicators of fingerprints of various objects stored in memory to identify a match; and
determine a type of the vehicle based on the identified match.

### Claim 11

A vehicle, comprising:
a body; and
at least one processor within the body and configured to:
scan a field of view by controlling movement of at least one deflector at which at least one light source is directed;
receive, from at least one sensor, reflections signals indicative of light reflected from a particular object in the field of view;
detect, based on time of flight, portions of the particular object in the field of view that are similarly spaced from the light source;
identify, based on the detected portions, at least a first portion having a first reflectivity, a second portion having a second reflectivity, and a third portion having a third reflectivity, and wherein the at least second and third portions have reflectivity substantially lower than the first reflectivity;
determine a reflectivity fingerprint of the particular object based on a reflectivity relationship between the first portion, the second portion, and the third portion; and
classify the particular object based on the determined reflectivity fingerprint of the particular object.

### Claim 12 (depends on 11)

The vehicle of claim 11, wherein the at least one processor is further configured to classify a plurality of objects within the field of view, and to distinguish between the plurality of objects based on a unique reflectivity fingerprint associated with each of the plurality of objects.

### Claim 13 (depends on 11)

The vehicle of claim 11, wherein the at least one processor is further configured to determine a distance of the particular object and to account for the determined distance when determining the reflectivity fingerprint of the particular object.

### Claim 14 (depends on 11)

The vehicle of claim 11, wherein the at least one processor is further to configured to enable construction of a 3D map of an environment around the vehicle, the 3D map including data representative of a reflectivity of objects in the field of view.

### Claim 15 (depends on 11)

The vehicle of claim 11, wherein the at least one processor is further configured to determine a confidence level for the determined reflectivity fingerprint and to consider the determined confidence when classifying the particular object.

### Claim 16 (depends on 11)

The vehicle of claim 11, wherein the vehicle is at least partially autonomous and the at least one processor is further configured to cause a change in an operation of the vehicle based on a type of the particular object.

### Claim 17 (depends on 11)

The vehicle of claim 11, wherein the at least one processor is further configured to control the at least one light deflector such that during a scanning cycle of the field of view, the at least one light deflector instantaneously assumes a plurality of instantaneous positions.

### Claim 18 (depends on 17)

The vehicle of claim 17, wherein the at least one processor is configured to coordinate the at least one light deflector and the at least one light source such that when the at least one light deflector assumes a particular instantaneous position, a portion of a light beam is deflected by the at least one light deflector from the at least one light source towards an object in the field of view, and reflections of the portion of the light beam from the object are deflected by the at least one light deflector toward at least one sensor.

### Claim 19 (depends on 17)

The vehicle of claim 17, further comprising a plurality of light sources aimed at the at least one light deflector, wherein the at least one processor is further configured to control the at least one light deflector such that when the at least one light deflector assumes a particular instantaneous position, light from the plurality of light sources is projected towards a plurality of independent regions in the field of view.

### Claim 20

A method for using LIDAR to detect a vehicle based on license plate reflectivity, the method comprising:
scanning a field of view by controlling movement of at least one deflector at which at least one light source is directed;
receiving, from at least one sensor, signals indicative of light reflected from a particular object in the field of view;
detecting, based on time of flight in the received signals, portions of the particular object in the field of view that are similarly spaced from the light source;
determining, based on the detected portions, at least a first portion having a first reflectivity corresponding to a license plate, and at least two additional spaced-apart portions corresponding to locations on the particular object other than a location of the first portion, and wherein the at least two additional portions have reflectivity substantially lower than the first reflectivity; and
based on a spatial relationship and a reflectivity relationship between the first portion and the at least two additional portions, classifying the particular object as a vehicle.

### Claim 21

A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method for using LIDAR to detect a vehicle based on license plate reflectivity, the method comprising:
scanning a field of view by controlling movement of at least one deflector at which at least one light source is directed;
receiving, from at least one sensor, signals indicative of light reflected from a particular object in the field of view;
detecting, based on time of flight in the received signals, portions of the particular object in the field of view that are similarly spaced from the light source;
determining, based on the detected portions, at least a first portion having a first reflectivity corresponding to a license plate, and at least two additional spaced-apart portions corresponding to locations on the particular object other than a location of the first portion, and wherein the at least two additional portions have reflectivity substantially lower than the first reflectivity; and
based on a spatial relationship and a reflectivity relationship between the first portion and the at least two additional portions, classifying the particular object as a vehicle.

### Claim at position 22

22-81. (canceled)
