# US 2019/0317217 A1 · Classifying objects with additional measurements

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317217 A1
- Document ID: US20190317217A1
- Status: Published application
- Kind: A1
- Application number: 16/456,426
- Filed: 2019-06-28
- Published: 2019-10-17
- Earliest claimed: 2011-02-10
- Assignees: Innoviz Technologies Ltd.
- Applicants: Innoviz Technologies Ltd.
- Inventors: Amir DAY; Guy ZOHAR; Julian VLAIKO; Nir OSIROFF; Ovadya MENADEVA
- Web page: https://patentgrep.com/patent/US20190317217A1

## CPC

- G01S 7/026: {involving the transmission of elliptically or circularly polarised waves}
- A01C 5/04: Machines for making or covering holes for sowing or planting
- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 7/4815: {using multiple transmitters}
- G01S 7/4816: {of receivers alone}
- G01S 7/4817: {relating to scanning}
- G01S 7/484: Transmitters
- G01S 7/4873: {by deriving and controlling a threshold value}
- G01S 17/04: Systems determining the presence of a target
- G01S 17/58: Velocity or trajectory determination systems; Sense-of-movement determination systems
- G01S 17/89: for mapping or imaging
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G01S 17/931: of land vehicles
- G06F 18/24: Classification techniques
- G06F 18/256: {of results relating to different input data, e.g. multimodal recognition}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/141: Control of illumination
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 10/82: using neural networks
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60W 2420/403: Image sensing, e.g. optical camera
- G06F 18/2414: {Smoothing the distance, e.g. radial basis function networks [RBFN]}
- G06T 2207/30256: Lane; Road marking
- G06V 20/625: {License plates}
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- A01C: PLANTING; SOWING; FERTILISING (parts, details or accessories of agricultural machines or implements, in general A01B51/00 - A01B75/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

A vehicle-assistance system for classifying objects in a vehicle's surroundings is provided. The system may include at least one memory configured to store classification information for classifying a plurality of objects and at least one processor configured to receive, on a pixel-by-pixel basis, a plurality of measurements associated with LIDAR detection results. The measurements may include at least one of: a presence indication, a surface angle, object surface physical composition, and a reflectivity level. The at least one processor may also be configured to receive, on the pixel-by-pixel basis, at least one confidence level associated with each received measurement, and access the classification information. The at least one processor may further be configured to, based on the classification information and the received measurements with the at least one associated confidence level plurality, identify a of pixels as being associated with a particular object.

## Claims

### Claim at position 1

1-51. (canceled)

### Claim 52

A vehicle-assistance system for classifying objects in a vehicle's surroundings, the system comprising:
at least one memory configured to store classification information for classifying a plurality of objects;
at least one processor configured to:
receive, on a pixel-by-pixel basis, a plurality of measurements associated with LIDAR detection results, the measurements including at least one of: a presence indication, a surface angle, object surface physical composition, and a reflectivity level;
receive, on the pixel-by-pixel basis, at least one confidence level associated with each received measurement;
access the classification information; and
based on the classification information and the received measurements with the at least one associated confidence level plurality, identify a plurality of pixels as being associated with a particular object.

### Claim 53 (depends on 52)

The vehicle-assistance system of claim 52, wherein the at least one processor is further configured to:
receive a plurality of measurements including a plurality of presence indications from multiple portions of the particular object;
determine, using the plurality of presence indications and at least one confidence level associated with the plurality of presence indications, a shape of the object; and
classify the particular object based at least in part on the shape of the particular object.

### Claim 54 (depends on 52)

The vehicle-assistance system of claim 52, wherein the at least one processor is further configured to:
receive a plurality of measurements including a plurality of surface angles from multiple portions of the particular object;
determine, using the plurality of surface angles and at least one confidence level associated with the plurality of surface angles, a spatial relationship between the multiple portions of the particular object; and
classify the particular object based at least in part on the determined spatial relationship.

### Claim 55 (depends on 52)

The vehicle-assistance system of claim 52, wherein the at least one processor is further configured to:
receive a plurality of measurements including a plurality of reflectivity levels from multiple portions of the particular object;
determine, using the differing reflectivity levels, a reflectivity relationship between the multiple portions of the particular object; and
classify the particular object based at least in part on the determined reflectivity relationship.

### Claim 56 (depends on 52)

The vehicle-assistance system of claim 52, wherein the at least one processor is further configured to:
obtain an additional measurement associated with a velocity of the particular object; and
classify the particular object based at least in part on the obtained measurement associated with a velocity of the particular object.

### Claim 57 (depends on 52)

The vehicle-assistance system of claim 52, wherein the at least one processor is further configured to:
obtain an additional measurement of ambient light and at least one confidence level associated with the ambient light associated with the particular object; and
classify the particular object based at least in part on the obtained measurement of ambient light associated with the particular object.

### Claim 58 (depends on 52)

The vehicle-assistance system of claim 52, wherein the at least one processor is further configured to detect a change of at least one of a presence indication, a surface angle, and a reflectivity level in at least one pixel from a prior scanning value, and classify the particular object based at least in part on the detected change.

### Claim 59 (depends on 52)

The vehicle-assistance system of claim 52, wherein the at least one processor is further configured to:
receive a plurality of measurements including at least one presence indication, at least one surface angle, and at least one reflectivity level from multiple portions of the particular object; and
classify the particular object based on the plurality of measurements.

### Claim 60 (depends on 52)

The vehicle-assistance system of claim 52, wherein the at least one processor is further configured determine a type of the particular object as at least one of: a vehicle, a car, a truck, a bus, a pedestrian, a building obstacle, a cyclist, a motorcycle, a traffic sign, a building, a tunnel, a bridge, a tree, an animal, and a hill.

### Claim 61 (depends on 60)

The vehicle-assistance system of claim 60, wherein the at least one processor is further configured to cause a change in an operational state of the vehicle based on a relative location and the determined type of the classified particular object.

### Claim 62 (depends on 60)

The vehicle-assistance system of claim 60, wherein the at least one processor is further configured to cause a change of an operational parameter of a light source associated with the LIDAR based on the determined type of the particular object.

### Claim 63 (depends on 60)

The vehicle-assistance system of claim 60, wherein the at least one processor is further configured to cause a change of an operational parameter of a sensor associated with the LIDAR based on the determined type of the particular object.

### Claim 64

A vehicle-assistance system for identifying objects in a vehicle's surroundings, the system comprising:
at least one processor configured to:
receive point-cloud information originating from a LIDAR configured to project light toward the vehicle's surroundings, wherein the point-cloud information is associated with a plurality of data points and each data point includes indications of a three-dimensional location and angular information with respect to a reference plane;
construct, from the received point cloud information, a point cloud map of the vehicle's surroundings, wherein the point cloud map is indicative of a shape of a particular object in the vehicle's surroundings and of angular orientations of at least two surfaces of the particular object;
access object-related classification information; and
identify the particular object based on the information from the point cloud map and the object-related classification information.

### Claim 65 (depends on 64)

The vehicle-assistance system of claim 64, wherein identifying the particular object includes classifying a plurality of pixels as being associated with the particular object.

### Claim 66 (depends on 64)

The vehicle-assistance system of claim 64, wherein identifying the particular object includes determining a type of the particular object.

### Claim 67 (depends on 64)

The vehicle-assistance system of claim 64, wherein the point cloud map is further indicative of a reflectivity level of different portions of the particular object.

### Claim 68 (depends on 64)

The vehicle-assistance system of claim 64, wherein each data point in the point cloud map includes measurements of at least two of: a presence indication, a surface angle, a reflectivity level, velocity, and ambient light.

### Claim 69 (depends on 68)

The vehicle-assistance system of claim 68, wherein the received point cloud information further includes confidence level for each of the measurements.

### Claim 70 (depends on 64)

The vehicle-assistance system of claim 64, wherein the at least one processor is further configured to determine a match by identifying a most likely three-dimensional representation in the classification information that corresponds to the information in the point cloud map.

### Claim 71 (depends on 64)

The vehicle-assistance system of claim 64, wherein when a certainty level is under a threshold, the at least one processor is further configured to request additional information from the LIDAR.

### Claim 72 (depends on 64)

The vehicle-assistance system of claim 64, wherein the at least one processor is further configured to determine that the identified particular object is an object of interest and to forward the LIDAR an indication of a region of interest that includes the identified particular object.

### Claim 73

A method for using LIDAR system to classify objects in a field of view, the method comprising:
receiving, on a pixel-by-pixel basis, measurements associated with LIDAR detection results, the measurements including at least one of a presence indication, a surface angle, and a reflectivity level;
receiving, on the pixel-by-pixel basis, a confidence level associated with each received measurement;
accessing classification information for classifying the objects; and
based on the classification information and the received measurements with the associated confidence level, classifying a plurality of pixels as being associated with a particular object.

### Claim 74

A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method for identifying objects in a vehicle's surroundings, the method comprising:
receiving point-cloud information originating from a LIDAR configured to project light toward the vehicle's surroundings, wherein the point-cloud information is associated with a plurality of data points and each data point includes indications of a three-dimensional location and angular information with respect to a reference plane;
constructing, from the received point cloud information, a point cloud map of the vehicle's surroundings, wherein the point cloud map is indicative of a shape of a particular object in the vehicle's surroundings and of angular orientations of at least two surfaces of the particular object;
accessing object-related classification information; and
identifying the particular object based on the information from the point cloud map and the object-related classification information.

### Claim at position 25

75-81. (canceled)
