# US 2024/0393434 A1 · Processing of lidar sensor data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0393434 A1
- Document ID: US20240393434A1
- Status: Published application
- Kind: A1
- Application number: 18/701,651
- Filed: 2022-11-02
- Published: 2024-11-28
- Earliest claimed: 2021-11-08
- Assignees: Continental Autonomous Mobility Germany GmbH
- Applicants: Continental Autonomous Mobility Germany GmbH
- Inventors: Olivier DIRAT; Boris LUGEZ
- Web page: https://patentgrep.com/patent/US20240393434A1

## CPC

- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46)
- G01S 17/89: for mapping or imaging
- G01S 17/931: of land vehicles
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES

## Abstract

The disclosure relates to a data processing device for a LiDAR sensor mounted on a vehicle. The data processing device is used to determine whether groups of pixels of a matrix of pixels obtained by the LiDAR sensor correspond to clouds of particles, notably based on a distribution of normal vectors associated with these pixels.

## Claims

### Claim 1

A data processing device (1) for a LIDAR sensor (2) adapted to be mounted on a vehicle (10), the device comprising a computer (3) configured for:
obtaining (110) a matrix of pixels (p) acquired by the LiDAR sensor (2), with each pixel (p) of the matrix being associated with a light intensity (l) and with a position (x, y, z) in a three-dimensional space;
identifying (120) at least one group of neighboring pixels of the matrix of pixels; and,
for at least one identified group of neighboring pixels:
determining (130) a plurality of normal vectors associated with the pixels of the group of neighboring pixels;
identifying (140) whether the group of neighboring pixels fully or partly belongs to a cloud of particles based on a substantially homogeneous distribution of the plurality of normal vectors associated with the pixels of the group of neighboring pixels.

### Claim 2

The device (1) as claimed in the preceding claim, characterized in that the computer (3) is also configured for determining (150), for at least one specific pixel of the group of neighboring pixels identified as fully or partly belonging to a cloud of particles, whether the specific pixel belongs to a solid element other than the cloud of particles.

### Claim 3

The device (1) as claimed in the preceding claim, characterized in that the computer (3) is configured for determining that the specific pixel belongs to a solid element when an intensity associated with the pixel is greater than an intensity threshold associated with a determined solid element.

### Claim 4

The device (1) as claimed in any one of the preceding claims, characterized in that the computer (3) is further configured for determining an average distance of the group of neighboring pixels relative to the LiDAR sensor (2), and in that a group of neighboring pixels is a candidate to be identified as fully or partly belonging to the cloud of particles when an average distance of the pixels of the group of neighboring pixels relative to the LiDAR sensor (2) is less than a predetermined distance threshold.

### Claim 5

The device (1) as claimed in any one of the preceding claims, characterized in that the computer (3) is further configured for determining an average intensity of the group of neighboring pixels and an average distance of the group of neighboring pixels relative to the LiDAR sensor (2),
and in that a group of neighboring pixels is a candidate to be identified as fully or partly belonging to the cloud of particles when an average intensity of the pixels of the group of neighboring pixels is less than a determined intensity threshold, with the intensity threshold being determined based on the average distance of the group of pixels.

### Claim 6

The device (1) as claimed in any one of the preceding claims, characterized in that the computer is further configured for determining an azimuth angle for each of the pixels of the group of neighboring pixels, and in that a group of neighboring pixels is a candidate to be identified as fully or partly belonging to the cloud of particles when a distribution of the azimuth angle of the pixels of the group of neighboring pixels substantially corresponds to a predetermined model.

### Claim 7

The device (1) as claimed in any one of the preceding claims, characterized in that the computer (3) is configured for identifying a group of neighboring pixels as corresponding to a plurality of pixels for which each pixel is at a distance below a predetermined neighboring threshold from another pixel of the group of pixels.

### Claim 8

A vehicle (10), characterized in that it is fitted with a data processing device (1) as claimed in any one of the preceding claims, in that a LIDAR sensor (2) is mounted at the rear of the vehicle, and in that the computer (3) of the data processing device (1) is configured for identifying a cloud of particles comprising exhaust gas particles.

### Claim 9

A method for processing data from a LIDAR sensor (2) mounted on a vehicle (10), characterized in that it comprises:
obtaining (110) a matrix of pixels (p) acquired by the LiDAR sensor (2), with each pixel (p) of the matrix being associated with a light intensity (l) and with a position (x, y, z) in a three-dimensional space;
identifying (120) at least one group of neighboring pixels of the matrix of pixels; and,
for at least one identified group of neighboring pixels:
determining (130) a plurality of normal vectors associated with the pixels of the group of neighboring pixels;
identifying (140) whether the group of neighboring pixels fully or partly belongs to a cloud of particles based on a substantially homogeneous distribution of the plurality of normal vectors associated with the pixels of the group of neighboring pixels.

### Claim 10

The method as claimed in the preceding claim, characterized in that it further comprises determining (150), for at least one specific pixel of the group of neighboring pixels identified as fully or partly belonging to a cloud of particles, whether the specific pixel belongs to a solid element other than the cloud of particles.

### Claim 11

A computer program product comprising instructions for implementing any one of the above method claims when it is implemented by a computer.

### Claim 12

A non-transient computer-readable storage medium storing code instructions for implementing a method as claimed in any one of the above method claims.
