# US 2025/0095190 A1 · Method, computing device, and recording medium for detecting object in real time based on lidar point cloud

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095190 A1
- Document ID: US20250095190A1
- Status: Published application
- Kind: A1
- Application number: 18/886,288
- Filed: 2024-09-16
- Published: 2025-03-20
- Earliest claimed: 2023-09-20
- Assignees: RideFlux Inc.
- Applicants: RideFlux Inc.
- Inventors: Hawook JEONG; Sangwon JEONG; Beomjun PARK
- Web page: https://patentgrep.com/patent/US20250095190A1

## CPC

- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G01S 17/89: for mapping or imaging
- G01S 17/931: of land vehicles
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/771: Feature selection, e.g. selecting representative features from a multi-dimensional feature space
- G06V 10/806: {of extracted features}
- G06V 10/82: using neural networks
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06V 2201/07: Target detection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Provided are a method, computing device, and recording medium for detecting an object in real time on the basis of a lidar point cloud. The method is performed by the computing device and includes generating a feature map on the basis of a point cloud which is generated by scanning a certain region through a lidar sensor and deriving an object detection result by inputting the generated feature map to a pretrained object detection model.

## Claims

### Claim 1

A method of detecting an object in real time on the basis of a lidar point cloud, which is performed by a computing device, the method comprising:
generating a feature map on the basis of a point cloud which is generated by scanning a certain region through a lidar sensor; and
deriving an object detection result by inputting the generated feature map to a pretrained object detection model.

### Claim 2 (depends on 1)

The method of claim 1, wherein the generating of the feature map comprises:
generating a first feature map by processing the point cloud on the basis of deep learning;
generating a second feature map by processing the point cloud on the basis of rules; and
generating an input feature map of the pretrained object detection model by combining the generated first feature map and the generated second feature map.

### Claim 3 (depends on 2)

The method of claim 2, wherein the generating of the first feature map comprises:
generating a range image by converting three-dimensional (3D) points included in the point cloud into two-dimensional (2D) points on a YZ plane on the basis of a range of the lidar sensor or a vehicle in which the lidar sensor is installed;
extracting feature information by analyzing the generated range image on the basis of a deep-learning-based feature extraction module and generating a range feature map using the extracted feature information; and
generating a first feature map in a form of a bird's eye view (BEV) by projecting the generated range feature map on an XY plane.

### Claim 4 (depends on 3)

The method of claim 3, wherein the generating of the first feature map in the form of a BEV comprises:
generating a plurality of lattices by latticing a region having a preset range on the XY plane; and
recording feature information of points included in the generated range feature map in each of the plurality of lattices.

### Claim 5 (depends on 4)

The method of claim 4, wherein the recording of the feature information of the points in each of the plurality of lattices comprises:
generating a plurality of unit lattices for each of the plurality of generated lattices by dividing the lattice to a certain size; and
recording feature information of points, which are included in the generated range feature map and correspond to a specific one of the plurality of lattices, in each of the plurality of unit lattices generated by dividing the specific lattice.

### Claim 6 (depends on 5)

The method of claim 5, wherein the recording of the feature information in each of the plurality of unit lattices generated by dividing the specific lattice comprises recording only feature information of one point corresponding to the plurality of unit lattices generated by dividing the specific lattice and, when two or more points correspond to a specific unit lattice, recording only feature information of any one of the two or more points in the specific unit lattice.

### Claim 7 (depends on 3)

The method of claim 3, wherein the generating of the range image comprises determining a size of a range image to be generated on the basis of an attribute of the lidar sensor which includes at least one of the number of channels and laser radiation intervals.

### Claim 8 (depends on 3)

The method of claim 3, wherein the generating of the range image comprises:
generating a range image in the form of a 2D tensor by converting the 3D points included in the point cloud into 2D points on the YZ plane;
generating range images in the form of a plurality of 2D tensors by recording a plurality of pieces of information about each of the 3D points in each of range images having different forms of 2D tensors in accordance with kinds of information; and
generating a range image in the form of one 3D tensor by combining the range images generated in the form of the plurality of 2D tensors,
the generating of the range feature map comprises generating a range feature map in the form of one 3D tensor using the generated range image having the form of one 3D tensor, and
the generating of the first feature map comprises generating a first feature map in the form of a 3D tensor using the generated range feature map having the form of one 3D tensor.

### Claim 9 (depends on 2)

The method of claim 2, wherein the generating of the second feature map comprises:
generating a bird's eye view (BEV) image by projecting the point cloud or a range image generated on the basis of the point cloud on an XY plane; and
extracting feature information by analyzing the generated BEV image on the basis of a rule-based feature extraction module and generating a second feature map in the form of a BEV using the extracted feature information.

### Claim 10 (depends on 9)

The device of claim 9, wherein the generating of the BEV image comprises:
generating a plurality of lattices by latticing a region having a preset size on the XY plane; and
recording feature information of points included in the point cloud or the range image generated on the basis of the point cloud in each of the plurality of generated lattices.

### Claim 11 (depends on 1)

The device of claim 1, wherein the generating of the feature map comprises:
generating a range image by converting three-dimensional (3D) points included in the point cloud into two-dimensional (2D) points on a YZ plane on the basis of a range of the lidar sensor or a vehicle in which the lidar sensor is installed;
extracting first feature information by analyzing the generated range image on the basis of a deep-learning-based feature extraction module and generating a range feature map using the extracted first feature information;
combining the point cloud or the generated range image with the generated range feature map and then projecting the combination on an XY plane to generate a first BEV feature map; and
extracting second feature information by analyzing the generated first BEV feature map through a rule-based feature extraction module and generating a second BEV feature map as an input feature map of the pretrained object detection model using the extracted second feature information.

### Claim 12 (depends on 1)

The device of claim 1, wherein the pretrained object detection model includes a deep-learning-based image analysis model, and
the deriving of the object detection result comprises:
determining one of a plurality of predefined classes to which an object belongs by analyzing the generated feature map through the deep-learning-based image analysis model and deriving an object detection result including information about the determined class and information about the object,
wherein, when the object is a pedestrian, the information about the object includes location information of the pedestrian, and
when the object is a vehicle, the information about the object includes information about a location of the vehicle and a distance from the vehicle.

### Claim 13

A computing device for performing a method of detecting an object in real time on the basis of a lidar point cloud, the computing device comprising:
a processor;
a network interface;
a memory; and
a computer program loaded to the memory and executed by the processor,
wherein the computer program comprises:
an instruction of generating a feature map on the basis of a point cloud which is generated by scanning a certain region through a lidar sensor; and
an instruction of deriving an object detection result by inputting the generated feature map to a pretrained object detection model.

### Claim 14

A recording medium in which a computer program for causing a computing device to perform a method of detecting an object in real time on the basis of a lidar point cloud is stored, wherein the method comprising:
generating a feature map on the basis of a point cloud which is generated by scanning a certain region through a lidar sensor; and
deriving an object detection result by inputting the generated feature map to a pretrained object detection model.
