# US 2025/0148800 A1 · Method and apparatus with multi-feature object detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148800 A1
- Document ID: US20250148800A1
- Status: Published application
- Kind: A1
- Application number: 18/636,331
- Filed: 2024-04-16
- Published: 2025-05-08
- Earliest claimed: 2023-11-03
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Solae LEE; Park SEUNGIN; Hyeongseok SON; Byung In YOO; Minki JEONG
- Web page: https://patentgrep.com/patent/US20250148800A1

## CPC

- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/89: for mapping or imaging
- G01S 17/931: of land vehicles
- G06F 18/256: {of results relating to different input data, e.g. multimodal recognition}
- G06V 10/40: Extraction of image or video features
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/806: {of extracted features}
- G06V 10/811: {the classifiers operating on different input data, e.g. multi-modal recognition}
- G06V 10/82: using neural networks
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An object detection method and an object detection apparatus for detecting an object based on multi-features are provided. The object detection method includes: obtaining first-sensor data from a first sensor and obtaining second-sensor data from a second sensor, wherein the first sensor is a different type of sensor than the second sensor; extracting a first feature from the first-sensor data and extracting a second feature from the second-sensor data; determining a target feature-type by inputting the first and second features to a feature-type selection model which, based thereon, predicts the target feature-type; determining a target feature to be used for object detection according to the determined target feature-type; and determining an object detection result based on the determined target feature.

## Claims

### Claim 1

An object detection method comprising:
obtaining first-sensor data from a first sensor and obtaining second-sensor data from a second sensor, wherein the first sensor is a different type of sensor than the second sensor;
extracting a first feature from the first-sensor data and extracting a second feature from the second-sensor data;
determining a target feature-type by inputting the first and second features to a feature-type selection model which, based thereon, predicts the target feature-type;
determining a target feature to be used for object detection according to the determined target feature-type; and
determining an object detection result based on the determined target feature.

### Claim 2 (depends on 1)

The object detection method of claim 1, wherein
the first sensor is an image capturing device configured to output image data as the first-sensor data, and
the second sensor is a light detection and ranging (LiDAR) or RADAR sensor configured to output point cloud data as the second-sensor data.

### Claim 3 (depends on 1)

The object detection method of claim 1, wherein the feature-type selection model is configured to,
based on the first feature that is input to the feature-type selection model and the second feature that is input to the feature-type selection model,
output selection data controlling selection of:
object detection using the first feature and not the second feature,
object detection using the second feature and not the first feature, and
object detection using the first feature with the second feature.

### Claim 4 (depends on 1)

The object detection method of claim 1, wherein the feature-type selection model is configured to,
based on the first feature that is input to the feature-type selection model and the second feature that is input to the feature-type selection model,
output probability values of a first and second feature-type, respectively, the first feature-type corresponding to performing object detection using the first feature and not the second feature, and the second feature-type corresponding to performing object detection using the second feature and not the first feature.

### Claim 5 (depends on 4)

The object detection method of claim 4, further comprising selecting, as the target feature-type, from among the first and second feature-types, whichever has the greatest among the probability values.

### Claim 6 (depends on 4)

The object detection method of claim 4, wherein the determining the object detection result comprises:
selecting, from among a first candidate object detection result determined based on the first feature and not the second feature, and a second candidate object detection result determined based on the second feature and not the first feature.

### Claim 7 (depends on 1)

The object detection method of claim 1, further comprising:
based on the determining of the target feature-type:
generating a third feature by synthesizing or combining the first feature with the second feature as the target feature.

### Claim 8 (depends on 1)

The object detection method of claim 1, wherein the object detection result from the object detection model is obtained by inputting the determined target feature to an object detection model based on the object detection model corresponding to the target feature-type.

### Claim 9 (depends on 1)

The object detection method of claim 1, wherein the determining the object result based on the determined target feature comprises:
selecting, as the object detection result, between (i) a first object detection result inferred by a first object detection model from the first feature but not from the second feature and (ii) a second object detection result inferred by a second object detection model from the second feature but not from the first feature.

### Claim 10

An object detection apparatus comprising:
one or more processors; and
a memory storing instructions configured to cause the one or more processors to:
obtain first-sensor data from a first sensor and obtain second-sensor data from a second sensor that is a different type of sensor than the first sensor;
extract a first feature from the first-sensor data but not from the second-sensor data, and extract a second feature from the second-sensor data but not from the first-sensor data;
determine a target feature-type through a feature-type selection model having the first feature and the second feature as an input;
determine a target feature to be used for object detection according to the determined target feature-type; and
determine an object detection result based on the determined target feature.

### Claim 11 (depends on 10)

The object detection apparatus of claim 10, wherein
the first sensor is an image capturing device configured to output image data as the first sensor data, and
the second sensor is a light detection and ranging (LiDAR) or RADAR sensor configured to output point cloud data as the second sensor data.

### Claim 12 (depends on 10)

The object detection apparatus of claim 10, wherein the feature-type selection model is configured to,
based on the first feature that is input to the feature-type selection model and the second feature that is input to the feature-type selection model with the first feature,
output selection data controlling selection of:
object detection using the first feature and not the second feature, and
object detection using the second feature and not the first feature.

### Claim 13 (depends on 10)

The object detection apparatus of claim 10, wherein the feature-type selection model is configured to,
based on the first feature that is input to the feature-type selection model and the second feature that is input to the feature-type selection model,
output data indicating probability values of a first and second feature-type, respectively, the first feature-type corresponding to performing object detection using the first feature and not the second feature, and the second feature-type corresponding to performing object detection using the second feature and not the first feature.

### Claim 14 (depends on 13)

The object detection apparatus of claim 13, wherein the instructions are further configured to cause the one or more processors to
select, as the target feature-type, from among the first and second feature-types, whichever has the greatest among the probability values.

### Claim 15 (depends on 13)

The object detection apparatus of claim 13, wherein the instructions are further configured to cause the one or more processors to
select between a first candidate object detection result determined based on the first feature and not the second feature, and a second candidate object detection result determined based on the second feature and not the first feature.

### Claim 16 (depends on 10)

The object detection apparatus of claim 10, wherein the instructions are further configured to cause the one or more processors to,
based on the determining of the target feature-type, generate a third feature by synthesizing or combining the first feature with the second feature as the target feature.

### Claim 17 (depends on 10)

The object detection apparatus of claim 10, wherein the object detection result from the object detection model is obtained by inputting the determined target feature to an object detection model based on the object detection model corresponding to the determined target feature-type.

### Claim 18

A vehicle system comprising:
a first sensor configured to obtain image data capturing an area near a vehicle;
a second sensor configured to radiate electromagnetic energy in the area near the vehicle and obtain point cloud data based on a reflection of the electromagnetic energy from an object in the area; and
one or more processors configured to detect the object based on the image data and the point cloud data by:
extracting a first feature from the image data and extracting a second feature from the point cloud data;
performing a first inference, by a first object detection model, on the first feature but not on the second feature, to generate a first object detection result;
performing a second inference, by a second object detection model, on the second feature but not the first feature, to generate a second object detection result;
input the first feature with the second feature to a selection model, the selection model inferring an output from the first feature and the second feature; and
based on the output, select between the first object detection result and the second object result as an object detection result corresponding to the object.

### Claim 19 (depends on 18)

The vehicle system of claim 18, wherein the output of the selection model comprises a first probability value corresponding to the first object detection model and a second probability value corresponding to the second object detection model, and wherein
whichever of the first and second object detection results' object detection model has the higher probability value is selected as the object detection result.

### Claim 20 (depends on 18)

The vehicle system of claim 18, wherein the one or more processors are further configured to
perform a third inference, by a third object detection model, on a combination or synthesis of the first feature with the second feature, to generate a second object detection result; and
wherein the selecting based on the output comprises selecting between the first, second, and third object detection results.
