# US 11,994,579 B2 · Hybrid radar and camera edge sensors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,994,579 B2
- Document ID: US11994579B2
- Status: Granted
- Kind: B2
- Application number: 17/001,541
- Filed: 2020-08-24
- Published: 2021-02-25
- Granted: 2024-05-28
- Earliest claimed: 2019-08-22
- Assignees: Bdcm A2 LLC
- Applicants: Bdcm A2 LLC
- Inventors: Maha Achour; Matthew Paul Harrison
- Web page: https://patentgrep.com/patent/US11994579B2

## CPC

- G01S 13/867: {Combination of radar systems with cameras}
- G01S 13/06: Systems determining position data of a target
- G01S 13/931: of land vehicles
- G01S 7/4026: {Antenna boresight}
- G01S 2013/93271: {in the front of the vehicles}
- G01S 2013/93272: {in the back of the vehicles}
- G01S 2013/93274: {on the side of the vehicles}
- G06N 5/047: Pattern matching networks; Rete networks
- G06N 20/00: Machine learning
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems, methods, and apparatus for hybrid radar and camera edge sensors are disclosed. Examples disclosed herein relate to a hybrid sensor system having a plurality of edge sensors positioned on the perimeter of a vehicle. The hybrid sensor system processes signals received from the various sensors to identify a target located within the vicinity of the vehicle.

## Claims

### Claim 1

A radar system, comprising:
a first sensor module;
a second sensor module;
a memory storage unit; and
at least one processing unit adapted to perform the operations of:
receiving a first set of data from the first sensor module;
receiving a second set of data from the second sensor module;
analyzing the first set of data;
analyzing the second set of data;
digitizing the first and second sets of data;
performing object recognition on the first and second sets of data;
combining the analyzed first and second sets of data; and
identifying at least one target based on the combined analyzed sets of data.

### Claim 2 (depends on 1)

The radar system of claim 1, wherein the first sensor module and the second sensor module are positioned on a perimeter of a vehicle, and the first set of data identifies road markings.

### Claim 3 (depends on 2)

The radar system of claim 2, wherein the vehicle is one of a terrestrial vehicle, a marine vehicle, or an airborne vehicle.

### Claim 4 (depends on 2)

The radar system of claim 2, wherein the vehicle is an autonomous vehicle.

### Claim 5 (depends on 1)

The radar system of claim 1, wherein the operations further comprise identifying specific types of information from the first sensor module and the second sensor module.

### Claim 6 (depends on 1)

The radar system of claim 1, wherein the operations further comprise processing data from output of the first sensor module and data from output of the second sensor module and performing data fusion for edge sensor data.

### Claim 7 (depends on 1)

The radar system of claim 1, wherein the operations further comprise outputting the combined analyzed sets of data in a point cloud format.

### Claim 8 (depends on 1)

The radar system of claim 1, wherein the first sensor module is a camera module, and the second sensor module is a radar module.

### Claim 9 (depends on 8)

The radar system of claim 8, wherein the operations further comprise:
digitizing camera data from the camera module and generating digitized data based on the digitized camera data; and
interpreting radar data from the radar module and generating a Range-Doppler map based on the interpreted radar data.

### Claim 10 (depends on 8)

The radar system of claim 8, wherein the radar module comprises a meta-structure array of antenna elements.

### Claim 11

A method for environmental perception of a vehicle, comprising:
generating first sensor data;
generating second sensor data;
processing the first sensor data;
generating a first classification output based on the processing of the first sensor data;
processing the second sensor data;
digitizing the first and second sensor data;
generating a second classification output based on the processing of the second sensor data;
combining and interpreting the first classification output and the second classification output; and
identifying at least one target based on the combined first and second classification outputs.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
sensing first sensor information, wherein the generating of the first sensor data comprises processing the first sensor information; and
sensing second sensor information, wherein the generating of the second sensor data comprises processing the second sensor information.

### Claim 13 (depends on 12)

The method of claim 12, wherein the generating of the first sensor data further comprises filtering out spurious data from the first sensor information, and the generating of the second sensor data further comprises filtering out spurious data from the second sensor information.

### Claim 14 (depends on 12)

The method of claim 12, wherein the sensing of the first sensor information is performed by a camera sensor, and wherein the method further comprises controlling the camera sensor to at least one of focusing light or steering the light.

### Claim 15 (depends on 12)

The method of claim 12, wherein the sensing of the second sensor information is performed by a radar sensor, and wherein the method further comprises controlling the radar sensor to at least one of steering a beam or adjusting a beamwidth of the beam.

### Claim 16 (depends on 11)

The method of claim 11, wherein the processing of the first sensor data and the second sensor data comprises at least one of digital processing or analog processing.

### Claim 17 (depends on 11)

The method of claim 11, further comprisingi
outputting identification information related to the at least one target.

### Claim 18 (depends on 17)

The method of claim 17, wherein the identification information comprises at least one of an identity, a velocity, or a location of the at least one target.

### Claim 19 (depends on 17)

The method of claim 17, wherein the identification information is in a point cloud format.

### Claim 20

A method for environmental perception of a first vehicle, comprising:
generating, by a first sensor module on a second vehicle, sensor data;
transmitting, by the first sensor module on the second vehicle, the sensor data to a second sensor module on the first vehicle;
receiving, by the second sensor module on the first vehicle, the sensor data; and
identifying at least one target by using the sensor data, wherein the at least one target is a road marking for navigation.
