# US 12,216,195 B2 · Radar-camera detection system and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,216,195 B2
- Document ID: US12216195B2
- Status: Granted
- Kind: B2
- Application number: 16/736,743
- Filed: 2020-01-07
- Published: 2020-07-09
- Granted: 2025-02-04
- Earliest claimed: 2019-01-07
- Assignees: Ainstein AI, Inc.
- Applicants: Ainstein AI, Inc
- Inventors: Zongbo Wang; Syed Ahmed; David Royer
- Web page: https://patentgrep.com/patent/US12216195B2

## CPC

- G01S 13/867: {Combination of radar systems with cameras}
- G01S 13/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S13/46)
- G01S 13/56: for presence detection {(presence detection using near field arrangements G01V3/00, e.g. G01V3/08, G01V3/12; burglar, theft or intruder alarms with electrical actuation G08B13/22 - G08B13/26)}
- G01S 13/581: {using transmission of interrupted pulse modulated waves and based upon the Doppler effect resulting from movement of targets}
- G01S 13/582: {adapted for simultaneous range and velocity measurements}
- G01S 13/886: {for alarm systems (alarms with electrical actuation G08B13/22)}
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- H04N 23/58: Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- G01S 7/03: Details of HF subsystems specially adapted therefor, e.g. common to transmitter and receiver
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An object detection system for use in residential or commercial buildings includes a housing for retaining a camera, a radar antenna, and an actuator. The camera has a first field of view, and the radar antenna has a second field of view. The actuator is configured to selectively move the camera. The system further includes computer memory and a processor in data communication with the camera, the radar antenna, the actuator, and the computer memory. The processor, using programming contained in the computer memory, causes the camera to move based on camera position data and data from the radar antenna.

## Claims

### Claim 1

A security system for use with a residential or commercial building to detect people, the security system comprising:
a stationary housing;
a camera contained in the housing, the camera having a first field of view inside or outside the building, wherein the first field of view comprises an azimuth field of view and an elevation field of view, wherein the azimuth field of view is greater than the elevation field of view;
a radar module vertically aligned with the camera, the radar module having radar antennas contained in the housing, the radar antennas having a second field of view and arranged in a formation including three radar transmission antennas of the radar antennas and four radar receiving antennas around each of the three radar transmission antennas;
an actuator configured to selectively move the camera;
computer memory; and
a processor in data communication with the camera, the radar antenna, the actuator, and the computer memory;
wherein the processor, using programming contained in the computer memory, causes the actuator to move the camera based on camera position data and data from the radar antenna; and
wherein the processor the processor, using programming contained in the computer memory, a cross validation analysis using object detection events from the camera and the radar antenna that suppresses false positive results detected in the object detection events.

### Claim 2 (depends on 1)

The system of claim 1, wherein the second field of view is larger than the first field of view.

### Claim 3 (depends on 1)

The system of claim 1, wherein the processor, using programming contained in the computer memory, validates the data from the radar antennas with data from the camera and outputs validated detection results.

### Claim 4 (depends on 1)

The system of claim 1, wherein the processor, using programming contained in the computer memory, further initiates doppler processing of the data from the radar antennas.

### Claim 5 (depends on 1)

The system of claim 1, wherein an azimuth field of view of the second field of view is about 160 degrees and an elevation field of view of the second field of view is about 160 degrees.

### Claim 6 (depends on 1)

The system of claim 1, wherein the actuator is a motor configured to adjust the camera based on data from the radar antennas and camera position data.

### Claim 7 (depends on 1)

The system of claim 1, wherein at least a portion of the housing comprises a radome material.

### Claim 8

A method of detecting an object, comprising:
providing an object detecting system, comprising:
a. a camera module comprising a camera having a first field of view, wherein the first field of view comprises an azimuth field of view and an elevation field of view, wherein the azimuth field of view is greater than the elevation field of view;
b. a radar module vertically aligned with the camera within a housing, the radar module comprising at least one receiving antenna and at least one transmitting antenna, and a radar sensor having a second field of view, the at least one receiving antenna and the at least one transmitting antenna arranged in a formation such that the receiving antenna surround the transmitting antenna, the second field of view being greater than the first field of view; and
c. a computing system operatively coupled to the camera module and the radar module;
determining a motion detection based on an image from the camera;
determining a motion detection based on a radar reflection from the radar sensor;
providing, via the computing system, an image object list from the camera module;
providing, via the computing system, a radar object list from the radar module;
comparing the image object list and the radar object list;
performing a cross validation on the image object list and the radar object list that suppresses false positive results detected in the image object list and the radar object list;
providing, via the computing system, a final object list based on the comparison of the image object list and the radar object list and the cross validation; and
outputting a system response based on the final object list.

### Claim 9 (depends on 8)

The method of claim 8, wherein the system response is an alarm.

### Claim 10 (depends on 8)

The method of claim 8, wherein the second field of view comprises an azimuth field of view of about 160 degrees and an elevation field of view of about 160 degrees.

### Claim 11 (depends on 8)

The method of claim 8, wherein the object detecting system further comprises a motor operatively coupled to the camera module and the radar module; and wherein the motor is configured to adjust a position of the camera based on data from the radar module.

### Claim 12

An object detection system for use in residential or commercial buildings, the system comprising:
a. a camera having a first field of view, wherein the first field of view comprises an azimuth field of view and an elevation field of view, wherein the azimuth field of view is greater than the elevation field of view;
a radar module vertically aligned with the camera, the radar module having radar antennas contained in the housing, the radar antennas having a second field of view and arranged in a formation including three radar transmission antennas of the radar antennas and four radar receiving antennas around each of the three radar transmission antennas;
c. computer memory; and
d. a processor in data communication with the camera, the radar module, the actuator, and the computer memory;
e. wherein the processor, using programming contained in the computer memory, causes the actuator to move the camera based on data from the module; and
f. wherein the processor the processor, using programming contained in the computer memory, performs a cross validation analysis using object detection events from the camera and the radar antenna that suppresses false positive results detected in the object detection events.

### Claim 13 (depends on 12)

The system of claim 12, wherein the processor, using programming contained in the computer memory, validates the data from the radar module with data from the camera and outputs validated detection results.
