US 9,805,273 B1 · Systems, methods, apparatuses, and devices for identifying and tracking unmanned aerial vehicles via a plurality of sensors

Abstract

Systems, methods, and apparatus for identifying and tracking UAVs including a plurality of sensors operatively connected over a network to a configuration of software and/or hardware. Generally, the plurality of sensors monitors a particular environment and transmits the sensor data to the configuration of software and/or hardware. The data from each individual sensor can be directed towards a process configured to best determine if a UAV is present or approaching the monitored environment. The system generally allows for a detected UAV to be tracked, which may allow for the system or a user of the system to predict how the UAV will continue to behave over time. The sensor information as well as the results generated from the systems and methods may be stored in one or more databases in order to improve the continued identifying and tracking of UAVs.

Claims72

Dependent claims

A method for identifying unmanned aerial vehicles (UAVs) in a particular air space, comprising the steps of:

receiving video data from a particular video sensor proximate to the particular air space, the video data including at least one image of an object that may be a UAV flying within the particular air space;
analyzing the video data to determine a first confidence measure that the object in the at least one image comprises a UAV;
receiving audio signal data from a particular audio sensor proximate to the particular air space, the audio signal data including frequency data indicating a possible presence of a UAV within the particular air space;
analyzing the audio signal data to determine a second confidence measure that the frequency data comprises a UAV;
receiving radio frequency (RF) signal data from a particular RF sensor proximate to the particular air space, the RF signal data including data indicating a possible presence of a UAV within the particular air space;
analyzing the RF signal data to determine a third confidence measure that the RF signal data corresponds to a UAV;
aggregating the first confidence measure, the second confidence measure, and the third confidence measure into a combined confidence measure indicating a possible presence of a UAV in the particular air space;
and
upon determination that the combined confidence measure exceeds a predetermined threshold value, storing an indication in a database that a UAV was identified in the particular air space.

6 more elements

A system for identifying unmanned aerial vehicles (UAVs) in a particular air space, comprising:

a video sensor proximate to the particular air space, wherein the video sensor is configured to collect and transmit video data, the video data including at least one image of an object that may be a UAV flying within the particular air space;
an audio sensor proximate to the particular air space, wherein the audio sensor is configured to collect and transmit audio signal data, the audio signal data including at least frequency data indicating a possible presence of a UAV within the particular air space;
a radio frequency (RF) sensor proximate to the particular air space, wherein the RF sensor is configured to collect RF signal data, the RF signal data including at least data indicating a possible presence of a UAV within the particular air space;
a database;
and
a processor operatively coupled to the video sensor, the audio sensor, the RF sensor, and the database, wherein the processor is operative to:
analyze the video data to determine a first confidence measure that the object in the at least one image comprises a UAV;
analyze the audio signal data to determine a second confidence measure that the frequency data comprises a UAV;
analyze the RF signal data to determine a third confidence measure that the RF signal data corresponds to a UAV;
aggregate the first confidence measure, the second confidence measure, and the third confidence measure into a combined confidence measure indicating a possible presence of a UAV in the particular air space;
and
upon determination that the combined confidence measure exceeds a predetermined threshold value, store an indication in the database that a UAV was identified in the particular air space.

9 more elements

A method for identifying unmanned aerial vehicles (UAVs) in a particular air space, comprising the steps of:

receiving video data from a particular video sensor proximate to the particular air space, the video data including at least one image of an object that may be a UAV flying within the particular air space;
analyzing the video data to determine a first confidence measure that the object in the at least one image comprises a UAV;
receiving audio signal data from a particular audio sensor proximate to the particular air space, the audio signal data including frequency data indicating a possible presence of a UAV within the particular air space;
analyzing the audio signal data to determine a second confidence measure that the frequency data comprises a UAV;
receiving Wi-Fi signal data from a particular Wi-Fi sensor proximate to the particular air space, the Wi-Fi signal data including data indicating a possible presence of a UAV within the particular air space;
analyzing the Wi-Fi signal data to determine a third confidence measure that the Wi-Fi signal data corresponds to a UAV;
aggregating the first confidence measure, the second confidence measure, and the third confidence measure into a combined confidence measure indicating a possible presence of a UAV in the particular air space;
upon determination that the combined confidence measure exceeds a predetermined threshold value, storing an indication in a database that a UAV was identified in the particular air space.

5 more elements

A method for identifying unmanned aerial vehicles (UAVs) in a particular air space, comprising the steps of:

receiving video data from a particular video sensor proximate to the particular air space, the video data including at least one image of an object that may be a UAV flying within the particular air space;
analyzing the video data to determine a first confidence measure that the object in the at least one image comprises a UAV;
receiving audio signal data from a particular audio sensor proximate to the particular air space, the audio signal data including frequency data indicating a possible presence of a UAV within the particular air space;
analyzing the audio signal data to determine a second confidence measure that the frequency data comprises a UAV, wherein analyzing the audio signal data comprises the steps of:
converting the audio signal data to frequency domain data such that the audio signal data may be represented as one or more frequencies;
determining if a frequency-to-noise volume for each of the one or more frequencies is within a predetermined frequency-to-noise threshold range;
upon determination that a respective frequency-to-noise volume for a respective frequency of the converted audio signal data is within the predetermined frequency-to-noise threshold range, comparing the respective frequency to one or more UAV frequencies known to be associated with UAVs;
and
upon determination that the respective frequency substantially matches at least one of the one or more UAV frequencies known to be associated with UAVs, determining the second confidence measure;
aggregating the first confidence measure and the second confidence measure into a combined confidence measure indicating a possible presence of a UAV in the particular air space;
and
upon determination that the combined confidence measure exceeds a predetermined threshold value, storing an indication in a database that a UAV was identified in the particular air space.

9 more elements

A system for identifying unmanned aerial vehicles (UAVs) in a particular air space, comprising:

a video sensor proximate to the particular air space, wherein the video sensor is configured to collect and transmit video data, the video data including at least one image of an object that may be a UAV flying within the particular air space;
an audio sensor proximate to the particular air space, wherein the audio sensor is configured to collect and transmit audio signal data, the audio signal data including at least frequency data indicating a possible presence of a UAV within the particular air space;
a Wi-Fi sensor proximate to the particular air space, wherein the Wi-Fi sensor is configured to receive Wi-Fi signal data, the Wi-Fi signal data including data indicating a possible presence of a UAV within the particular air space;
a database;
and
a processor operatively coupled to the video sensor, the audio sensor, the Wi-Fi sensor, and the database, wherein the processor is operative to:
analyze the video data to determine a first confidence measure that the object in the at least one image comprises a UAV;
analyze the audio signal data to determine a second confidence measure that the frequency data comprises a UAV;
analyze the Wi-Fi signal data to determine a third confidence measure that the Wi-Fi signal data corresponds to a UAV;
aggregate the first confidence measure, the second confidence measure, and the third confidence measure into a combined confidence measure indicating a possible presence of a UAV in the particular air space;
and
upon determination that the combined confidence measure exceeds a predetermined threshold value, store an indication in the database that a UAV was identified in the particular air space.

9 more elements

A system for identifying unmanned aerial vehicles (UAVs) in a particular air space, comprising:

a video sensor proximate to the particular air space, wherein the video sensor is configured to collect and transmit video data, the video data including at least one image of an object that may be a UAV flying within the particular air space;
an audio sensor proximate to the particular air space, wherein the audio sensor is configured to collect and transmit audio signal data, the audio signal data including at least frequency data indicating a possible presence of a UAV within the particular air space;
a database;
and
a processor operatively coupled to the video sensor, the audio sensor, and the database, wherein the processor is operative to:
analyze the video data to determine a first confidence measure that the object in the at least one image comprises a UAV;
analyze the audio signal data to determine a second confidence measure that the frequency data comprises a UAV, wherein analyzing the audio signal data further comprises:
converting the audio signal data to frequency domain data such that the audio signal data may be represented as one or more frequencies;
determining if a frequency-to-noise volume for each of the one or more frequencies is within a predetermined frequency-to-noise volume threshold range;
upon determination that a respective frequency-to-noise volume for a respective frequency of the converted audio signal data is within the predetermined frequency-to-noise threshold range, comparing the respective frequency to one or more UAV frequencies known to be associated with UAVs;
and
upon determination that the respective frequency substantially matches at least one of the one or more UAV frequencies known to be associated with UAVs, determine the second confidence measure;
aggregate the first confidence measure and the second confidence measure into a combined confidence measure indicating a possible presence of a UAV in the particular air space;
and
upon determination that the combined confidence measure exceeds a predetermined threshold value, store an indication in the database that a UAV was identified in the particular air space.

12 more elements

Dependencies are inferred from the claim text.

Systems, methods, apparatuses, and devices for identifying and tracking unmanned aerial vehicles via a plurality of sensors

Life of this patent

Systems, methods, apparatuses, and devices for identifying and tracking unmanned aerial vehicles via a plurality of sensors

Life of this patent

Abstract

Claims72