# US 2017/0148467 A1 · Drone detection and classification with compensation for background clutter sources

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0148467 A1
- Document ID: US20170148467A1
- Status: Published application
- Kind: A1
- Application number: 15/360,069
- Filed: 2016-11-23
- Published: 2017-05-25
- Earliest claimed: 2015-11-24
- Assignees: Droneshield, LLC
- Applicants: DroneShield, LLC
- Inventors: John Franklin; Brian Hearing
- Web page: https://patentgrep.com/patent/US20170148467A1

## CPC

- G10L 25/51: for comparison or discrimination
- G10L 25/39: using genetic algorithms
- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- G10L 25/21: the extracted parameters being power information
- H04R 29/00: Monitoring arrangements; Testing arrangements {(for hearing aids H04R25/30; detection of loudspeaker connection H04R5/04; sound-field adaptation dependent on speaker detection H04S7/308)}
- H04R 2410/00: Microphones
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A system, method, and apparatus for detecting drones are disclosed. An example method includes receiving a digital sound sample and partitioning the digital sound sample into segments. The method also includes applying a frequency and power spectral density transformation to each of the segments to produce respective sample vectors. For each of the sample vectors, the example method determines a combination of drone sound signatures and background sound signatures that most closely match the sample vector. The method further includes determining, for the sample vectors, if the drone sound signatures in relation to the background sound signatures that are included within the respective combinations are indicative of a drone. Conditioned on determining that the drone sound signatures are indicative of a drone, an alert message indicative of the drone is transmitted.

## Claims

### Claim 1

An apparatus configured to detect drones comprising:
a microphone configured to receive a sound signal;
a sound card configured to record a digital sound sample of the sound signal; and
a memory storing a plurality of drone sound signatures and a plurality of background sound signatures;
a processor configured to:
apply a frequency transformation to the digital sound sample to create a sample time-frequency spectrum;
determine a sample power spectral density of the sample time-frequency spectrum;
perform single channel source separation of the sample power spectral density using a non-negative matrix factorization algorithm to determine which of the plurality of sound signatures in the memory are activated by
determining a combination of the drone and background sound signatures stored in the memory that most closely match the sample power spectral density of the digital sound sample, and
applying a sparsity parameter to cause the non-negative matrix factorization algorithm to select a minimal combination of sound signatures needed to closely match the sample power spectral density;
determine if at least one of the plurality of drone sound signatures are activated; and
conditioned on the at least one of the plurality of drone sound signatures being activated, at least one of (i) transmit an alert indicative of a drone, and (ii) activate a beamformer to determine a location of a drone associated with the sound signal.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein each of the drone and background sound signatures are stored as power spectral densities.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the drone and background sound signatures are stored within an m×p matrix W, where p is equal to a total number of drone and background sound signatures such that each column of the matrix W corresponds to a different drone or background sound signature and m is equal to a predetermined number of frequency bins, each entry within the matrix W specifying a power of the respective sound signature at the respective frequency bin.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the processor is configured to:
partition the digital sound sample into n number of non-overlapping segments each having a predetermined duration;
process each of the non-overlapping segments into a power spectral density vector; and
create a sample m×n matrix M where n is equal to a total number of power spectral density vectors such that each column of the sample matrix M corresponds to a different power spectral density vector,
wherein the sample matrix M has the same number m of predetermined frequency bins as the matrix W, and
wherein each entry within the sample matrix M specifies a power of the respective power spectral density vector at the respective frequency bin.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the predetermined duration is between 0.05 seconds and 2 seconds.

### Claim 6 (depends on 4)

The apparatus of claim 4, wherein the processor is configured to using the non-negative matrix factorization algorithm to determine which of the plurality of sound signatures in the memory are activated by solving for an activation p×n matrix H, where the matrix W multiplied by the activation matrix H approximates the sample matrix M,
wherein an i-th row and j-th column of the activation matrix H specifies a contribution of the drone or background sound signature at the i-th column of the matrix W for the power spectral density vector at the j-th column of the sample matrix M.

### Claim 7 (depends on 4)

The apparatus of claim 4, wherein the non-negative matrix factorization algorithm is specified as:
H
←
H
⊗
W
T

(
M
⊗
Λ
β
-
2
)
W
T

Λ
β
-
1
+
μ
where T indicates a matrix transpose, μ is the sparsity parameter and is greater than 0, β is a cost function that measures a difference between a linear combination of the sound signatures and each of the power spectral density vectors, and L=WH.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the matrices W and H are determined by:
W
,
H
=
min
W
,
H


D

(
M

WH
)
.

### Claim 9 (depends on 6)

The apparatus of claim 6, wherein each entry of the activation matrix H includes a value greater than 0 that is indicative of how much of a respective drone or background sound signature matches a corresponding power spectral density vector across the predetermined number of frequency bins.

### Claim 10

A system configured to detect drones comprising:
a drone detection device including:
a microphone configured to receive a sound signal;
a sound card configured to record a digital sound sample of the sound signal; and
a frequency processor configured to:
apply a frequency transformation to the digital sound sample to create a sample time-frequency spectrum,
determine a sample power spectral density vector from the sample time-frequency spectrum, and
transmit the sample power spectral density vector for further analysis; and
a server communicatively coupled to the drone detection device including:
a memory storing a plurality of drone sound signatures and a plurality of background sound signatures; and
a detection processor configured to
determine which of the plurality of sound signatures in the memory are activated using a non-negative matrix factorization algorithm by determining a combination of the drone and background sound signatures stored in the memory that most closely match the sample power spectral density vector,
determine if at least one of the plurality of drone sound signatures are activated, and
conditioned on the at least one of the plurality of drone sound signatures being activated, at least one of (i) transmit an alert indicative of a drone, and (ii) activate a beamformer in proximity of the drone detection device to determine a location of a drone associated with the sound signal.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the drone detection device is deployed at a specific location and the server is located within at least one of a management server, a cloud computing environment, and a distributed computing environment remote from the specific location.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the detection processor is configured to:
determine if at least one sample power spectral density vector previously received within a predetermined time period is associated with a detected drone;
conditioned on the previously received sample power spectral density vectors not being associated with a detected drone, before determining which of the plurality of sound signatures in the memory are activated, update at least some of the background sound signatures based on the previously received sample power spectral density vectors; and
conditioned on at least one of the previously received sample power spectral density vectors being associated with a detected drone, refrain from updating the background sound signatures.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the detection processor is configured to use the non-negative matrix factorization algorithm to update the at least some of the background sound signatures by iteratively changing (i) the at least some of the background sound signatures and (ii) activations of the background sound signatures such the combination of (i) and (ii) closely approximates the previously received sample power spectral density vectors.

### Claim 14 (depends on 10)

The apparatus of claim 10, wherein the detection processor is configured to:
determine an error associated with the combination of the drone and background sound signatures that most closely match the sample power spectral density vector; and
conditioned upon the error exceeding a threshold, determine that a drone is not detected.

### Claim 15 (depends on 10)

The apparatus of claim 10, wherein the detection processor is configured to:
determine a ratio between activated drone sound signatures and activated background sound signatures; and
conditioned upon the ratio not exceeding a threshold, determine that a drone is not detected.

### Claim 16

A method for detecting drones comprising:
receiving, via an interface, a digital sound sample:
partitioning, via a processor, the digital sound sample into segments;
applying, via the processor, a frequency and power spectral density transformation to each of the segments to produce respective sample vectors;
for each of the sample vectors, determining, via the processor, a combination of drone sound signatures and background sound signatures stored in a memory that most closely match the sample vector;
determining, via the processor, for the sample vectors, if the drone sound signatures in relation to the background sound signatures that are included within the respective combinations are indicative of a drone; and
conditioned on determining the drone sound signatures are indicative of a drone, transmitting an alert message indicative of the drone.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
determining, via the processor, frequency bins of the drone sound signatures included within the combination that are indicative of the drone; and
transmitting, via the processor, an indication of at least some of the determined frequency bins to a beamformer directional finder to determine a location of the drone.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
determining, via the processor, a classification of the drone based on metadata associated with the drone sound signatures that are included within the combination; and
transmitting, via the processor, the classification in conjunction with the alert.

### Claim 19 (depends on 16)

The method of claim 16, wherein the combination includes a minimal number of drone sound signatures and background sound signatures that closely match the receptive sample vector.

### Claim 20 (depends on 16)

The method of claim 16, wherein the combination includes only drone sound signatures and no background sound signatures or only background sound signatures and no drone sound signatures,
wherein the alert s not transmitted if the combination only includes background sound signatures.
