# US 2019/0377325 A1 · System and methods of novelty detection using non-parametric machine learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377325 A1
- Document ID: US20190377325A1
- Status: Published application
- Kind: A1
- Application number: 16/480,148
- Filed: 2018-01-23
- Published: 2019-12-12
- Earliest claimed: 2017-01-23
- Assignees: Nrg Systems, Inc.
- Applicants: Nrg Systems, Inc.
- Inventors: Enrique Daniel Angola Abreu
- Web page: https://patentgrep.com/patent/US20190377325A1

## CPC

- G05B 19/4065: Monitoring tool breakage, life or condition
- G10L 25/51: for comparison or discrimination
- G05B 13/0265: {the criterion being a learning criterion}
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/08: Learning methods
- G05B 2219/37337: Noise, acoustic emission, sound
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In general, a system and method consistent with the present disclosure allows for non-parametric modeling of audio data by advantageously utilizing a feature space of training vectors that is one-dimensional. A novelty detector consistent with the present disclosure may capture a plurality of audio samples and convert the same into a time-frequency domain pattern to establish a baseline sound signature using a statistical approach. A plurality of monitoring nodes may be associated with one or more frequencies represented within the time-frequency domain pattern. Each node may then compare subsequently captured time-frequency domain patterns to detect values which exceed a so-called “normal” threshold, with the threshold being dynamically derived based on the baseline sound signature in some embodiments. In the event a predetermined number of nodes detect a novelty in the sound signature, alerts may be issued to users/technicians.

## Claims

### Claim 1

A monitoring system for detection of novel audio events, the monitoring system comprising:
a memory;
a controller coupled to the memory, the controller to:
receive a plurality of captured audio samples corresponding to a first period of time T1;
convert the plurality of captured audio samples into a time-frequency domain pattern for a predetermined frequency range, the time-frequency domain pattern comprising a plurality of frequency bins and associated amplitude values for frequencies within the predetermined frequency range over the first period of time T1;
compare the time-frequency domain pattern to a baseline time-frequency domain pattern to identify a novel condition based in part on at least one frequency bin having a density estimate that exceeds an associated predefined threshold; and
send a condition event message with an identifier of the novel condition to a user.

### Claim 2 (depends on 1)

The monitoring system of claim 1, wherein converting the plurality of captured audio samples into the time-frequency domain pattern includes applying a short windowed Fast-Fourier-Transform (short-time FFT) to the plurality of captured audio samples.

### Claim 3 (depends on 1)

The monitoring system of claim 1, wherein comparing the time-frequency domain pattern to the baseline time-frequency pattern includes applying a first Parzen Window to audio samples associated with the at least one first frequency bin to derive a probability density function (PDF).

### Claim 4 (depends on 3)

The monitoring system of claim 3, wherein the Parzen Window is given by the following equation:
p
n

(
x
)
=
1
n

∑
i
=
1
n

1
V
n

ψ
(
x
-
xi
h
n
where Vn=hnd, h is a bandwidth parameter, and ψ is a kernel function in the d-dimensional space.

### Claim 5 (depends on 3)

The monitoring system of claim 3, wherein the derived PDF is used to determine a log-likelihood value, and wherein in response to the log-likelihood value exceeding the associated predefined threshold, the controller sends the condition event message with an identifier of the novel condition to a user.

### Claim 6 (depends on 1)

The monitoring system of claim 1, the controller further configured to:
receive a plurality of baseline audio samples corresponding to a second period of time T2, the second period of time T2 being prior to the first period of time T1;
convert the plurality of baseline audio samples into a time-frequency domain pattern; and
store the time-frequency domain pattern as the baseline time-frequency domain pattern in the memory.

### Claim 7 (depends on 1)

The monitoring system of claim 1, wherein the predefined threshold for the at least one frequency bin is derived based on an outlier limit applied to corresponding audio samples represented within the baseline time-frequency domain pattern.

### Claim 8

A computer-implemented method for detecting novelties in an audio signal, the method comprising:
receiving, by a controller, a plurality of captured audio samples corresponding to a first period of time T1;
converting, by the controller, the plurality of captured audio samples into a time-frequency domain pattern for a predetermined frequency range, the time-frequency domain pattern comprising a plurality of frequency bins and associated amplitude values for frequencies within the predetermined frequency range over the first period of time T1;
comparing the time-frequency domain pattern to a baseline time-frequency domain pattern to identify a novel condition based in part on at least one frequency bin having a density estimate that exceeds an associated predefined threshold; and
sending a condition event message with an identifier of the novel condition to a user.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, wherein converting, by the controller, the plurality of captured audio samples into the time-frequency domain pattern includes applying a short windowed Fast-Fourier-Transform (short-time FFT) to the plurality of captured audio samples.

### Claim 10 (depends on 8)

The computer-implemented method of claim 8, further comprising associating each of the frequency bins with a respective monitoring node.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, wherein comparing the time-frequency domain pattern to a baseline time-frequency domain pattern further comprises each monitoring node applying a Parzen Window to each associated audio sample to derive a probability distribution function (PDF), and wherein identifying novelty includes comparing the derived PDF to a corresponding PDF of the baseline time-frequency domain pattern.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the Parzen Window is given by the following equation:
p
n

(
x
)
=
1
n

∑
i
=
1
n

1
V
n

ψ
(
x
-
x
i
h
n
where Vn=hnd, h is a bandwidth parameter, and ψ is a kernel function in the d-dimensional space.

### Claim 13 (depends on 11)

The computer-implemented method of claim 11, wherein the derived PDF is used to determine a log a log-likelihood value, and wherein in response to the log-likelihood value exceeding the associated predefined threshold, the method further comprises sending the condition event message with an identifier of the novel condition to a user.

### Claim 14 (depends on 8)

The computer-implemented method of claim 8, further comprising generating the baseline time-frequency domain pattern by capturing a plurality of audio samples when machinery is operating in a normal condition.

### Claim 15 (depends on 8)

The computer-implemented method of claim 8, wherein generating the baseline time-frequency domain pattern further comprises capturing audio samples for a plurality of equal-length intervals.
