# US 2017/0372571 A1 · Detection and classification of abnormal sounds

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0372571 A1
- Document ID: US20170372571A1
- Status: Published application
- Kind: A1
- Application number: 15/697,837
- Filed: 2017-09-07
- Published: 2017-12-28
- Earliest claimed: 2014-12-05
- Assignees: Elwha LLC
- Applicants: Elwha LLC
- Inventors: Ehren J. Brav; Roderick A. Hyde; Yaroslav A. Urzhumov; Thomas A. Weaver; Lowell L. Wood, JR.
- Web page: https://patentgrep.com/patent/US20170372571A1

## CPC

- G08B 13/1672: {using sonic detecting means, e.g. a microphone operating in the audio frequency range}
- G08B 3/10: using electric transmission; using electromagnetic transmission
- G08B 13/19697: {Arrangements wherein non-video detectors generate an alarm themselves}
- G08B 21/02: Alarms for ensuring the safety of persons
- G08B 21/043: {detecting an emergency event, e.g. a fall}
- G08B 21/0469: {Presence detectors to detect unsafe condition, e.g. infrared sensor, microphone (G08B21/0476 takes precedence)}
- G08B 29/188: {Data fusion; cooperative systems, e.g. voting among different detectors}
- H04R 1/028: {associated with devices performing functions other than acoustics, e.g. electric candles}
- G08B 17/00: Fire alarms; Alarms responsive to explosion
- H04R 2420/07: Applications of wireless loudspeakers or wireless microphones
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An audio surveillance system includes a plurality of nodes and each node includes a microphone, a speaker, and a control unit. The microphone is configured to detect sound and the speaker is configured to provide sound. The control unit is configured to receive a plurality of inputs from the plurality of nodes and the plurality of inputs are based on a detected sound; determine a location of the source of the detected sound based on the plurality of inputs; classify the detected sound according to predefined alert conditions and based on the location of the source of the detected sound; provide an alert to a monitoring device regarding the detected sound based on the classification of the detected sound; and control at least one node from the plurality of nodes to provide an audio response to the detected sound.

## Claims

### Claim 1

A system comprising:
a primary audio surveillance node including a control unit, the control unit configured to:
receive a sound input based on a sound emitted by a source and detected by a microphone configured to detect sound and acoustic pulses;
receive an acoustic pulse input based on an acoustic pulse provided by a secondary audio surveillance node and detected by the microphone;
determine a relative location of the primary audio surveillance node with respect to the secondary audio surveillance node based on the acoustic pulse;
determine a location of the source of the detected sound based on the sound input and the determined relative location;
classify the detected sound based on a characteristic of the detected sound and the determined location of the source.

### Claim 2 (depends on 1)

The system of claim 1, wherein the primary audio surveillance node further comprises a speaker configured to emit acoustic pulses, and a wireless transceiver configured to transmit time-of-emission data for each acoustic pulse emitted by the speaker and receive time-of-emission data for each acoustic pulse provided by the secondary audio surveillance node.

### Claim 3 (depends on 1)

The system of claim 1, wherein the control unit is further configured to determine a time-of-flight for each detected acoustic pulse.

### Claim 4 (depends on 1)

The system of claim 1, wherein the primary audio surveillance node further comprises a wireless transceiver configured to transmit time-of-flight data for each detected acoustic pulse and receive time-of-emission data for an acoustic pulse detected by another audio surveillance node.

### Claim 5 (depends on 1)

The system of claim 1, wherein the determination of the relative location of the primary audio surveillance node is based on a plurality of time-of-flight data.

### Claim 6 (depends on 1)

The system of claim 1, wherein the primary audio surveillance node further comprises a wireless transceiver configured to transmit a signal based on the detected sound and receive a signal from a monitoring device regarding an audio response, wherein the control unit is configured to provide the audio response using a speaker of the primary audio surveillance node.

### Claim 7 (depends on 1)

The system of claim 1, wherein the control unit is configured to provide an alert, the alert including audio received from a monitoring device.

### Claim 8 (depends on 1)

The system of claim 1, wherein the control unit is configured to provide an alert, the alert including at least one of an image and a video.

### Claim 9 (depends on 1)

The system of claim 1, wherein the control unit is configured to determine the location of the source based on a characteristic of the detected sound, the sound characteristic at least one of a time of arrival, a relative intensity, a relative spectral content, and a triangulation.

### Claim 10 (depends on 1)

The system of claim 1, wherein the control unit is configured to automatically direct the microphone toward the determined location of the source.

### Claim 11 (depends on 1)

The system of claim 1, wherein the primary audio surveillance node further comprises a camera, and wherein the camera is at least one of a video camera, a still camera, or a spectral camera.

### Claim 12 (depends on 11)

The system of claim 11, wherein the control unit is configured to automatically direct the camera toward the determined location of the source.

### Claim 13

A method comprising:
receiving, by a control unit, a plurality of inputs from a plurality of nodes, wherein the plurality of inputs are based on a sound detected by a microphone;
determining, by the control unit, a location of a source of the detected sound based on the plurality of inputs;
classifying, by the control unit, the detected sound based on a characteristic of the detected sound and the location of the source;
providing, by the control unit, an alert to a monitoring device regarding the detected sound based on the classification.

### Claim 14 (depends on 13)

The method of claim 13, further comprising transmitting a signal based on the detected sound and receiving a signal from the monitoring device regarding an audio response.

### Claim 15 (depends on 13)

The method of claim 13, wherein the microphone is a directional microphone.

### Claim 16 (depends on 13)

The method of claim 13, further comprising providing an audio response using a speaker of a node of the plurality of nodes, wherein the speaker includes one of a wide angle speaker, a directional speaker, or a directional speaker using nonlinearly downconverted ultrasound.

### Claim 17 (depends on 13)

The method of claim 13, further comprising receiving, by the control unit, an image captured by a camera, wherein the camera is at least one of a video camera, a still camera, or a spectral camera.

### Claim 18 (depends on 17)

The method of claim 17, further comprising automatically directing the microphone based on the image.

### Claim 19 (depends on 13)

The method of claim 13, wherein the classification is based on a predefined alert condition.

### Claim 20 (depends on 19)

The method of claim 19, further comprising altering the predefined alert condition based on a time of day.

### Claim 21 (depends on 19)

The method of claim 19, wherein the predefined alert condition comprises a first alert condition and a second alert condition, and wherein the first alert condition is applied to a first node and a second alert condition is applied to a second node.

### Claim 22 (depends on 21)

The method of claim 21, wherein the applied alert condition is based on the location of the node.

### Claim 23 (depends on 13)

The method of claim 13, further comprising determining the location of at least a first node of the plurality of nodes based on an acoustic pulse transmitted by a speaker of a second node and received by a microphone of at least one of the first node and a third node.

### Claim 24 (depends on 13)

The method of claim 13, further comprising detecting, by the control unit, a moving audio shadow caused by a portion of the source being blocked.

### Claim 25

A method for detecting and classifying sounds, comprising:
receiving, by a control unit, sound data from a plurality of audio surveillance nodes, the sound data indicative of a sound detected by at least one of the audio surveillance nodes and an acoustic pulse received by a primary audio surveillance node and transmitted by a secondary audio surveillance node;
determining, by the control unit, a time-of-flight of the acoustic pulse;
determining, by the control unit, a location of the primary audio surveillance node based on the time-of-flight;
determining, by the control unit, a location of a source of the detected sound based on the sound data and based on the location of the primary audio surveillance node;
classifying, by the control unit, the detected sound based on the location of the source; and
controlling, by the control unit, a speaker to provide an audio response to the detected sound.

### Claim 26 (depends on 25)

The method of claim 25, wherein classifying the detected sound is based on a predefined alert condition, the predefined alert condition including a sound characteristic.

### Claim 27 (depends on 26)

The method of claim 26, further comprising altering the predefined alert condition based on a time of day.

### Claim 28 (depends on 26)

The method of claim 26, wherein the predefined alert condition includes a condition based on at least one of a voice, glass breaking, running, falling, a scream, fighting, or a gun shot.

### Claim 29 (depends on 26)

The method of claim 26, wherein the predefined alert condition is updated based on the detected sound.

### Claim 30 (depends on 26)

The method of claim 26, wherein the predefined alert condition is updated based on a user input received at a monitoring device.

### Claim 31 (depends on 25)

The method of claim 25, further comprising determining a movement of the source based on Doppler shifts in the detected sound.

### Claim 32 (depends on 25)

The method of claim 25, further comprising determining a velocity of the source based on the sound data.

### Claim 33 (depends on 25)

The method of claim 25, wherein the detected sound is detected by a microphone, and wherein the microphone is configured to detect sound only during a predefined time period.

### Claim 34 (depends on 33)

The method of claim 33, wherein the predefined time period occurs once per second.

### Claim 35 (depends on 25)

The method of claim 25, further comprising providing an audio response to the detected sound based on at least one of the classification of the detected sound or a user input received at a monitoring device.
