# US 2021/0233514 A1 · Listening devices for obtaining metrics from ambient noise

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0233514 A1
- Document ID: US20210233514A1
- Status: Published application
- Kind: A1
- Application number: 17/301,681
- Filed: 2021-04-12
- Published: 2021-07-29
- Earliest claimed: 2018-06-11
- Assignees: Capital One Services, LLC
- Applicants: Capital One Services, LLC
- Inventors: Michael MOSSOBA; Joshua EDWARDS; Abdelkadar M'Hamed BENKREIRA; Austen NOVIS; Sophie BERMUDEZ
- Web page: https://patentgrep.com/patent/US20210233514A1

## CPC

- G10L 15/063: {Training}
- G01R 19/2506: {Arrangements for conditioning or analysing measured signals, e.g. for indicating peak values (G01R19/003 takes precedence); Details concerning sampling, digitizing or waveform capturing (displaying waveforms G01R13/00; analog sampling G01R19/0053)}
- G05B 19/042: using digital processors (G05B19/05 takes precedence)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06N 3/02: Neural networks
- G06N 20/00: Machine learning
- G06Q 50/00: Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism (healthcare informatics G16H)
- G10L 21/16: Transforming into a non-visible representation (devices or methods enabling ear patients to replace direct auditory perception by another kind of perception A61F11/04)
- G10L 25/51: for comparison or discrimination
- G05B 23/0221: {Preprocessing measurements, e.g. data collection rate adjustment; Standardization of measurements; Time series or signal analysis, e.g. frequency analysis or wavelets; Trustworthiness of measurements; Indexes therefor; Measurements using easily measured parameters to estimate parameters difficult to measure; Virtual sensor creation; De-noising; Sensor fusion; Unconventional preprocessing inherently present in specific fault detection methods like PCA-based methods}
- G05B 2219/2639: Energy management, use maximum of cheap power, keep peak load low
- G05B 2219/37337: Noise, acoustic emission, sound
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G01R: MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES (indicating correct tuning of resonant circuits H03J3/12)
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A device may receive audio data based on a capturing of sounds associated with a structure. The device may obtain a model associated with the structure. The model may have been trained to receive the audio data as input, determine a score that identifies a likelihood that a sound is present in the audio data, and identify the sound based on the score. The device may determine at least one parameter associated with the sound. The device may generate a metric based on the at least one parameter associated with the sound, and perform an action based on the metric.

## Claims

### Claim 1

A method, comprising:
receiving, by a device and from at least one microphone associated with a structure, first audio data based on a first sound associated with the structure;
determining, by the device, that the first sound is distinct from a second sound associated with the structure,
the second sound including ambient noise associated with the structure;
processing, by the device and based on determining that the first sound is distinct from the second sound, the first sound to identify the first sound;
generating, by the device, a metric indicating usage of an equipment associated with the structure; and
performing, by the device, an action based on the metric.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
obtaining, from a plurality of models and based on the structure, a particular model associated with the structure; and
wherein processing the first sound to identify the first sound comprises:
processing the first sound using the particular model.

### Claim 3 (depends on 2)

The method of claim 2, wherein the particular model comprises a machine learning model that was generated based on historical audio data associated with the structure.

### Claim 4 (depends on 1)

The method of claim 1, wherein the equipment associated with the structure comprises:
an appliance associated with usage of power resources.

### Claim 5 (depends on 1)

The method of claim 1, wherein the metric defines a cost associated with usage of the equipment.

### Claim 6 (depends on 1)

The method of claim 1, wherein performing the action comprises:
generating a notification indicating the metric; and
transmitting the notification to a user device associated with the structure.

### Claim 7 (depends on 1)

The method of claim 1, wherein performing the action comprises:
transmitting, to the equipment, an instruction to adjust a state or setting of the equipment.

### Claim 8

A device, comprising:
one or more memories; and
one or more processors, coupled to the one or more memories, configured to:
receive, from at least one microphone associated with a structure, first audio data based on a first sound associated with the structure;
determine that the first sound is distinct from a second sound associated with the structure,
the second sound including ambient noise associated with the structure;
process, based on determining that the first sound is distinct from the second sound, the first sound to identify the first sound;
generate a metric indicating usage of an equipment associated with the structure; and
perform an action based on the metric.

### Claim 9 (depends on 8)

The device of claim 8, wherein the one or more processors are further configured to:
obtain, from a plurality of models and based on the structure, a particular model associated with the structure; and
wherein the one or more processors, to process the first sound to identify the first sound, are configured to:
process the first sound using the particular model.

### Claim 10 (depends on 9)

The device of claim 9, wherein the particular model comprises a machine learning model that was generated based on historical audio data associated with the structure.

### Claim 11 (depends on 8)

The device of claim 8, wherein the equipment associated with the structure comprises:
an appliance associated with usage of power resources.

### Claim 12 (depends on 8)

The device of claim 8, wherein the metric defines a cost associated with usage of the equipment.

### Claim 13 (depends on 8)

The device of claim 8, wherein the one or more processors, to perform the action, are configured to:
generate a notification indicating the metric; and
transmit the notification to a user device associated with the structure.

### Claim 14 (depends on 8)

The device of claim 8, wherein the one or more processors, to perform the action, are configured to:
transmit, to the equipment, an instruction to adjust a state or setting of the equipment.

### Claim 15

A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:
one or more instructions that, when executed by one or more processors of a device, cause the device to:
receive, from at least one microphone associated with a structure, first audio data based on a first sound associated with the structure;
determine that the first sound is distinct from a second sound associated with the structure,
the second sound including ambient noise associated with the structure;
process, based on determining that the first sound is distinct from the second sound, the first sound to identify the first sound;
generate a metric indicating usage of an equipment associated with the structure; and
perform an action based on the metric.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the one or more instructions further cause the device to:
obtain, from a plurality of models and based on the structure, a particular model associated with the structure; and
wherein the one or more instructions, that cause the device to process the first sound to identify the first sound, cause the device to:
process the first sound using the particular model.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein the particular model comprises a machine learning model that was generated based on historical audio data associated with the structure.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the equipment associated with the structure comprises:
an appliance associated with usage of power resources.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the metric defines a cost associated with usage of the equipment.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the one or more instructions, that cause the device to perform the action, cause the device to:
generate a notification indicating the metric; and
transmit the notification to a user device associated with the structure.
