# US 2024/0179479 A1 · Audio training

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0179479 A1
- Document ID: US20240179479A1
- Status: Published application
- Kind: A1
- Application number: 18/533,575
- Filed: 2023-12-08
- Published: 2024-05-30
- Earliest claimed: 2019-07-22
- Assignees: Cochlear Limited
- Applicants: Cochlear Limited
- Inventors: Alexander von Brasch; Stephen Fung; Kartik Natarajan
- Web page: https://patentgrep.com/patent/US20240179479A1

## CPC

- H04R 25/507: {implemented by neural network or fuzzy logic}
- H04R 25/552: {Binaural}
- H04R 25/554: {using a wireless connection, e.g. between microphone and amplifier or using Tcoils}
- H04R 25/70: {Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting}
- H04R 2225/39: Aspects relating to automatic logging of sound environment parameters and the performance of the hearing aid during use, e.g. histogram logging, or of user selected programs or settings in the hearing aid, e.g. usage logging
- H04R 2225/41: Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
- H04R 2225/55: Communication between hearing aids and external devices via a network for data exchange
- H04R 2225/67: Implantable hearing aids or parts thereof not covered by H04R25/606
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

Presented herein are audio training techniques that facilitate the rehabilitation of a recipient of an auditory prosthesis. In certain embodiments, the audio training techniques presented herein may include real time training aspects in which the recipient's surrounding (ambient) auditory environment, including the sounds present therein, is analyzed in real time. The recipient can then be provided with a real time identity (e.g., audible or visible representation/description) of the sounds present in the auditory environment. The identity of the sounds can be provided to the recipient automatically and/or in response to recipient queries.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method, comprising:
recording sound signals received at a hearing device system including a hearing device;
detecting one or more sound identification trigger conditions associated with at least one of the sound signals;
extracting sound features from the at least one of the sound signals in response to detecting the one or more sound identification trigger conditions;
performing a classification analysis of the sound features extracted from the at least one of the sound signals to determine an identity of one or more sounds present in the at least one of the sound signals; and
providing the identity of the one or more sounds present in the at least one of the sound signals to a user of the hearing device.

### Claim 22 (depends on 21)

The method of claim 21, wherein detecting one or more sound identification trigger conditions associated with at least one of the sound signals comprises:
detecting a user-initiated query to identify the one or more sounds present in the at least one of the sound signals.

### Claim 23 (depends on 22)

The method of claim 22, wherein detecting a user-initiated query to identify the one or more sounds present in the at least one of the sound signals comprises:
detecting a manual input at a user interface of a component of the hearing device system; or
detecting a verbal query issued by the user of the hearing device.

### Claim 24 (depends on 21)

The method of claim 21, wherein detecting one or more sound identification trigger conditions associated with at least one of the sound signals comprises:
detecting at least one of a plurality of predetermined trigger sounds.

### Claim 25 (depends on 21)

The method of claim 21, further comprising:
receiving contextual data associated with the one or more sounds present in the at least one of the sound signals; and
performing the classification analysis based on the sound features extracted from the at least one of the sound signals and the contextual data.

### Claim 26 (depends on 25)

The method of claim 25, wherein the contextual data comprises one or more of geographic information, location information, and image data.

### Claim 27 (depends on 21)

The method of claim 21, wherein providing the identity of the one or more sounds present in the at least one of the sound signals to a recipient of the hearing device system comprises:
generating a visible descriptor of the identity of the one or more sounds present in the at least one of the sound signals; or
delivering the identity of the one or more sounds present in the at least one of the sound signals to the user as an audible descriptor via the hearing device.

### Claim 28 (depends on 21)

The method of claim 21, further comprising:
replaying the one or more sounds present in the at least one of the sound signals to the user via the hearing device,
wherein the replaying of the one or more sounds is associated with the identity of the one or more sounds.

### Claim 29 (depends on 21)

The method of claim 21, further comprising:
providing to the user, with the identity of the one or more sounds, a location description indicating a location of the one or more sounds relative to the user.

### Claim 30

A method, comprising:
receiving one or more recordings of one or more sounds captured via one or more sound inputs of a hearing device, wherein the one or more sounds include one or more speech components and one or more non-speech components;
extracting sound features of the one or more sounds, including the one or more speech components and the one or more non-speech components, from the one or more recordings;
analyzing the sound features of the one or more sounds extracted from the one or more recordings to determine sound identity information associated with the one or more sounds based at least on the sound features; and
providing a user of the hearing device with the sound identity information, wherein the sound identity information comprises a description of the one or more speech components and the one or more non-speech components of the one or more sounds.

### Claim 31 (depends on 30)

The method of claim 30, wherein analyzing the sound features of the one or more sounds extracted from the one or more recordings to determine sound identity information associated with the one or more sounds comprises:
generating a description of one or more of a source that produces the one or more sounds, content of the one or more sounds, a type or category of the one or more sounds, characteristics of the one or more sounds, an identity of a speaker associated with the one or more sounds, or speech identity information or non-speech identity information that enables the one or more sounds present in the one or more recordings to be differentiated from other sounds.

### Claim 32 (depends on 31)

The method of claim 31, wherein generating a description of the content of the one or more sounds includes generating a description that indicates content of the one or more speech components present in the one or more recordings, and
wherein generating a description of the type or category of the one or more sounds includes generating a description that indicates one or more of a type of the source that produces the one or more sounds, a type of noise present in the one or more recordings, a language spoken by the speaker associated with the one or more sounds, or a type of accent of the speaker associated with the one or more sounds.

### Claim 33 (depends on 30)

The method of claim 30, wherein analyzing the sound features of the one or more sounds extracted from the one or more recordings to determine sound identity information associated with the one or more sounds comprises:
performing a multi-dimensional classification analysis of the sound features extracted from the one or more recordings of the one or more sounds to classify the one or more sounds into respective categories based on the one or more speech components and the one or more non-speech components; and
generating the description of the one or more speech components and the one or more non-speech components of the one or more sounds based on the multi-dimensional classification analysis.

### Claim 34 (depends on 33)

The method of claim 33, further comprising:
receiving contextual data associated with the one or more sounds, wherein the contextual data comprises one or more of geographic information, location information, and image data; and
performing the multi-dimensional classification analysis to determine the sound identity information based on the sound features extracted from the one or more recordings of the one or more sounds and the contextual data associated with the one or more sounds.

### Claim 35 (depends on 30)

The method of claim 30, further comprising:
generating at least one of a visible descriptor or an audible descriptor of the sound identity information of the one or more sounds;
wherein providing the user with the description of the sound identity information comprises at least one of providing the user with the visible descriptor of the sound identity information via an external device associated with the user, or providing the user with the audible descriptor of the sound identity information via the hearing device.

### Claim 36

A system, comprising:
one or more microphones configured to receive sound signals;
one or more memory devices configured to store instructions for an audio training program; and
one or more processors configured to execute the instructions for the audio training program to:
record sound signals received at a hearing device system including a hearing device;
detect one or more sound logging trigger conditions associated with one or more sounds present in at least one of the sound signals;
determine an identity of at least one of the one or more sounds present in the at least one of the sound signals in response to detection of the one or more sound logging trigger conditions; and
store at least the identity of the at least one of the one or more sounds in an identified sound database stored on the one or more memory devices.

### Claim 37 (depends on 36)

The system of claim 36, wherein to detect one or more sound logging trigger conditions associated with one or more sounds present in at least one of the sound signals, the one or more processors are configured to:
detect a user-initiated query to identify the at least one of the one or more sounds present in the at least one of the sound signals; or
detect at least one of a plurality of predetermined trigger sounds.

### Claim 38 (depends on 36)

The system of claim 36, wherein to determine an identity of at least one of the one or more sounds present in the at least one of the sound signals in response to detection of the one or more sound logging trigger conditions, the one or more processors are configured to:
extract sound features from the at least one of the sound signals; and
perform a classification analysis of the sound features extracted from the at least one of the sound signals to determine the identity of the at least one of the one or more sounds present in the at least one of the sound signals.

### Claim 39 (depends on 36)

The system of claim 36, wherein the one or more processors are configured to execute the instructions for the audio training program to:
use at least the identity of the at least one of the one or more sounds stored in the identified sound database for non-real time rehabilitation operations.

### Claim 40 (depends on 39)

The system of claim 39, wherein the one or more processors are further configured to execute the instructions for the audio training program to:
determine additional sound information associated with the at least one of the one or more sounds;
store the additional sound information in association with the identity of the at least one of the one or more sounds in the identified sound database; and
use the identity of the at least one of the one or more sounds and the additional sound information associated with the at least one of the one or more sounds for the non-real time rehabilitation operations.

### Claim 41 (depends on 36)

The system of claim 36, wherein the one or more processors are configured to execute the instructions for the audio training program to:
adjust one or more operational settings of the hearing device based on at least the identity of the at least one of the one or more sounds stored in the identified sound database.

### Claim 42 (depends on 41)

The system of claim 41, wherein the one or more processors are further configured to execute the instructions for the audio training program to:
determine additional sound information associated with the at least one of the one or more sounds;
store the additional sound information in association with the identity of the at least one of the one or more sounds in the identified sound database; and
adjust one or more operational settings of the hearing device based on the identity of the at least one of the one or more sounds and the additional sound information associated with the at least one of the one or more sounds stored in the identified sound database.
