# US 2021/0174824 A1 · Neural Network Audio Scene Classifier for Hearing Implants

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174824 A1
- Document ID: US20210174824A1
- Status: Published application
- Kind: A1
- Application number: 17/263,068
- Filed: 2019-07-24
- Published: 2021-06-10
- Earliest claimed: 2018-07-26
- Assignees: MED-EL Elektromedizinische Geraete GmbH
- Applicants: MED-EL Elektromedizinische Geraete GmbH
- Inventors: Rainer Martin; Semih Agcaer; Florian Frühauf; Ernst Aschbacher; Erhard Rank
- Web page: https://patentgrep.com/patent/US20210174824A1

## CPC

- G10L 25/51: for comparison or discrimination
- A61N 1/36038: {Cochlear stimulation}
- G10L 21/00: Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility (G10L19/00 takes precedence)
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- G10L 25/30: using neural networks
- H04R 25/507: {implemented by neural network or fuzzy logic}
- H04R 2225/41: Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An audio scene classifier classifies an audio input signal from an audio scene and includes a pre-processing neural network configured for pre-processing the audio input signal based on initial classification parameters to produce an initial signal classification, and a scene classifier neural network configured for processing the initial scene classification based on scene classification parameters to produce an audio scene classification output. The initial classification parameters reflect neural network training based on a first set of initial audio training data, and the scene classification parameters reflect neural network training on a second set of classification audio training data separate and different from the first set of initial audio training data. A hearing implant signal processor configured for processing the audio input signal and the audio scene classification output to generate the stimulation signals to the hearing implant for perception by the patient as sound.

## Claims

### Claim 1

A signal processing method for generating stimulation signals for a hearing implant implanted in a patient, the method comprising:
classifying an audio input signal from an audio scene with a multi-layer neural network, the classifying comprising:
a) pre-processing the audio input signal with a pre-processing neural network using initial classification parameters to produce an initial signal classification, and
b) processing the initial scene classification with a scene classifier neural network using scene classification parameters to produce an audio scene classification output,
wherein the initial classification parameters reflect neural network training based on a first set of initial audio training data, and the scene classification parameters reflect neural network training on a second set of classification audio training data separate and different from the first set of initial audio training data;
processing the audio input signal and the audio scene classification output with a hearing implant signal processor for generating the stimulation signals.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the pre-processing neural network includes successive recurrent convolutional layers.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the recurrent convolutional layers are implemented as recursive filter banks.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the pre-processing neural network includes an envelope processing block configured for calculating sub-band signal envelopes for the audio input signal.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the pre-processing neural network includes a pooling layer configured for signal decimation within the pre-processing neural network.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the initial signal classification is a multi-dimensional feature vector.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the scene classifier neural network comprises a fully connected neural network layer.

### Claim 8 (depends on 1)

The system according to claim 1, wherein the scene classifier neural network comprises a linear discriminant analysis (LDA) classifier.

### Claim 9

A signal processing system for generating stimulation signals for a hearing implant implanted in a patient, the system comprising:
an audio scene classifier comprising a multi-layer neural network configured for classifying an audio input signal from an audio scene, wherein the audio scene classifier includes:
c) a pre-processing neural network configured for pre-processing the audio input signal based on initial classification parameters to produce an initial signal classification, and
d) a scene classifier neural network configured for processing the initial scene classification based on scene classification parameters to produce an audio scene classification output,
wherein the initial classification parameters reflect neural network training based on a first set of initial audio training data, and the scene classification parameters reflect neural network training on a second set of classification audio training data separate and different from the first set of initial audio training data;
a hearing implant signal processor configured for processing the audio input signal and the audio scene classification output for generating the stimulation signals.

### Claim 10 (depends on 9)

The system according to claim 9, wherein the pre-processing neural network includes successive recurrent convolutional layers.

### Claim 11 (depends on 10)

The system according to claim 10, wherein the recurrent convolutional layers are implemented as recursive filter banks.

### Claim 12 (depends on 9)

The system according to claim 9, wherein the pre-processing neural network includes an envelope processing block configured for calculating sub-band signal envelopes for the audio input signal.

### Claim 13 (depends on 9)

The system according to claim 9, wherein the pre-processing neural network includes a pooling layer configured for signal decimation within the pre-processing neural network.

### Claim 14 (depends on 9)

The system according to claim 9, wherein the initial signal classification is a multi-dimensional feature vector.

### Claim 15 (depends on 9)

The system according to claim 9, wherein the scene classifier neural network comprises a fully connected neural network layer.

### Claim 16 (depends on 9)

The system according to claim 9, wherein the scene classifier neural network comprises a linear discriminant analysis (LDA) classifier.
