# US 8,280,087 B1 · Delivering fundamental frequency and amplitude envelope cues to enhance speech understanding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,280,087 B1
- Document ID: US8280087B1
- Status: Granted
- Kind: B1
- Application number: 12/433,851
- Filed: 2009-04-30
- Granted: 2012-10-02
- Earliest claimed: 2008-04-30
- Assignees: Arizona Board of Regents for and on behalf of Arizona State University
- Inventors: Sid P. Bacon; Christopher A. Brown; Frederic Apoux
- Web page: https://patentgrep.com/patent/US8280087B1

## CPC

- H04R 25/353: {Frequency, e.g. frequency shift or compression}
- A61N 1/36038: {Cochlear stimulation}
- G10L 21/0364: for improving intelligibility
- G10L 21/003: Changing voice quality, e.g. pitch or formants
- G10L 25/90: Pitch determination of speech signals
- H04R 25/356: {Amplitude, e.g. amplitude shift or compression}
- H04R 2225/43: Signal processing in hearing aids to enhance the speech intelligibility
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems, apparatus, and techniques are described to perform operations including receiving speech that includes audio signals from a talker. A fundamental frequency, unique to the talker, is extracted from the audio signals. A tone in frequency with the extracted fundamental frequency of the received speech is modulated and the modulated tone is delivered to an audio transducing device.

## Claims

### Claim 1

A computer-implemented method to enhance speech understanding, the method comprising:
receiving speech from a talker at a system including one or more computers, the speech including audio signals;
extracting, at the system, a fundamental frequency from the audio signals, wherein the extracted fundamental frequency is unique to the talker;
modulating, at the system, a tone of the speech in frequency with dynamic changes of the extracted fundamental frequency of the received speech, wherein the dynamic changes are obtained using YIN algorithm; and
delivering the modulated tone as an acoustic signal.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
modulating, at the system, the tone in amplitude with an amplitude envelope of the received speech;
providing the tone of the speech, modulated in frequency with the extracted fundamental frequency of the received speech, and in amplitude with the amplitude envelope of the received speech,
wherein the modulated tone is amplified prior to the delivering.

### Claim 3 (depends on 2)

The method of claim 2, wherein the amplitude envelope is obtained by half-wave rectification and low-pass filtering.

### Claim 4

A computer-readable medium tangibly encoding software instructions executable by one or more data processing apparatus to perform operations comprising:
receiving speech from a talker, the speech including audio signals;
extracting a fundamental frequency from the audio signals, wherein the extracted fundamental frequency is unique to the talker;
modulating a tone of the speech in frequency with dynamic changes of the extracted fundamental frequency of the received speech, wherein the dynamic changes are obtained using YIN algorithm;
amplifying the modulated tone; and
delivering the modulated tone as an acoustic signal.

### Claim 5 (depends on 4)

The computer-readable medium of claim 4, further comprising:
modulating the tone of the speech in amplitude with an amplitude envelope of the received speech; and
providing the tone, modulated in amplitude with the amplitude envelope of the received speech.

### Claim 6 (depends on 5)

The computer-readable medium of claim 5, wherein the amplitude envelope is obtained by half-wave rectification and low-pass filtering.

### Claim 7

A cochlear implant system comprising:
a cochlear implant;
means for receiving speech from a talker, the speech including audio signals;
means for extracting a fundamental frequency from the audio signals, wherein the extracted fundamental frequency is unique to the talker;
means for modulating a tone of the speech in frequency with dynamic changes of the extracted fundamental frequency of the received speech, wherein the dynamic changes are obtained using YIN algorithm; and
means for providing the modulated tone to the cochlear implant as an acoustic signal.

### Claim 8 (depends on 7)

The system of claim 7, further comprising means for:
modulating the tone in amplitude with an amplitude envelope of the received speech; and
providing the tone of the speech, modulated in amplitude with the amplitude envelope.

### Claim 9 (depends on 8)

The system of claim 8, wherein the amplitude envelope is obtained by half-wave rectification and low-pass filtering of the received speech.

### Claim 10

A system comprising:
a first transformer to receive an audio signal and transform the received audio signal into a frequency-domain representation;
a processor operatively coupled to the transformer, the processor including:
a frequency compression unit to perform frequency compression of the frequency-domain representation of the audio signal,
a frequency transposition unit operatively coupled to the frequency compression unit to perform frequency transposition of the frequency-domain representation of the audio signal on which the frequency compression has been performed;
a second transformer operatively coupled to the processor to transform the compressed and transposed audio signals into a time-domain representation;
a transmitter operatively coupled to the second transformer to deliver the signals in the time-domain representation as acoustic signals;
an amplifier operatively coupled to the second transformer to amplify the signals in the time-domain representation; and
a level control unit operatively coupled to the amplifier to control a level by which the amplifier amplifies the signals in the time-domain representation.

### Claim 11 (depends on 10)

The system of claim 10, wherein the frequency compression is applied to a frequency region in which a fundamental frequency of most talkers occurs.

### Claim 12 (depends on 10)

The system of claim 10, wherein the frequency transposition is applied such that a frequency region in which a fundamental frequency of most talkers occurs is audible to a user.

### Claim 13 (depends on 10)

The system of claim 10, further comprising an audio transducing device to receive the signals in the time-domain representation delivered by the second transformer.
