# US 2019/0172477 A1 · Systems and methods for removing reverberation from audio signals

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172477 A1
- Document ID: US20190172477A1
- Status: Published application
- Kind: A1
- Application number: 16/271,338
- Filed: 2019-02-08
- Published: 2019-06-06
- Earliest claimed: 2015-09-02
- Assignees: University of Rochester
- Applicants: The University of Rochester
- Inventors: Mark Bocko; Sarah Smith
- Web page: https://patentgrep.com/patent/US20190172477A1

## CPC

- G10L 21/0264: characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
- G10L 21/0208: Noise filtering
- G10L 21/0232: Processing in the frequency domain
- G10H 3/125: {Extracting or recognising the pitch or fundamental frequency of the picked up signal}
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 25/06: the extracted parameters being correlation coefficients
- G10L 2021/02082: {the noise being echo, reverberation of the speech}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE

## Abstract

Disclosed herein are systems and methods for removing reverberation from signals. The systems and methods can be applicable to audio signals, for example, to voice, musical instrument sounds, and the like. Signals such as the vowel sounds in speech and the sustained portions of many musical instrument sounds can be composed of a fundamental frequency component and a series of harmonically related overtones. The systems and methods can exploit the intrinsically high degree of mutual correlation among the overtones. When such signals are passed through a reverberant channel, the degree of mutual correlation among the partials can be reduced. An inverse channel filter for the removal of reverberation can be found by employing an adaptive filter technique that maximizes the cross-correlation among signal overtones.

## Claims

### Claim 1

A method for the removal of reverberation from a signal, the method comprising:
tracking one or more overtones of the signal;
determining cross-correlations of the overtones of the signal;
determining an error associated with the cross-correlations of the overtones of the signal; and
removing reverberation from the signal by filtering the signal based on the determined error to maximize the cross correlations of the overtones.

### Claim 2 (depends on 1)

The method of claim 1, further comprising sending the signal to one or more systems.

### Claim 3 (depends on 2)

The method of claim 2, wherein the one or more systems comprises a loudspeaker system.

### Claim 4 (depends on 1, 2, 3)

The method of any of claims 1-3, wherein the signal is one or more of periodic and quasi-periodic.

### Claim 5 (depends on 1, 2, 3, 4)

The method of any of claims 1-4, wherein the signal comprises a digital signal, an analog signal, or a partially digital, partially analog signal.

### Claim 6 (depends on 1, 2, 3, 4, 5)

The method of any of claims 1-5, wherein the signal is an audio signal.

### Claim 7 (depends on 1, 2, 3, 4, 5, 6)

The method of any of claims 1-6, wherein the signal is pre-recorded.

### Claim 8 (depends on 1, 2, 3, 4, 5, 6, 7)

The method of any of claims 1-7, wherein the signal is live.

### Claim 9 (depends on 1, 2, 3, 4, 5, 6, 7, 8)

The method of any of claims 1-8, wherein the signal comprises one or more of speech and music.

### Claim 10 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9)

The method of any of claims 1-9, wherein removing reverberation from the signal by filtering the signal comprises using an adaptive filter for the removal of reverberation from the signal.

### Claim 11 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10)

The method of any of claims 1-10, wherein the determining the error is performed from the cross-correlations among the overtone signal components with an adaptive filter tuning scheme.

### Claim 12 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11)

The method of any of claims 1-11, wherein maximizing cross-correlations of the overtones based on the error is performed by adjusting one or more coefficients of the adaptive filter.

### Claim 13 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)

The method of any of claims 1-12, wherein tracking the overtones of the signal comprises determining an instantaneous frequency and amplitude of the overtones of the signal.

### Claim 14 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)

The method of any of claims 1-13, wherein tracking the overtones of the signal comprises tracking multiple overtones simultaneously using a Short Time Fourier Transform (STFT).

### Claim 15 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)

The method of any of claims 1-14, wherein tracking the overtones of the signal comprises isolating the overtones of the signal.

### Claim 16 (depends on 15)

The method of claim 15, wherein the isolating the overtones of the signal is performed by a bank of filters.

### Claim 17 (depends on 16)

The method of claim 16, wherein the bank of filters comprise one or more of highpass, lowpass, and bandpass filters.

### Claim 18 (depends on 16, 17)

The method of any of claims 16-17, wherein the bank of filters are analog, digital, or partially analog, partially digital filters.

### Claim 19 (depends on 15, 16, 17, 18)

The method of any of claims 15-18, wherein the isolating the overtones of the signal is performed by a heterodyne detection method.

### Claim 20 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)

The method of any of claims 1-19, wherein determining the cross-correlation of the overtones of the signal comprises determining if the cross-correlation of the overtones of the signal is in an analog domain, a digital domain, or a partially analog, partially digital domain.

### Claim 21 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)

The method of any of claims 1-20, wherein removing reverberation from the signal by filtering the signal based on the determined error to maximize the cross correlations of the overtones comprises finding an inverse filter.

### Claim 22

A system for the removal of reverberation from a signal, the system comprising:
memory containing computer-executable instructions;
a processor in communication with the memory, wherein the processor executes the computer-readable instructions, said instructions causing the processor to:
track overtones of the signal;
determine cross-correlations of the overtones of the signal;
determine an error associated with the cross-correlations of the overtones of the signal;
remove reverberation from the signal by filtering the signal based on the determined error to maximize the cross correlations of the overtones; and
send the signal to one or more systems.

### Claim 23 (depends on 22)

The system of claim 22, wherein the one or more systems comprises a loudspeaker.

### Claim 24 (depends on 22, 23)

The system of any of claims 22-23, wherein the signal is one or more of periodic and quasi-periodic.

### Claim 25 (depends on 23, 24)

The system of any of claims 23-24, wherein the signal comprises a digital signal, an analog signal, or a partially digital, partially analog signal.

### Claim 26 (depends on 24, 25)

The system of any of claims 24-25, wherein the signal is an audio signal.

### Claim 27 (depends on 22, 23, 24, 25, 26)

The system of any of claims 22-26, wherein the signal is pre-recorded.

### Claim 28 (depends on 22, 23, 24, 25, 26, 27)

The system of any of claims 22-27, wherein the signal is live.

### Claim 29 (depends on 22, 23, 24, 25, 26, 27, 28)

The system of any of claims 22-28, wherein the signal comprises one or more of speech and music.

### Claim 30 (depends on 22, 23, 24, 25, 26, 27, 28, 29)

The system of any of claims 22-29, wherein removing reverberation from the signal by filtering the signal comprises the processor executing computer-readable instructions to use an adaptive filter for the removal of reverberation from the signal.

### Claim 31 (depends on 22, 23, 24, 25, 26, 27, 28, 29, 30)

The system of any of claims 22-30, wherein the processor executing computer-readable instructions to determine the error comprises the processor executing computer-readable instructions to determine the error from the cross-correlations among the overtone signal components with an adaptive filter tuning scheme.

### Claim 32 (depends on 22, 23, 24, 25, 26, 27, 28, 29, 30, 31)

The system of any of claims 22-31, wherein the processor executing computer-readable instructions to maximize cross-correlations of the overtones based on the error comprises the processor executing computer-readable instructions to adjust one or more coefficients of the adaptive filter.

### Claim 33 (depends on 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32)

The system of any of claims 22-32, the processor executing computer-readable instructions to track the overtones of the signal comprises the processor executing computer-readable instructions to track multiple overtones simultaneously using a Short Time Fourier Transform.

### Claim 34 (depends on 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33)

The system of any of claims 22-33, wherein the processor executing computer-readable instructions to track the overtones of the signal comprises the processor executing computer-readable instructions to isolate the overtones of the signal.

### Claim 35 (depends on 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34)

The system of any of claims 23-34, wherein the processor executing computer-readable instructions to isolate the overtones of the signal comprises the processor executing computer-readable instructions to determine an instantaneous frequency and amplitude of the overtones of the signal.

### Claim 36 (depends on 34, 35)

The system of any of claims 34-35, further comprising a bank of filters, wherein the isolating the overtones of the signal is performed by the bank of filters.

### Claim 37 (depends on 36)

The system of claim 36, wherein the bank of filters comprise one or more of lowpass, highpass, and bandpass filters.

### Claim 38 (depends on 36, 37)

The system of any of claims 36-37, wherein the bank of filters are analog, digital, or partially analog, partially digital filters.

### Claim 39 (depends on 34, 35, 36, 37, 38)

The system of any of claims 34-38, wherein the processor executing computer-readable instructions to isolate the overtones of the signal comprises the processor executing computer-readable instructions to isolate the overtones of the signal by a heterodyne detection method.

### Claim 40 (depends on 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38)

The system of any of claims 22-38, wherein the processor executing computer-readable instructions to determine if the cross-correlation of the overtones of the signal comprises the processor executing computer-readable instructions to determine if the cross-correlation of the overtones of the signal is in an analog domain, a digital domain, or a partially analog, partially digital domain.

### Claim 41 (depends on 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40)

The system of any of claims 22-40, wherein the processor executing computer-readable instructions to remove reverberation from the signal by filtering the signal based on the determined error to maximize the cross correlations of the overtones comprises the processor executing computer-readable instructions to find an inverse filter.

### Claim 42

A non-transitory computer-readable medium having computer-executable instructions stored thereon, said computer-readable instructions for removal of reverberation from a signal by:
tracking overtones of the signal;
determining cross-correlations of the overtones of the signal;
determining an error associated with the cross-correlations of the overtones of the signal; and
removing reverberation from the signal by filtering the signal based on the determined error to maximize the cross correlations of the overtones.

### Claim 43 (depends on 42)

The computer-readable medium of claim 42, further comprising providing the filtered signal to one or more systems.

### Claim 44 (depends on 42, 43)

The computer-readable medium of claim 42-43, wherein the one or more systems comprises a loudspeaker system.

### Claim 45 (depends on 43, 44)

The computer-readable medium of any of claims 43-44, wherein the signal is one or more of periodic and quasi-periodic.

### Claim 46 (depends on 42, 43, 44, 45)

The computer-readable medium of any of claims 42-45, wherein the signal comprises a digital signal, an analog signal, or a partially digital, partially analog signal.

### Claim 47 (depends on 42, 43, 44, 45, 46)

The computer-readable medium of any of claims 42-46, wherein the signal is an audio signal.

### Claim 48 (depends on 42, 43, 44, 45, 46, 47)

The computer-readable medium of any of claims 42-47, wherein the signal is pre-recorded.

### Claim 49 (depends on 42, 43, 44, 45, 46, 47, 48)

The computer-readable medium of any of claims 42-48, wherein the signal is live.

### Claim 50 (depends on 42, 43, 44, 45, 46, 47, 48, 49)

The computer-readable medium of any of claims 42-49, wherein the signal comprises one or more of speech and music.

### Claim 51 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50)

The computer-readable medium of any of claims 42-50, wherein removing reverberation from the signal by filtering the signal comprises using an adaptive filter for the removal reverberation from the signal.

### Claim 52 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51)

The computer-readable medium of any of claims 42-51, wherein the determining the error is performed from the cross-correlations among the overtone signal components with an adaptive filter tuning scheme.

### Claim 53 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52)

The computer-readable medium of any of claims 42-52, wherein maximizing cross-correlations of the overtones based on the error is performed by adjusting one or more coefficients of the adaptive filter.

### Claim 54 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53)

The computer-readable medium of any of claims 42-53, wherein tracking the overtones of the signal comprises tracking multiple overtones simultaneously using a Short Time Fourier Transform.

### Claim 55 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54)

The computer-readable medium of any of claims 42-54, wherein tracking the overtones of the signal comprises isolating the overtones of the signal.

### Claim 56 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55)

The computer-readable medium of any of claims 42-55, wherein tracking the overtones of the signal comprises determining an instantaneous frequency and amplitude of the overtones of the signal.

### Claim 57 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56)

The computer-readable medium of any of claims 42-56, wherein the tracking of the overtones involves isolating the overtones of the signal being performed by a bank of filters.

### Claim 58 (depends on 57)

The computer-readable medium of claim 57, wherein the bank of filters comprise one or more of highpass, lowpass, and bandpass filters.

### Claim 59 (depends on 57, 58)

The computer-readable medium of any of claims 57-58, wherein the bank of filters are analog, digital, or partially analog, partially digital filters.

### Claim 60 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59)

The computer-readable medium of any of claims 42-59, wherein the tracking the overtones of the signal is performed by a heterodyne detection method.

### Claim 61 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60)

The computer-readable medium of any of claims 42-60, wherein determining the cross-correlation of the overtones of the signal comprises determining if the cross-correlation of the overtones of the signal is in an analog domain, a digital domain, or a partially analog, partially digital domain.

### Claim 62 (depends on 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61)

The computer-readable medium of any of claims 42-61, wherein removing reverberation from the signal by filtering the signal based on the determined error to maximize the cross correlations of the overtones comprises finding an inverse filter.
