# US 2004/0083100 A1 · System and method for characterizing voiced excitations of speech and acoustic signals, removing acoustic noise from speech, and synthesizing speech

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0083100 A1
- Document ID: US20040083100A1
- Status: Published application
- Kind: A1
- Application number: 10/682,786
- Filed: 2003-10-08
- Published: 2004-04-29
- Earliest claimed: 1996-02-06
- Assignees: The Regents of the University of California
- Inventors: Greg C. Burnett; John F. Holzrichter; Lawrence C. Ng
- Web page: https://patentgrep.com/patent/US20040083100A1

## CPC

- A61B 5/0507: using microwaves or terahertz waves
- G06F 18/256: {of results relating to different input data, e.g. multimodal recognition}
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G10L 13/04: Details of speech synthesis systems, e.g. synthesiser structure or memory management
- G10L 15/24: Speech recognition using non-acoustical features
- A61B 5/7257: {using Fourier transforms}
- G01N 2291/02491: Materials with nonlinear acoustic properties
- G01N 2291/02872: Pressure
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

The present invention is a system and method for characterizing human (or animate) speech voiced excitation functions and acoustic signals, for removing unwanted acoustic noise which often occurs when a speaker uses a microphone in common environments, and for synthesizing personalized or modified human (or other animate) speech upon command from a controller. A low power EM sensor is used to detect the motions of windpipe tissues in the glottal region of the human speech system before, during, and after voiced speech is produced by a user. From these tissue motion measurements, a voiced excitation function can be derived. Further, the excitation function provides speech production information to enhance noise removal from human speech and it enables accurate transfer functions of speech to be obtained. Previously stored excitation and transfer functions can be used for synthesizing personalized or modified human speech. Configurations of EM sensor and acoustic microphone systems are described to enhance noise cancellation and to enable multiple articulator measurements.

## Claims

### Claim 1

A method for removing acoustic noise from an acoustic speech signal, comprising the steps of:
selecting a first set of acoustic speech time frames with timing defined by an excitation function determined using an EM sensor;
characterizing qualities of an acoustic noise signal over a second set of time frames with timing defined by an excitation function determined using the EM sensor and by using the acoustic speech signal over said second set of time frames;
constructing an acoustic noise filter appropriate to the acoustic speech signal over the first set of time frames and to the characterized noise signal over the second set of time frames; and
filtering the acoustic noise signal from the acoustic speech signal over the first set of time frames using the acoustic noise filter.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the characterizing step includes the step of characterizing the qualities of the acoustic noise signal over the first set of time frames; and
the constructing step includes the step of constructing the acoustic noise filter using both acoustic speech signal and noise signal information over the first set of time frames.

### Claim 3 (depends on 1)

The method of claim 1 wherein the characterizing step includes the step of characterizing the qualities of the acoustic noise signal over a predetermined portion of a no-speech time period.
