US 7,467,089 B2Granted

Combined speech and handwriting recognition

OwnerDaniel L. Roth, Edward W. Porterinventors

Life of this patent

Estimating the term…

Loading patent…

Abstract

The invention relates to the combination of speech recognition with handwriting and/or character recognition. This includes the innovation of selecting one or more best-scoring recognition candidates as a function of recognition of both handwritten and spoken representations of a sequence of one or more words to be recognized. It also includes the innovation of using character or handwriting recognition of one or more letters to alphabetically filter speech recognition of one or more words. It also includes the innovations of using speech recognition of one or more letter-identifying words to alphabetically filter handwriting recognition, and of using speech recognition to correct handwriting recognition of one or more words.

Claims24

Dependent claims

A method of word recognition comprising:

receiving a given spoken representation of a given sequence of one or more words to be recognized;
in association with said given spoken representation, receiving a filtering input consisting of handwriting input;
using handwriting recognition to define a filter representing one or more filtering sequences of characters selected by said recognition as most likely corresponding to said filtering input;
and
using a combination of said filter and speech recognition performed on said given spoken representation to select one or more recognition candidates, each consisting of a sequence of one or more words, selected as a function of the closeness of their match against the given spoken representation and whether or not they match one of the one or more filtering character sequences associated with said filter, where a recognition candidate matches a given filtering sequence if the candidate starts with the same sequence of one or more characters as said filtering sequence, independently of whether the candidate contains more characters than the given filtering sequence.

2 more elements

A method of word recognition comprising:

receiving a handwritten representation of a given sequence of one or more words to be recognized;
in association with said handwritten representation, receiving a filtering input consisting of one or more utterances representing a sequence of one or more letter identifying words;
using speech recognition to define a filter representing one or more filtering sequences of characters selected by said recognition as most likely corresponding to said filtering input;
and
using a combination of said filter and handwriting recognition performed on said handwritten representation to select one or more recognition candidates, each consisting of a sequence of one or more words, selected as a function of the closeness of their match against the handwritten representation and whether or not they match one of the one or more filtering character sequences associated with said filter, where a recognition candidate matches a given filtering sequence if the candidate starts with the same sequence of one or more characters as said filtering sequence, independently of whether the candidate contains more characters than given filtering sequence.

2 more elements

Dependencies are inferred from the claim text.

Facts

Application: 11/005,633Filed 5 Dec 2004 · continuation in part
Priority: 5 Sep 2001
Published: US 2005/0159948 A121 Jul 2005
Granted: 16 Dec 2008
Term ends: Not estimatedThe source records don’t support an estimate.

Classification3 codes

G10L 15/22
Speech recognition: procedures used during a speech recognition process, e.g. man-machine dialogue
G10L 15/19
Using context dependencies, e.g. language models: grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
G10L
Speech analysis techniques or speech synthesis

Family

Application60/317,333Us provisional application · filed 5 Sep 2001
Application60/317,433Us provisional application · filed 5 Sep 2001
Application60/317,431Us provisional application · filed 5 Sep 2001
Application60/317,329Us provisional application · filed 5 Sep 2001
Application60/317,330Us provisional application · filed 5 Sep 2001
Application60/317,331Us provisional application · filed 5 Sep 2001
Application60/317,423Us provisional application · filed 5 Sep 2001
Application60/317,422Us provisional application · filed 5 Sep 2001
Application60/317,421Us provisional application · filed 5 Sep 2001
Application60/317,430Us provisional application · filed 5 Sep 2001
Application60/317,432Us provisional application · filed 5 Sep 2001
Application60/317,435Us provisional application · filed 5 Sep 2001
Application60/317,434Us provisional application · filed 5 Sep 2001
Application10/302,053Parent of this continuation-in-part · filed 5 Sep 2002
Application10/227,653Parent of this continuation-in-part · filed 6 Sep 2002
US 2005/0159948 A1Pre-grant publication · published 21 Jul 2005
US 7,225,130 B2Parent of this continuation-in-part
US 2004/0049388 A1Published application
US 2004/0267528 A9Published application
US 7,467,089 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key