US 12,608,544 B2 · System and method for automatic language detection for handwritten text

Abstract

Methods for automatic language detection for handwritten text are performed by systems and devices. Such automatic language detection is performed prior to sending representations of the handwritten text to a language recognition engine. Handwritten inputs including one or more writing strokes are received from an input interface, and are associated with coordinates of the inputs and times that the inputs are made. The handwritten inputs are grouped into words based on the coordinates and times. Writing strokes are normalized, and then the words are individually transformed to generate language vectors, such as through a recurrent neural network. The language vectors are used to determine language probabilities for the handwritten inputs. Based on the language probabilities, the handwritten inputs are provided to a specific language recognition engine to determine the language thereof prior to translation or transcription.

Claims20

Dependent claims

A language detection system comprising:

a processing system comprising one or more processors;
and
a memory configured to store program code to be executed by the one or more processors, the program code including:
an input analyzer configured to:
receive handwritten inputs from an input interface, the handwritten inputs including one or more writing strokes;
associate the handwritten inputs with sets of coordinate-time pairs, wherein said sets of coordinate-time pairs represent at least one or more times when the strokes were made;
and
group the handwritten inputs into words based at least on the sets of coordinate-time pairs;
a detection manager configured to:
normalize the one or more writing strokes that correspond to the words to generate normalized words;
transform the normalized words individually to generate language vectors for the normalized words;
and
determine at least one language probability based at least on the language vectors;
and
an engine selector configured to:
select a specific language recognition engine from a plurality of language recognition engines based at least on the at least one language probability;
and
provide the handwritten inputs to the selected specific language recognition engine to recognize the handwritten inputs.

15 more elements

A computer-implemented method for language detection, the method comprising:

receiving handwritten inputs from an input interface, the handwritten inputs including one or more writing strokes;
grouping the handwritten inputs into words based at least on sets of coordinate-time pairs corresponding to the handwritten inputs, wherein said sets of coordinate-time pairs represent at least one or more times when the strokes were made;
transforming the words individually to generate language vectors for the words;
determining at least one language probability based at least on the language vectors;
based at least on the at least one language probability, selecting a specific language recognition engine from a plurality of language recognition engines corresponding to different languages;
and
providing the handwritten inputs to the selected specific language recognition engine to recognize the handwritten inputs.

4 more elements

A computer-readable storage medium having program instructions recorded thereon that, when executed by a processing device, perform a method for language detection, the method comprising:

receiving handwritten inputs that include one or more writing strokes;
grouping the handwritten inputs into words based at least on sets of coordinate-time pairs corresponding to the handwritten inputs, wherein said sets of coordinate-time pairs represent at least one or more times when the strokes were made;
transforming the words individually to generate language vectors for the words;
determining at least one language probability based at least on the language vectors;
selecting a specific language recognition engine from a plurality of language recognition engines based at least on the at least one language probability;
and
providing the handwritten inputs to a specific language recognition engine to recognize the handwritten inputs.

4 more elements

Dependencies are inferred from the claim text.

System and method for automatic language detection for handwritten text

Life of this patent

System and method for automatic language detection for handwritten text

Life of this patent

Abstract

Claims20