Generating predicted ink stroke information using text-based semantics
AssigneeMicrosoft Technology Licensing, LLC
InventorsSteven N. BATHICHE, Moshe R. LUTZ
Life of this patent
Estimating the term…
Abstract
In some examples, systems and methods for generating predicted ink strokes, using text-based semantics, are provided. Ink stroke data may be received, the ink stroke data may be input into a first model, and text data may be received from the first model. The text data may correspond to the ink stroke data. The text data and a semantic context may be input into a second model. A predicted ink stroke may be determined, from the second model. Further, an indication of the predicted ink stroke may be generated.
Claims20
A system for generating predicted ink strokes comprising:
- at least one processor;
- memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations, the set of operations comprising:
- receiving ink stroke data;
- inputting the ink stroke data into a first model;
- receiving text data from the first model, the text data corresponding to the ink stroke data, and the text data comprising a partial word, phrase, or sentence;
- inputting the text data and a semantic context into a second model;
- determining, from the second model, a predicted ink stroke, the predicted ink stroke completing the partial word, phrase, or sentence based on the semantic context;
- and
- generating an indication of the predicted ink stroke.
A system for generating predicted ink strokes comprising:
- at least one processor;
- memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations, the set of operations comprising:
- receiving ink stroke data;
- inputting the ink stroke data into a model;
- receiving text data from the model, the text data corresponding to the ink stroke data, and the text data comprising a partial word, phrase, or sentence;
- determining, from the text data and a semantic context, a plurality of predicted ink strokes, the plurality of predicted ink strokes completing the partial word, phrase, or sentence based on the semantic context;
- and
- generating a plurality of indications corresponding to the plurality of predicted ink strokes.
A method for generating predicted ink strokes, the method comprising:
- receiving ink stroke data;
- inputting the ink stroke data into a first trained machine-learning model;
- receiving text data from the first trained machine-learning model, the text data corresponding to the ink stroke data;
- inputting the text data and a semantic context into a second trained machine-learning model;
- determining, from the second trained machine-learning model, a predicted text;
- inputting the predicted text into a third trained machine-learning model;
- determining, from the third trained machine-learning model, predicted ink stroke data corresponding to the predicted text;
- and
- displaying an indication of the predicted ink stroke data.
Dependencies are inferred from the claim text.