US 11,776,289 B2 · Method and electronic device for predicting plurality of multi-modal drawings

Abstract

Embodiments herein disclose a method and electronic device for predicting multi-modal drawings. The method includes: receiving, by the electronic device, at least one of a text input and strokes of a drawing and determining, by the electronic device, features associated with the text input and features associated with the strokes of the drawing. The method includes classifying, by the electronic device, the features associated with the text input and the features associated with the strokes of the drawing into one of a dominant feature and a non-dominant feature and performing, by the electronic device, early concatenation or late concatenation of the features based on the classification; classifying, by the electronic device, the strokes of the drawing based on the concatenation into a category using a deep neural network (DNN) model; and predicting, by the electronic device, primary drawings corresponding to the category.

Claims16

Dependent claims

A method for predicting multi-modal drawing by an electronic device, wherein the method comprises:

receiving, by the electronic device, at least one of a text input and strokes of a drawing on a screen of the electronic device;
determining, by the electronic device, features associated with the text input and features associated with the strokes of the drawing;
classifying, by the electronic device, the features associated with the text input and the features associated with the strokes of the drawing into one of a dominant feature and a non-dominant feature;
performing, by the electronic device, concatenation of the features associated with the text input and the features associated with the strokes of the drawing based on the classification;
classifying, by the electronic device, the strokes of the drawing based on the concatenation into at least one category using a deep neural network (DNN) model;
and
predicting, by the electronic device, a plurality of primary drawings corresponding to the at least one category.

4 more elements

An electronic device configured to predict multi-modal drawing, wherein the electronic device comprises:

a memory;
a processor coupled to the memory;
a communicator comprising communication circuitry coupled to the memory (120) and the processor;
a drawing management controller coupled to the memory, the processor and the communicator, and configured to:
receive at least one of a text input and strokes of a drawing on a screen of the electronic device,
determine features associated with the text input and features associated with the strokes of the drawing;
classify the features associated with the text input and the features associated with the strokes of the drawing into one of a dominant feature and a non-dominant feature;
perform concatenation of the features associated with the text input and the features associated with the strokes of the drawing based on the classification;
classify the strokes of the drawing based on the concatenation into at least one category using a deep neural network (DNN) model;
and
predict a plurality of primary drawings corresponding to the at least one category.

8 more elements

Dependencies are inferred from the claim text.

Method and electronic device for predicting plurality of multi-modal drawings

Life of this patent

Method and electronic device for predicting plurality of multi-modal drawings

Life of this patent

Abstract

Claims16