Method and system for providing personalized multimodal objects in real time

An electronic device for providing personalized multimodal objects, the electronic device comprising:

• a memory for storing instructions;
• and
• at least one processor configured to execute the stored instructions to at least:
• obtain a text input through at least one application installed in the electronic device;
• determine an intent of a user of the electronic device based on the text input;
• obtain a query by correlating the determined intent of the user and contextual data;
• based on the query, perform a search in a database to generate a prediction of a plurality of multimodal objects based on the determined intent of the user and the contextual data, wherein the database comprises multimodal data related to ideographs, one or more applications configured in the electronic device and one or more internet of things (IoT) devices connected to the electronic device, and wherein the plurality of multimodal objects are predicted using one or more deep neural network (DNN) techniques and a document term matrix (DTM) stored in the database, the DTM comprising the ideographs and mapping of the ideographs with metadata description corresponding to the ideographs;
• in response to the search, rank the plurality of multimodal objects predicted based on at least one of the contextual data and user preferences;
• and
• based on the ranking, display multimodal objects related to the text input among the predicted plurality of multimodal objects, the displayed multimodal objects comprising a first object indicating an image or text and a second object indicating a list of items associated with the one or more IoT devices.

A non-transitory computer readable medium containing instructions that when executed cause a processor to:

• obtain a text input through at least one application installed in an electronic device;
• determine an intent of a user of the electronic device based on the text input;
• obtain a query by correlating the determined intent of the user and contextual data;
• based on the query, perform a search in a database to generate a prediction of a plurality of multimodal objects based on the determined intent of the user and the contextual data, wherein the database comprises multimodal data related to ideographs, one or more applications configured in the electronic device and one or more internet of things (IoT) devices connected to the electronic device, and wherein the plurality of multimodal objects are predicted using one or more deep neural network (DNN) techniques and a document term matrix (DTM) stored in the database, the DTM comprising the ideographs and mapping of the ideographs with metadata description corresponding to the ideographs;
• in response to the search, rank the plurality of multimodal objects predicted based on at least one of the contextual data and user preferences;
• and
• based on the ranking, display multimodal objects related to the text input among the predicted plurality of multimodal objects, the displayed multimodal objects comprising a first object indicating an image or text and a second object indicating a list of items associated with the one or more IoT devices.