# US 2026/0075014 A1 · Artificial intelligence-based system and method for generating and recommending personalized graphics for messaging applications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2026/0075014 A1 - Document ID: US20260075014A1 - Status: Published application - Kind: A1 - Application number: 18/829,495 - Filed: 2024-09-10 - Published: 2026-03-12 - Earliest claimed: 2024-09-10 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Shubham AGARWAL; Akshita JAJOO; Rima JAIN - Web page: https://patentgrep.com/patent/US20260075014A1 ## CPC - H04L 51/10: Multimedia information - G06T 11/60: Creating or editing images; Combining images with text - G06V 10/768: {using context analysis, e.g. recognition aided by known co-occurring patterns} - G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames} - G06V 40/174: {Facial expression recognition} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06V 2201/10: Recognition assisted with metadata - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method for generating and recommending graphics for inclusion in messages includes delivering message data to a context determining model of a graphic recommendation system, the context determining model being trained to process message data to identify context data pertaining to at least one of the message, the user, and the message partner. A prompt is generated that includes the context data and instructions for causing a model to generate one or more graphics for inclusion in the message. The graphics are delivered to a graphic recommendation model along with a plurality of predefined graphics of the messaging system to rank the graphics using at least one ranking algorithm and to select a predetermined number of graphics to include in a graphic recommendation for the message based on ranks and delivering the graphic recommendation to the messaging client. ## Claims ### Claim 1 A data processing system for generating and recommending graphics for inclusion in messages in a messaging system, the system comprising: a processor; and a memory in communication with the processor, the memory comprising executable instructions that, when executed by the processor alone or in combination with other processors, cause the data processing system to perform functions of: receiving message data from a messaging client, the message data pertaining to a message between a user associated with the messaging client and a message partner; delivering the message data to a context determining model of a graphic recommendation system, the context determining model being trained to process the message data to extract context data, the context data pertaining to characteristics of the message and at least one of the user and the message partner; constructing a prompt for a graphic generating model of the graphic recommendation system, the prompt including the context data and instructions for causing the graphic generating model to generate one or more graphics for inclusion in the message; delivering the prompt as input to the graphic generating model, the graphic generating model being trained to generate the one or more graphics conditioned on the context data and the instructions; delivering the one or more graphics to a graphic recommendation model of the graphic recommendation system along with a plurality of predefined graphics of the messaging system, the graphic recommendation model being trained to rank the one or more graphics along with the plurality of predefined graphics using at least one ranking algorithm and to select a predetermined number of graphics to include in a graphic recommendation for the message based on ranks of the one or more graphics and the plurality of predefined graphics; and delivering the graphic recommendation to the messaging client for display to the user. ### Claim 2 (depends on 1) The data processing system of claim 1, wherein the executable instructions include instructions that, when executed, cause the data processing system to perform functions of: displaying the graphic recommendation in a user interface of the messaging client and enabling selection of at least one graphic from the graphic recommendation via the user interface; and in response to receiving a selection of the at least one graphic via the user interface, adding the at least one graphic to the message or sending the at least one graphic as a new message to the message partner. ### Claim 3 (depends on 1) The data processing system of claim 1, wherein: the context determining model includes a natural language processing (NLP) model trained to process text of the message data by tokenizing and encoding the text, and the graphic recommendation system includes a user profile dataset that includes user profile information for the user and the message partner, the user profile information being collected during previous message sessions. ### Claim 4 (depends on 1) The data processing system of claim 1, wherein: the context determining model includes at least one artificial intelligence (AI) model trained to process the text of the message to determine at least one message characteristic of the message and at least one user characteristic pertaining to at least one of the user and the message partner, and the context data includes the at least one message characteristic and the at least one user characteristic. ### Claim 5 (depends on 3) The data processing system of claim 3, wherein: the at least one message characteristic includes at least one of: keywords determined by a named entity recognition (NER) model, the NER model being trained to extract entities from the text of the message, the entities corresponding to the keywords; sentiments determined by a sentiment analysis model, the sentiment analysis model being trained to identify and classify emotions in the text of the message, the emotions corresponding to the sentiments; intents determined by an intent detection model, the intent detection model being trained to identify and classify goals in the text of the message, the goals corresponding to the intents; and preferences determined by a topic detection model, the topic detection model being trained to identify topics or themes in the text of the message, the topics or themes corresponding to preferences. ### Claim 6 (depends on 3) The data processing system of claim 3, wherein: the at least one user characteristic includes a persona of the user and the message partner, the persona including at least one of: a message classification of the message; roles of the user and the message partner in the message; relationship between the user and the message partner in the message; status of the user and the message partner in the message; attitude of the user and the message partner in the message; tone of the user and the message partner in the message; style of the message; and purpose of the message. ### Claim 7 (depends on 3) The data processing system of claim 3, wherein: the message includes a video feed; and the at least one user characteristic includes at least one of: an identity of at least one of the user and the message partner in the video feed, the identity of at least one of the user and the message partner being determined using a face recognition model; emotions of the user and message partner in the video feed, the emotions being determined by a facial expression recognition model trained to identify and classify the emotions based on facial expressions of the user and the message partner; poses of the user and the message partner in the video feed, the poses being determined by a pose classification model trained to identify and classify body postures and orientations, the body postures and orientations corresponding to the poses; movements of the user and message partner in the video feed, the movements being determined by a gesture recognition model trained to identify and classify actions performed by the user and the message partner, the actions corresponding to the movements; a location of the user and the message partner in the video feed, the location being determined using a location classification model trained to identify locations based on information in video feeds; and an activity of the user in the video feed, the activity being determined by an activity recognition model trained to identify and classify activities of people in video feeds. ### Claim 8 (depends on 7) The data processing system of claim 7, wherein: the at least one user characteristic includes at least one of: historical and cultural background information of the user, the historical and cultural background information including at least one an age, a gender, an ethnicity, a nationality, a religion, a language, an education, and an occupation of the user, and being determined from at least one of metadata of the message, metadata of the video feed, and previously determined user profile information; and social and emotional dynamics of the user, the social and emotional dynamics of the user being determined from at least one of the metadata of the message, the metadata of the video feed, and the previously determined user profile information. ### Claim 9 (depends on 7) The data processing system of claim 7, wherein to construct the prompt, the executable instructions further include instructions that, when executed, cause the data processing system to perform functions of: including at least one user characteristic in the prompt, the at least one user characteristic including at least one of: the identity determined using the face recognition model; and the emotions determined using the facial expression recognition model. ### Claim 10 A method for generating and recommending graphics for inclusion in messages in a messaging system, the method comprising: receiving message data from a messaging client of the messaging system, the message data pertaining to a message between a user associated with the messaging client and a message partner; delivering the message data to a context determining model of a graphic recommendation system, the context determining model being trained to process message data to identify context data pertaining to at least one of the message, the user, and the message partner; generating a prompt for a graphic generating model of the graphic recommendation system, the prompt including the context data and instructions for causing the graphic generating model to generate one or more graphics for inclusion in the message; delivering the prompt as input to the graphic generating model, the graphic generating model being trained to generate the one or more graphics conditioned on the context data and the instructions; delivering the one or more graphics to a graphic recommendation model of the graphic recommendation system along with a plurality of predefined graphics of the messaging system, the graphic recommendation model being trained to rank the one or more graphics along with the plurality of predefined graphics using at least one ranking algorithm and to select a predetermined number of graphics to include in a graphic recommendation for the message based on ranks of the one or more graphics along and the plurality of predefined graphics; and delivering the graphic recommendation to the messaging client. ### Claim 11 (depends on 10) The method of claim 10, further comprising: displaying the graphic recommendation in a user interface of the messaging client and enabling selection of at least one graphic from the graphic recommendation via the user interface; and in response to receiving a selection of the at least one graphic via the user interface, adding the at least one graphic to the message or sending the at least one graphic as a new message to the message partner. ### Claim 12 (depends on 10) The method of claim 10, wherein: the context determining model includes a natural language processing (NLP) model trained to process text of the message data by tokenizing and encoding the text, and the graphic recommendation system includes a user profile dataset that includes user profile information for the user and the message partner, the user profile information being collected during previous message sessions. ### Claim 13 (depends on 10) The method of claim 10, wherein: the context determining model includes at least one artificial intelligence (AI) model trained to process the text of the message to determine at least one message characteristic of the message and at least one user characteristic pertaining to the user and/or the message partner, and the context data includes the at least one message characteristic and the at least one user characteristic. ### Claim 14 (depends on 13) The method of claim 13, wherein: the at least one message characteristic includes at least one of: keywords determined by a named entity recognition (NER) model, the NER model being trained to extract entities from the text of the message, the entities corresponding to the keywords; sentiments determined by a sentiment analysis model, the sentiment analysis model being trained to identify and classify emotions in the text of the message, the emotions corresponding to the sentiments; intents determined by an intent detection model, the intent detection model being trained to identify and classify goals in the text of the message, the goals corresponding to the intents; and preferences determined by a topic detection model, the topic detection model being trained to identify topics or themes in the text of the message, the topics or themes corresponding to preferences. ### Claim 15 (depends on 13) The method of claim 13, wherein: the at least one user characteristic includes a persona of the user and the message partner, the persona including at least one of: a message classification of the message; roles of the user and the message partner in the message; relationship between the user and the message partner in the message; status of the user and the message partner in the message; attitude of the user and the message partner in the message; tone of the user and the message partner in the message; style of the message; and purpose of the message. ### Claim 16 (depends on 13) The method of claim 13, wherein: the message includes a video feed; and the at least one user characteristic includes at least one of: an identity of at least one of the user and the message partner in the video feed, the identity of at least one of the user and the message partner being determined using a face recognition model; emotions of the user and message partner in the video feed, the emotions being determined by a facial expression recognition model trained to identify and classify the emotions based on facial expressions of the user and the message partner; poses of the user and the message partner in the video feed, the poses being determined by a pose classification model trained to identify and classify body postures and orientations, the body postures and orientations corresponding to the poses; movements of the user and message partner in the video feed, the movements being determined by a gesture recognition model trained to identify and classify actions performed by the user and the message partner, the actions corresponding to the movements; a location of the user and the message partner in the video feed, the location being determined using a location classification model trained to identify locations based on information in video feeds; and an activity of the user in the video feed, the activity being determined by an activity recognition model trained to identify and classify activities of people in video feeds. ### Claim 17 (depends on 16) The method of claim 16, wherein: the at least one user characteristic includes at least one of: historical and cultural background information of the user, the historical and cultural background information including at least one an age, a gender, an ethnicity, a nationality, a religion, a language, an education, and an occupation of the user, and being determined from at least one of metadata of the message, metadata of the video feed, and previously determined user profile information; and social and emotional dynamics of the user, the social and emotional dynamics of the user being determined from at least one of the metadata of the message, the metadata of the video feed, and the previously determined user profile information. ### Claim 18 (depends on 10) The method of claim 10, wherein constructing the prompt further comprises: including at least one user characteristic in the prompt, the at least one user characteristic including at least one of: the identity of at least one of the user the message partner determined using the face recognition model; and the emotions of the user and the message partner determined using the facial expression recognition model. ### Claim 19 A non-transitory computer readable medium on which are stored instructions that, when executed, cause a programmable device to perform functions of: receiving message data from a messaging client of a messaging system, the message data pertaining to a message between a user associated with the messaging client and a message partner; delivering the message data to a context determining model of a graphic recommendation system, the context determining model being trained to process message data to identify context data pertaining to at least one of the message, the user, and the message partner; generating a prompt for a graphic generating model of the graphic recommendation system, the prompt including the context data and instructions for causing the graphic generating model to generate one or more graphics for inclusion in the message; delivering the prompt as input to the graphic generating model, the graphic generating model being trained to generate the one or more graphics conditioned on the context data and the instructions; delivering the one or more graphics to a graphic recommendation model of the graphic recommendation system along with a plurality of predefined graphics of the messaging system, the graphic recommendation model being trained to rank the one or more graphics along with the plurality of predefined graphics using at least one ranking algorithm and to select a predetermined number of graphics to include in a graphic recommendation for the message based on ranks of the one or more graphics along and the plurality of predefined graphics; and delivering the graphic recommendation to the messaging client. ### Claim 20 (depends on 19) The non-transitory computer readable medium of claim 19, wherein the one or more graphics include stickers.