# US 11,307,880 B2 · Assisting users with personalized and contextual communication content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,307,880 B2 - Document ID: US11307880B2 - Status: Granted - Kind: B2 - Application number: 16/996,196 - Filed: 2020-08-18 - Published: 2020-12-03 - Granted: 2022-04-19 - Earliest claimed: 2018-04-20 - Assignees: Meta Platforms, Inc. - Applicants: Meta Platforms, Inc. - Inventors: Scott Martin - Web page: https://patentgrep.com/patent/US11307880B2 ## CPC - G06Q 10/00: Administration; Management - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0237: {using prediction or retrieval techniques} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 7/14: Merging, i.e. combining at least two sets of record carriers each arranged in the same ordered sequence to produce a single set having the same ordered sequence - G06F 8/31: {Programming languages or programming paradigms} - G06F 9/44505: {Configuring for program initiating, e.g. using registry, configuration files} - G06F 9/4451: {User profiles; Roaming} - G06F 9/453: {Help systems} - G06F 16/176: Support for shared access to files; File sharing support - G06F 16/2255: {Hash tables} - G06F 16/2365: {Ensuring data consistency and integrity} - G06F 16/243: {Natural language query formulation} - G06F 16/24552: {Database cache management} - G06F 16/24575: {using context} - G06F 16/24578: {using ranking} - G06F 16/248: Presentation of query results - G06F 16/285: {Clustering or classification} - G06F 16/3322: {using system suggestions (G06F16/3325 takes precedence)} - G06F 16/3323: {using document space presentation or visualization, e.g. category, hierarchy or range presentation and selection} - G06F 16/3329: Natural language query formulation - G06F 16/3344: {using natural language analysis} - G06F 16/338: Presentation of query results - G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums} - G06F 16/90332: {Natural language query formulation or dialogue systems} - G06F 16/90335: {Query processing} - G06F 16/9038: Presentation of query results - G06F 16/904: Browsing; Visualisation therefor (for navigating the web G06F16/954; browsing optimisation for the web G06F16/957) - G06F 16/951: Indexing; Web crawling techniques - G06F 16/9532: Query formulation - G06F 16/9535: Search customisation based on user profiles and personalisation - G06F 18/2411: based on the proximity to a decision surface, e.g. support vector machines - G06F 18/2414: {Smoothing the distance, e.g. radial basis function networks [RBFN]} - G06F 40/205: Parsing - G06F 40/274: Converting codes to words; Guess-ahead of partial word inputs - G06F 40/295: Named entity recognition - G06F 40/30: Semantic analysis - G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30) - G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO] - G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] - G06N 3/045: Combinations of networks - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/08: Learning methods - G06N 3/09: Supervised learning - G06N 5/022: Knowledge engineering; Knowledge acquisition - G06N 5/027: {Frames} - G06N 20/00: Machine learning - G06Q 10/42: Determination of affinities or common interests between users - G06Q 10/48: using social graphs - G06V 10/82: using neural networks - G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) - G06V 40/172: {Classification, e.g. identification} - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit - G10L 15/063: {Training} - G10L 15/07: to the speaker - G10L 15/16: using artificial neural networks - G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning} - G10L 15/1822: {Parsing for meaning understanding} - G10L 15/183: using context dependencies, e.g. language models - G10L 15/187: Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G10L 17/06: Decision making techniques; Pattern matching strategies - G10L 17/22: Interactive procedures; Man-machine interfaces - H04L 12/2816: {Controlling appliance services of a home automation network by calling their functionalities (arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00)} - H04L 41/20: {Network management software packages} - H04L 41/22: comprising specially adapted graphical user interfaces [GUI] - H04L 43/0882: Utilisation of link capacity - H04L 43/0894: Packet rate - H04L 51/02: using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages - H04L 51/216: Handling conversation history, e.g. grouping of messages in sessions or threads - H04L 51/52: for supporting social networking services - H04L 63/102: {Entity profiles} - H04L 67/306: User profiles - H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)} - H04L 67/5651: Reducing the amount or size of exchanged application data - H04L 67/75: Indicating network or usage conditions on the user display - H04W 12/08: Access security - G06F 2216/13: Prefetching - G10L 13/00: Speech synthesis; Text to speech systems - G10L 13/04: Details of speech synthesis systems, e.g. synthesiser structure or memory management - G10L 17/00: Speaker identification or verification techniques - G10L 2015/223: {Execution procedure of a spoken command} - G10L 2015/225: {Feedback of the input speech} - H04L 51/046: Interoperability with other network applications or services - H04L 51/222: using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area - H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) - H04L 67/53: using third party service providers - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract In one embodiment, a method includes receiving a first user input by a first user at a client system associated with the first user, wherein the first user input is associated with a first language register, selecting a first language-register model from a plurality of language-register models based on the first language register by the client system, wherein the plurality of language-register models are each personalized with respect to the first user, and presenting a personalized first communication content generated based on the selected first language-register model at the client system. ## Claims ### Claim 1 A method comprising: receiving, at a client system associated with a first user, a first user input by the first user, wherein the first user input is associated with a first language register; selecting, by the client system, a first language-register model from a plurality of language-register models based on the first language register, wherein the plurality of language-register models are each personalized with respect to the first user; and presenting, at the client system, a personalized first communication content generated based on the selected first language-register model. ### Claim 2 (depends on 1) The method of claim 1, further comprising: identifying, by the client system, an intent and one or more slots associated with the first user input; determining, by the client system, an action based on the identified intent; executing, by the client system, the action to retrieve information associated with the one or more slots from one or more information sources; accessing, by the client system, a plurality of language-generation templates stored in a data store, wherein each language-generation template comprises one or more slots corresponding to the one or more slots associated with the first user input; and selecting, by the client system, a language-generation template from the plurality of language-generation templates based on the identified intent. ### Claim 3 (depends on 2) The method of claim 2, wherein the one or more information sources comprise one or more of: one or more first-party agents; or one or more third-party agents. ### Claim 4 (depends on 2) The method of claim 2, wherein the personalized first communication content is generated further based on the retrieved information and the selected language-generation template. ### Claim 5 (depends on 4) The method of claim 4, further comprising generating the personalized first communication content, wherein the generation comprises: generating, by the client system, a list of candidate words based on the identified language register and the retrieved information; pruning, by the client system, the list of candidate words; and inserting, from the pruned list of candidate words, one of the candidate words into each slot of the selected language-generation template by the client system. ### Claim 6 (depends on 1) The method of claim 1, wherein the first user input is associated with a current dialog session, wherein the method further comprises: receiving, at the client system, a second user input by the first user, wherein the second user input is associated with the current dialog session; identifying, by the client system, a second language register associated with the first user based on the second user input; selecting a second language-register model from the plurality of language-register models based on the identified second language register; and generating a personalized second communication content responsive to the second user input, wherein the personalized second communication content is based on the selected second language-register model. ### Claim 7 (depends on 1) The method of claim 1, further comprising: identifying, by the client system, the first language register based on a machine-learning model. ### Claim 8 (depends on 1) The method of claim 1, wherein the first user is in a current dialog session with a second user, and wherein the current dialog session comprises a message thread between the first user and the second user. ### Claim 9 (depends on 8) The method of claim 8, wherein the personalized first communication content is operable to allow the first user to select the personalized first communication content, wherein the method further comprises: receiving, at the client system, a selection of the personalized first communication content from the first user; and inserting, by the client system, the personalized first communication content in the message thread between the first user and the second user. ### Claim 10 (depends on 1) The method of claim 1, wherein the first user is in a current dialog session with an assistant xbot, and wherein the current dialog session comprises a message thread between the first user and the assistant xbot. ### Claim 11 (depends on 10) The method of claim 10, further comprising: inserting, by the client system, the personalized first communication content in the message thread between the first user and the assistant xbot. ### Claim 12 (depends on 1) The method of claim 1, wherein the first user input comprises one or more of: a character string; an audio clip; an image; or a video. ### Claim 13 (depends on 1) The method of claim 1, wherein the personalized first communication content comprises one or more of: a character string; an audio clip; an image; or a video. ### Claim 14 (depends on 1) The method of claim 1, wherein the plurality of language-register models are trained based on a word-embedding model. ### Claim 15 (depends on 14) The method of claim 14, wherein the word-embedding model is based on convolutional neural network. ### Claim 16 (depends on 1) The method of claim 1, wherein each language-register model is trained based on a plurality of training samples associated with the first user, the training samples comprising one or more of news feed posts, news feed comments, a user profile, or messages. ### Claim 17 (depends on 16) The method of claim 16, wherein the plurality of training samples are associated with one or more groups corresponding to one or more criteria, wherein the one or more criteria comprise one or more of age, relationship, location, education, interest, or native language, and wherein each group is associated with a language-register model for the group. ### Claim 18 (depends on 1) The method of claim 1, further comprising identifying the first language register, wherein the identifying comprises: generating, by the client system, a first feature vector representing the first user input; accessing, by the client system, a plurality of second feature vectors representing the plurality of language registers stored in a data store; calculating, by the client system, a plurality of similarity scores between the first feature vector and the respective second feature vector; and identifying, by the client system, the first language register based on the plurality of similarity scores. ### Claim 19 One or more computer-readable non-transitory storage media embodying software that is operable when executed to: receive, at a client system associated with a first user, a first user input by the first user, wherein the first user input is associated with a first language register; select, by the client system, a first language-register model from a plurality of language-register models based on the first language register, wherein the plurality of language-register models are each personalized with respect to the first user; and present, at the client system, a personalized first communication content generated based on the selected first language-register model. ### Claim 20 A system comprising: one or more processors; and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to: receive, at a client system associated with a first user, a first user input by the first user, wherein the first user input is associated with a first language register; select, by the client system, a first language-register model from a plurality of language-register models based on the first language register, wherein the plurality of language-register models are each personalized with respect to the first user; and present, at the client system, a personalized first communication content generated based on the selected first language-register model.