Back to results
US 10,593,087 B2Granted
System and method for generating emoji mashups with machine learning
AssigneePaypal, Inc.
InventorsTitus Woo, Wei Ting Kuo, Xueguang Lu, Venkatesh Komma
Life of this patent
Estimating the term…
Abstract
Aspects of the present disclosure involve systems, methods, devices, and the like for emoji mashup generation. The system and method introduce a method and model that can generate emoji mashups representative of contextual information received by a user at an application. The emoji mashup may come in the form of two or more emojis coherently combined to represent the contextual idea or emotion being conveyed.
Claims20
A system comprising:
- a non-transitory memory storing instructions;
- and
- one or more hardware processors coupled to the non-transitory memory and configured to read the instructions from the non-transitory memory to cause the system to perform operations comprising:
- receiving, over a network connection, user input text from a user device;
- analyzing using a first learning model, the user input text;
- extracting, based on the analyzing, an emoji sequence related to the user input text;
- processing, using a second learning model, the emoji sequence to obtain coordinate information for each emoji in the emoji sequence, wherein the processing comprises:
- determining a coordinate center for the each emoji in the emoji sequence, and
- determining a scale for the each emoji in the emoji sequence, wherein the coordinate information comprises at least the coordinate center and the scale for the each emoji in the emoji sequence;
- and
- combining at least two of the emojis in the emoji sequence using the coordinate information and an emoji positioning model generated based on user feedback for combining the emoji sequence, wherein the combining comprises:
- determining, using the emoji positioning model, a relative position of each of the at least two of the emojis to other one(s) of the at least two of the emojis based on the coordinate information and the user feedback associated with the at least two of the emojis;
- and
- placing the each of the at least two of the emojis together in an emoji mashup based on the relative position(s).
11 more elements
A method comprising:
- receiving, over a network connection, text data from a user device;
- analyzing the text data;
- extracting, based on the analyzing, an emoji sequence related to the text data;
- processing the emoji sequence to obtain coordinate information for each emoji in the emoji sequence, wherein the processing comprises:
- determining a coordinate center for the each emoji in the emoji sequence, and
- determining a scale for the each emoji in the emoji sequence, wherein the coordinate information comprises at least the coordinate center and the scale for the each emoji in the emoji sequence;
- and
- combining at least two of the emojis in the emoji sequence using the coordinate information and an emoji positioning model generated based on user feedback for combining the emoji sequence, wherein the combining comprises:
- determining, using the emoji positioning model, a position of each of the at least two of the emojis relative to other one(s) of the at least two of the emojis based on the coordinate information and the user feedback associated with the at least two of the emojis;
- and
- placing the each of the at least two of the emojis together in an emoji mashup based on the position of the each of the at least two of the emojis.
8 more elements
A non-transitory machine-readable medium having stored thereon machine readable instructions executable to cause a machine to perform operations comprising:
- receiving, over a network connection, user input text from a user device;
- analyzing the user input text;
- extracting, based on the analyzing, an emoji sequence related to the user input text;
- processing the emoji sequence to obtain coordinate information for each emoji in the emoji sequence, wherein the processing comprises:
- determining a coordinate center for the each emoji in the emoji sequence, and
- determining a scale for the each emoji in the emoji sequence, wherein the coordinate information comprises at least the coordinate center and the scale for the each emoji in the emoji sequence;
- and
- combining at least two of the emojis in the emoji sequence using the coordinate information and an emoji positioning model generated based on user feedback for combining the emoji sequence, wherein the combining comprises:
- determining, using the emoji positioning model, a relative position of each of the at least two of the emojis to other one(s) of the at least two of the emojis based on the coordinate information and the user feedback associated with the at least two of the emojis;
- and
- merging the each of the at least two of the emojis in an emoji mashup based on the relative position(s).
8 more elements
Dependencies are inferred from the claim text.