Back to results
US 10,853,987 B2Granted
Generating cartoon images from photos
AssigneeGoogle Inc.
InventorsAaron Sarna, Dilip Krishnan, Forrester Cole, Inbar Mosseri
Life of this patent
Estimating the term…
Abstract
A system and method for generating cartoon images from photos are described. The method includes receiving an image of a user, determining a template for a cartoon avatar, determining an attribute needed for the template, processing the image with a classifier trained for classifying the attribute included in the image, determining a label generated by the classifier for the attribute, determining a cartoon asset for the attribute based on the label, and rendering the cartoon avatar personifying the user using the cartoon asset.
Claims20
A computer-implemented method comprising:
- receiving, using one or more computing devices, an image of a user;
- determining, using the one or more computing devices, a template for an avatar;
- determining, based on the image of the user and using the one or more computing devices, attributes needed for the template, wherein the attributes include a plurality of facial attributes;
- processing, using the one or more computing devices, the image with a respective classifier trained to generate a corresponding label that corresponds to a value of each of the attributes, wherein each classifier is coupled to a selected layer of a pre-trained neural network model and wherein the selected layer of the pre-trained neural network model is selected by determining that the selected layer provides discrimination for a corresponding attribute;
- determining, using the one or more computing devices, a set of assets for the avatar based on labels;
- and
- rendering, using the one or more computing devices, the avatar personifying the user using the set of assets by:
- organizing each asset of the set of assets into a position relative to other assets corresponding to the plurality of facial attributes in the template;
- and
- rendering the avatar based on the organized assets.
7 more elements
A computer program product comprising a non-transitory computer readable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to perform operations comprising:
- receiving, using one or more computing devices, an image of a user;
- determining, using the one or more computing devices, a template for an avatar;
- determining, based on the image of the user and using the one or more computing devices, attributes needed for the template, wherein the attributes include a plurality of facial attributes;
- processing, using the one or more computing devices, the image with a respective classifier trained to generate a corresponding label that corresponds to a value of each of the attributes, wherein each classifier is coupled to a selected layer of a pre-trained neural network model and wherein the selected layer of the pre-trained neural network model is selected by determining that the selected layer provides discrimination for a corresponding attribute;
- determining, using the one or more computing devices, a set of assets for the avatar based on labels;
- and
- rendering, using the one or more computing devices, the avatar personifying the user using the set of assets by:
- organizing each asset of the set of assets into a position relative to other assets corresponding to the plurality of facial attributes in the template;
- and
- rendering the avatar based on the organized assets.
7 more elements
A system comprising:
- a processor;
- and
- a memory coupled to the processor and storing instructions that, when executed, cause the processor to perform operations comprising:
- receiving, using one or more computing devices, an image of a user;
- determining, using the one or more computing devices, a template for an avatar;
- determining, based on the image of the user and using the one or more computing devices, attributes needed for the template, wherein the attributes include a plurality of facial attributes;
- processing, using the one or more computing devices, the image with a respective classifier trained to generate a corresponding label that corresponds to a value of each of the attributes, wherein each classifier is coupled to a selected layer of a pre-trained neural network model and wherein the selected layer of the pre-trained neural network model is selected by determining that the selected layer provides discrimination for a corresponding attribute;
- determining, using the one or more computing devices, a set of assets for the avatar based on labels;
- and
- rendering, using the one or more computing devices, the avatar personifying the user using the set of assets by:
- organizing each asset of the set of assets into a position relative to other assets corresponding to the plurality of facial attributes in the template;
- and
- rendering the avatar based on the organized assets.
10 more elements
Dependencies are inferred from the claim text.