Augmented reality experiences of color palettes in a messaging system
AssigneeSnap Inc.
InventorsJean Luo, Celia Nicole Mourkogiannis
Life of this patent
Estimating the term…
Abstract
The subject technology receives image data including a representation of a physical item. The subject technology analyzes the image data to determine an object corresponding to the physical item. The subject technology identifies a set of colors corresponding to a set of regions of the determined object. The subject technology analyzes second image data to detect a second object corresponding to a representation of a particular body part of a user. The subject technology generates augmented reality content based at least in part on the identified set of colors and the detected second object. The subject technology causes display, at a client device, the augmented reality content applied to the detected second object.
Claims20
A method, comprising:
- analyzing first image data to determine an object corresponding to a beauty product, the analyzing based at least in part on a recognition process performed on the first image data wherein the recognition process further comprises:
- classifying, using a first image classifier, the first image data to determine that the object includes a physical identification indicator, and
- classifying, using a second image classifier, the first image data to perform object classification of the object based on a set of 3D models or images;
- determining texture information corresponding to a set of regions of the object, wherein the texture information comprises a set of textures based on pixels from the set of regions;
- analyzing second image data to identify a body part of a user;
- generating augmented reality content by performing a texture transfer process based on the set of textures to a surface of the body part;
- and
- causing display of the augmented reality content applied to the body part.
A system comprising:
- a processor;
- and
- a memory including instructions that, when executed by the processor, cause the processor to perform operations comprising:
- analyzing first image data to determine an object corresponding to a beauty product, the analyzing based at least in part on a recognition process performed on the first image data wherein the recognition process further comprises:
- classifying, using a first image classifier, the first image data to determine that the object includes a physical identification indicator, and
- classifying, using a second image classifier, the first image data to perform object classification of the object based on a set of 3D models or images;
- determining texture information corresponding to a set of regions of the object, wherein the texture information comprises a set of textures based on pixels from the set of regions;
- analyzing second image data to identify a body part of a user;
- generating augmented reality content by performing a texture transfer process based on the set of textures to a surface of the body part;
- and
- causing display of the augmented reality content applied to the body part.
A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:
- analyzing first image data to determine an object corresponding to a beauty product, the analyzing based at least in part on a recognition process performed on the first image data wherein the recognition process further comprises:
- classifying, using a first image classifier, the first image data to determine that the object includes a physical identification indicator, and
- classifying, using a second image classifier, the first image data to perform object classification of the object based on a set of 3D models or images;
- determining texture information corresponding to a set of regions of the object, wherein the texture information comprises a set of textures based on pixels from the set of regions;
- analyzing second image data to identify a body part of a user;
- generating augmented reality content by performing a texture transfer process based on the set of textures to a surface of the body part;
- and
- causing display of the augmented reality content applied to the body part.
Dependencies are inferred from the claim text.