Systems and Methods for Identification and Virtual Application of Cosmetic Products

A system, comprising:

• a memory storing instructions;
• at least one camera;
• and
• a processor coupled to the memory and configured by the instructions to at least:
• obtain a target image from a user, the target image depicting at least one of a cosmetic product or an individual wearing at least one cosmetic product;
• access a database storing a plurality of sample images, each sample image having a corresponding image feature map and metadata, the metadata comprising cosmetic product information and cosmetic makeup parameters;
• analyze the target image and identify a matching sample image among the plurality of sample images based on the image feature map;
• obtain an image or video with a facial region of the user via a camera;
• perform virtual application of at least one cosmetic product on the image or video with the facial region of the user based on the cosmetic makeup parameters specified in metadata of the matching sample image;
• generate a user interface displaying a resulting image or video showing virtual application of the at least one cosmetic product on the user;
• and
• display cosmetic product information to the user in the user interface corresponding to the cosmetic product information specified in the metadata of the matching sample image.

A non-transitory computer-readable storage medium storing instructions to be implemented by a computing device having a processor, wherein the instructions, when executed by the processor, cause the computing device to at least:

• obtain a target image from a user, the target image depicting at least one of a cosmetic product or an individual wearing at least one cosmetic product;
• access a database storing a plurality of sample images, each sample image having a corresponding image feature map and metadata, the metadata comprising cosmetic product information and cosmetic makeup parameters;
• analyze the target image and identify a matching sample image among the plurality of sample images based on the image feature map;
• obtain an image or video with a facial region of the user via a camera;
• perform virtual application of at least one cosmetic product on the image or video with the facial region of the user based on the cosmetic makeup parameters specified in metadata of the matching sample image;
• generate a user interface displaying a resulting image or video showing virtual application of the at least one cosmetic product on the user;
• and
• display cosmetic product information to the user in the user interface corresponding to the cosmetic product information specified in the metadata of the matching sample image.