Method, medium, and system for product recommendations based on augmented reality viewpoints

A system for providing a product recommendation using augmented reality, the system comprising:

• at least one memory including instructions;
• and
• at least one processor that is operably coupled to the at least one memory and that is arranged and configured to execute instructions that, when executed, cause the at least one processor to:
• receive a viewpoint of the user from an augmented reality application, wherein the viewpoint comprises a camera image of real objects and an image of an augmented product, the image of the augmented product being positioned among the real objects of the camera image in the viewpoint;
• determine a location and orientation of the augmented product in the viewpoint;
• determine style similarities of the augmented product to candidate products;
• based on the determined style similarities of the augmented product to the candidate products, create a set of recommendation images by embedding images of the candidate products in a position that corresponds to the determined location and orientation of the augmented product in the viewpoint;
• automatically determine a recommendation image from the set of recommendation images to provide to the user based on automatically evaluating the set of recommendation images using at least one of color compatibility scoring and style similarity scoring for each recommendation image from the set of recommendation images;
• and
• in response to the automatically determining, provide the recommendation image to the user, thereby providing a product recommendation to the user.

A computer program product for providing a product recommendation using augmented reality, the computer program product being tangibly embodied on a non-transitory computer-readable storage medium and comprising instructions that, when executed by at least one computing device, are configured to cause the at least one computing device to:

• receive a viewpoint of the user from an augmented reality application, wherein the viewpoint comprises a camera image of real objects and an image of an augmented product, the image of the augmented product being positioned among the real objects of the camera image in the viewpoint;
• determine a location and orientation of the augmented product in the viewpoint;
• determine style similarities of the augmented product to candidate products;
• based on the determined style similarities of the augmented product to the candidate products, create a set of recommendation images by embedding images of the candidate products in a position that corresponds to the determined location and orientation of the augmented product in the viewpoint;
• automatically determine a recommendation image from the set of recommendation images to provide to the user based on automatically evaluating the set of recommendation images using at least one of color compatibility scoring and style similarity scoring for each recommendation image from the set of recommendation images;
• and
• in response to the automatically determining, provide the recommendation image to the user, thereby providing a product recommendation to the user.