Virtual try-on systems for spectacles using reference frames

A system, comprising:

• a memory circuit storing instructions;
• and
• a processor circuit configured to execute the instructions to cause the system to:
• capture, in a client device, a first image of a user, the first image including a reference token for a user-wearable item, the reference token being worn by the first user in the first image and has a known three-dimensional model including a known dimension;
• automatically generate, by the client device, a three-dimensional model of a face of the user from the first image, the three-dimensional model of the face of the user including dimensions based on the known three-dimensional model of the reference token;
• display, by the client device, images of multiple user-wearable items for the user;
• receive an input from the user, the input indicative of a selected user-wearable item from the user-wearable items on display, the selected user-wearable item having an associated three-dimensional model;
• segment, by the client device, the first image to separate the reference token from a background comprising a portion of a physiognomy of the user;
• replace, by the client device, a segment for the reference token in the first image with an image for the selected user-wearable item in a second image of the user based on the three-dimensional model of the face of the user and the three-dimensional model of the selected user-wearable item;
• and
• display, by the client device, the second image of the user.

A method, comprising:

• generating, by a client device, a three-dimensional model of a face of the user from a first image of a user that includes a reference token having a known three-dimensional model being worn by the user, the three-dimensional model of the face of the user including dimensions based on the known three-dimensional model of the reference token;
• displaying, by the client device, at least one image of at least one user-wearable item, the at least one user-wearable item having an associated three-dimensional model;
• receiving an input from the user, the input indicative of a selected user-wearable item from at least one image of at least one user-wearable item;
• segmenting, by the client device, the first image to separate the reference token from a background comprising a portion of a physiognomy of the user;
• replacing, by the client device, a segment for the reference token in the first image with an image for the selected user-wearable item in a second image of the user based on the three-dimensional model of the face of the user and the three-dimensional model of the selected user-wearable item;
• and
• displaying, by the client device, the second image of the user.