Virtual try-on systems and methods for spectacles
AssigneeWarby Parker Inc.
InventorsDavid Goldberg, Michael Rakowski, Benjamin Cohen, Ben Hall, Brian Bernberg, Hannah Zachritz
Life of this patent
Estimating the term…
Abstract
Various aspects of the subject technology relate to systems, methods, and machine-readable media for virtual try-on of items such as spectacles. A virtual try-on interface may be implemented at a server or at a user device, and may use collision detection between three-dimensional models of the spectacles and of a user's face and head to determine the correct size and position of the spectacles for virtual try-on. With the determined size and position, a virtual representation of the spectacles is superimposed on an image of the user.
Claims23
A computer-implemented method, comprising:
- capturing, with a camera of an electronic device, an image of a face of a user;
- obtaining, using a sensor of the electronic device, three-dimensional location information for the user;
- obtaining a three-dimensional model of a pair of spectacles;
- determining a position of a virtual representation of the spectacles based on the image and the three-dimensional location information;
- determining a size of the virtual representation of the spectacles based on the image and the three-dimensional location information;
- and
- displaying, with a display of the electronic device, a combined image including the image of the user and the virtual representation of the spectacles with the determined size and the determined position.
A computer-implemented method, comprising:
- capturing an image of a face of a user;
- obtaining a three-dimensional model of the user at a time of capture of the image;
- obtaining a three-dimensional model of a pair of spectacles;
- determining a size and a position for a virtual representation of the spectacles based on the image, the three-dimensional model of the user at the time of capture of the image, and the three-dimensional model of the pair of spectacles;
- and
- displaying the virtual representation of the spectacles, with the determined size and at the determined position, overlaid on the image of the face of the user.
A system, comprising:
- a server having a database storing three-dimensional models for a plurality of pairs of spectacles;
- and
- a user device of a user, wherein the user device includes memory storing code that, when executed by a processor of the user device, causes the processor to:
- capture an image of a face of the user;
- obtain a three-dimensional model of the user;
- obtain, from the server, the three-dimensional model of a selected one of the pairs of spectacles;
- determine a size and a position for a virtual representation of the selected one of the pairs of spectacles based on the image, the three-dimensional model of the user, and the three-dimensional model of the selected one of the selected one of the pairs of spectacles;
- and
- provide, for display, the virtual representation of the selected one of the pairs of spectacles, with the determined size and at the determined position, overlaid on the image of the face of the user.
Dependencies are inferred from the claim text.