Method and apparatus for determining a fit of a visual equipment

An apparatus for determining a fit of a visual equipment, comprising:

• processing circuitry configured to
• receive at least one image of a face of a user,
• identify a subset of eyeglasses from a database of visual equipment that satisfy a preliminary fit threshold, the preliminary fit threshold being a deviation limit of a parameter of the eyeglasses from a corresponding anatomical parameter of the face of the user, wherein whether an eyeglass of the database does or does not satisfy the preliminary fit threshold is determined by comparing the parameter of the eyeglasses with the corresponding anatomical parameter of the face of the user and by eliminating the eyeglass when the preliminary fit threshold is exceeded, the comparing being related to comfort, which is based on an adaptation of the eyeglasses to a facial width of the user, and/or being related to aesthetics, which is based on an adaptation of the eyeglasses to a user facial shape and/or skin color and/or eye color,
• determine, for a candidate eyeglass of the subset of eyeglasses, an eyeglass rim plane defined by a pantoscopic angle,
• determine, based on the eyeglass rim plane, an eyeglass pads plane that intersects eyeglass pads of the candidate eyeglass, the eyeglass pads plane being situated at a position offset from the eyeglass rim plane by a predetermined distance,
• generate at least one two-dimensional (2D) profile of a nose of the user based on one or more facial landmarks detected in the at least one image of the face of the user and a three-dimensional (3D) nose contour estimated from the at least one image of the face of the user, the at least one 2D profile of the nose of the user including at least one of:
• a first one of the at least one 2D profile of the nose of the user being defined as an intersection of a plane parallel to the eyeglass pads plane and the estimated 3D nose contour, the first one of the at least one 2D profile being situated at a predetermined distance from a facial reference landmark of the one or more facial landmarks, and
• a second one of the at least one 2D profile of the nose of the user being defined as an intersection of a plane parallel to the eyeglass rim plane and the estimated 3D nose contour, the second one of the at least one 2D profile being situated relative to the first one of the at least one 2D profile based on the predetermined distance of the offset of the eyeglass pads plane from the eyeglass rim plane,
• generate, for the candidate eyeglass of the subset of eyeglasses, at least one 2D profile of a nasal section of a frame of the candidate eyeglass, a first one of the at least one 2D profile of the nasal section of the frame being associated with eyeglass pads of the candidate eyeglass and a second one of the at least one 2D profile of the nasal section of the frame being associated with an eyeglass rim of the candidate eyeglass,
• virtually dock, based on the at least one 2D profile of the nose of the user and the at least one 2D profile of the nasal section of the frame of the candidate eyeglass, the candidate eyeglass on the nose of the face of the user,
• compare locations of a feature of an eyeglass rim of the virtually docked candidate eyeglass to a subset of the one or more facial landmarks detected in the at least one image of the face of the user, and
• calculate, when the virtually docked candidate eyeglass satisfies a secondary fit threshold representing a distance between global reference positions of the eyeglass and the face of the user, a final fit of the virtually docked candidate eyeglass on the nose of the user, the final fit of the virtually docked candidate eyeglass being a score, which is a result of a scoring function obtained by:
• defining comfort and/or aesthetic criteria,
• defining an evaluation function measuring the defined comfort and/or aesthetic criteria, wherein inputs include one or more morphological features of the face of the user, or of the eyeglass,
• defining a target value representing an ideal result of the evaluation function, and
• defining the scoring function that evaluates the distance between a result of the evaluation function and the ideal result.

A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by processing circuitry of a computer, cause the computer to perform a method for determining a fit of a visual equipment, the method comprising:

• receiving at least one image of a face of a user;
• identifying a subset of eyeglasses from a database of visual equipment that satisfy a preliminary fit threshold, the preliminary fit threshold being a deviation limit of a parameter of the eyeglasses from a corresponding anatomical parameter of the face of the user, wherein whether an eyeglass of the database does or does not satisfy the preliminary fit threshold is determined by comparing the parameter of the eyeglasses with the corresponding anatomical parameter of the face of the user and by eliminating the eyeglass when the preliminary fit threshold is exceeded, the comparing being related to comfort, which is based on an adaptation of the eyeglasses to a facial width of the user, and/or being related to aesthetics, which is based on an adaptation of the eyeglasses to a user facial shape and/or skin color and/or eye color;
• determining, for a candidate eyeglass of the subset of eyeglasses, an eyeglass rim plane defined by a pantoscopic angle;
• determining, based on the eyeglass rim plane, an eyeglass pads plane that intersects eyeglass pads of the candidate eyeglass, the eyeglass pads plane being situated at a position offset from the eyeglass rim plane by a predetermined distance;
• generating at least one two-dimensional (2D) profile of a nose of the user based on one or more facial landmarks detected in the at least one image of the face of the user and a three-dimensional (3D) nose contour estimated from the at least one image of the face of the user, the at least one 2D profile of the nose of the user including at least one of:
• a first one of the at least one 2D profile of the nose of the user being defined as an intersection of a plane parallel to the eyeglass pads plane and the estimated 3D nose contour, the first one of the at least one 2D profile being situated at a predetermined distance from a facial reference landmark of the one or more facial landmarks, and
• a second one of the at least one 2D profile of the nose of the user being defined as an intersection of a plane parallel to the eyeglass rim plane and the estimated 3D nose contour, the second one of the at least one 2D profile being situated relative to the first one of the at least one 2D profile based on the predetermined distance of the offset of the eyeglass pads plane from the eyeglass rim plane;
• generating, for the candidate eyeglass of the subset of eyeglasses, at least one 2D profile of a nasal section of a frame of the candidate eyeglass, a first one of the at least one 2D profile of the nasal section of the frame being associated with eyeglass pads of the candidate eyeglass and a second one of the at least one 2D profile of the nasal section of the frame being associated with an eyeglass rim of the candidate eyeglass;
• virtually docking, based on the at least one 2D profile of the nose of the user and the at least one 2D profile of the nasal section of the frame of the candidate eyeglass, the candidate eyeglass on the nose of the face of the user;
• comparing locations of a feature of an eyeglass rim of the virtually docked candidate eyeglass to a subset of the one or more facial landmarks detected in the at least one image of the face of the user;
• and
• calculating, when the virtually docked candidate eyeglass satisfies a secondary fit threshold representing a distance between global reference positions of the eyeglass and the face of the user, a final fit of the virtually docked candidate eyeglass on the nose of the user, the final fit of the virtually docked candidate eyeglass being a score, which is a result of a scoring function obtained by:
• defining comfort and/or aesthetic criteria,
• defining an evaluation function measuring the defined comfort and/or aesthetic criteria, wherein inputs include one or more morphological features of the face of the user, or of the eyeglass,
• defining a target value representing an ideal result of the evaluation function, and
• defining the scoring function that evaluates the distance between a result of the evaluation function and the ideal result.