Process and method for real-time physically accurate and realistic-looking glasses try-on

A method for generating a real-time realistic-looking image of a pair of virtual glasses defined as a 3D object comprising two arms, and positioned on a real user face image issued from an image, which is one of a single image, a bundle of pictures, a video clip or real-time camera streams, comprising the steps of:

• estimating facial parameters comprising a 3D rotation matrix, a 3D translation vector and morphology parameters, of a user's face by a face analysis element;
• estimating glasses positioning parameters comprising a 3D rotation matrix, a 3D translation vector, global and local deformation parameters of the virtual glasses, and arms articulation, adapted to the morphology parameters, by glasses positioning element associated with a try-on mode for look or real-size simulation;
• mixing the real user face image with the virtual glasses positioned in accordance with the glasses positioning parameters by a realistic rendering element;
• modifying an opacity value α into a corrected value αLDR of objects using the formula:
• α
• LDR
• =
• L
• HDR
• L
• HDR
• Max
• +
• (
• 1
• -
• L
• HDR
• L
• HDR
• Max
• )
• ⁢
• α
• =
• α
• +
• (
• 1
• -
• α
• )
• ⁢
• L
• HDR
• L
• HDR
• Max
• where LHDR is the computed irradiance and LHDRMax is an upper bound on a real scene irradiance;
• and
• wherein global and local deformation parameters of the virtual glasses comprise non-rigid deformation of arms of the virtual glasses.