Gaze tracking for a mobile device
AssigneesSony Corporation, Sony Mobile Communications Inc.
InventorOla Thorn
Life of this patent
Estimating the term…
Abstract
A method includes detecting, by a camera of a mobile device, a face of a user of the mobile device. The method includes determining a sequence of video images of the face and applying three dimensional (3D) modeling to the sequence of video images of the face to create a 3D model of the face. The method includes identifying rotational movement of the mobile device. The method includes tracking the face to identify rotational movement of the face based on the 3D model of the face, and adjusting the tracking of the face based on the 3D model of the face and rotational movement of the mobile device.
Claims19
A computer-implemented method of gaze-tracking, the method comprising:
- detecting, by a camera of a mobile device, a face of a user of the mobile device;
- determining initial two dimensional (2D) video images for each of a sequence of poses of the face of the user as the face of the user moves through a range of rotational movement;
- generating a three dimensional (3D) model of a face of the user from the sequence of initial 2D video images of the face;
- identifying rotational movement of the mobile device;
- tracking the face of the user by capturing additional 2D images of the face of the user with the camera;
- identifying rotational movement of the face of the user based on an application of the 3D model of the face to the additional 2D images of the face of the user;
- and
- stabilizing gaze-tracking of the face by tracking an approximate position of the user's eyes based on identified positions of feature points of the face other than the eyes relative to the 3D model of the face and tracking and compensating for rotational movement of the mobile device.
A mobile device, comprising:
- a video camera to receive video images of a user;
- a memory to store a plurality of instructions;
- and
- a processor configured to execute the instructions in the memory to:
- detect, by the video camera, a face of the user;
- determine initial two dimensional (2D) video images for each of a sequence of poses of the face of the user as the face of the user moves through a range of rotational movement;
- generate a three dimensional (3D) model of the face from the sequence of initial 2D video images of the face;
- identify rotational movement of the mobile device;
- track the face of the user by capturing additional 2D images of the face of the user with the camera;
- identify rotational movement of the face of the user based on an application of the 3D model of the face to the additional 2D images of the face of the user;
- and
- stabilize gaze-tracking of the face by tracking an approximate position of the user's eyes based on identified positions of feature points of the face other than the eyes relative to the 3D model of the face and tracking and compensating for rotational movement of the mobile device.
Dependencies are inferred from the claim text.