Using dynamic facial landmarks for head gaze estimation
AssigneeInternational Business Machines Corporation
InventorsKaran Ahuja, Kuntal Dey, Seema Nagar, Roman Vaculin
Life of this patent
Estimating the term…
Abstract
Techniques are provided for automatically dynamically determining one or more additional landmarks to produce a set of landmarks that includes at least four non-planar landmarks, in response to receiving a captured image that excludes a portion of a head or face that included one or more landmarks previously employed for gaze estimation/tracking from a previously captured image of the head or face.
Claims14
A system, comprising:
- a memory that stores computer executable components;
- a processor, operably coupled to the memory, and that executes computer executable components stored in the memory, wherein the computer executable components comprise:
- a gaze determination component that:
- determines a second set of landmarks of a head from a second image of the head of a stream of images of the head, wherein the second set of landmarks comprises a defined quantity of landmarks, wherein the defined quantity is at least four non-planar landmarks, wherein the second set of landmarks comprises at least one landmark that was not in a first set of landmarks of the head used for gaze estimation associated with a first image of the head that is prior to the second image in the stream of images, and
- determines a gaze vector for the head based on the second set of landmarks;
- and
- an output component that sends a transmission including at least the gaze vector to a robotic device that initiates the robotic device to assist a user associated with the gaze vector in performing a task to which the gaze vector is directed.
8-14. (canceled)
A computer program product for generating a gaze vector of a head, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by the computer to cause the computer to:
- determine a second set of landmarks of the head from a second image of the head of a stream of images of the head, wherein the second set of landmarks comprises a defined quantity of landmarks, wherein the defined quantity is at least four non-planar landmarks, wherein the second set of landmarks comprises at least one landmark that was not in a first set of landmarks of the head used for gaze estimation associated with a first image of the head that is prior to the second image in the stream of images;
- determine a gaze vector for the head based on the second set of landmarks;
- and
- send a transmission including at least the gaze vector to a robotic device that initiates the robotic device to assist a user associated with the gaze vector in performing a task to which the gaze vector is directed.
Dependencies are inferred from the claim text.