Method and system for gaze estimation
AssigneeGeneral Electric Company
InventorsXiaoming Liu, Nils Oliver Krahnstoever, Ambalangoda Gurunnanselage Amitha Perera, Anthony James Hoogs, Peter Henry Tu, Gianfranco Doretto
Life of this patent
Estimating the term…
Abstract
A gaze estimation method and system, the method including capturing a video sequence of images with an image capturing system, designating at least one landmark in a head portion of the captured video sequence, fitting a virtual model of the head portion to the actual head portion in the captured video sequence, and determining the gaze estimation.
Claims16
A method for gaze estimation of a head portion of a person using a computer readable medium having executable code, comprising:
- capturing video sequences of images with an image capturing system and storing said video sequences on said computer readable medium;
- designating at least one landmark on the head portion of the video sequences;
- building a shape model and an appearance model of the head portion using the video sequences and the corresponding landmarks;
- developing a virtual head portion model for said head portion, wherein said virtual head portion model combines the shape model and appearance model;
- fitting the virtual head portion model to an actual head portion of the person in a subsequent video image;
- and
- determining said gaze estimation for the person in the subsequent video image.
A gaze estimation system for video sequences, comprising:
- a computing system for storing the video sequences;
- a training section for designating a plurality of landmarks on a plurality of head portions in the video sequences and developing a virtual head portion model using an active appearance model with a shape and appearance component;
- a fitting section that fits the virtual head portion model with an actual head portion of a person in the video sequences and estimating a gaze of the person for each frame of the video sequence;
- and
- broadcast equipment for broadcasting gaze information for display to a viewer.
Dependencies are inferred from the claim text.