Three-dimensional (3D) facial feature tracking for autostereoscopic telepresence systems
AssigneeGoogle Inc.
InventorsSascha Haeberling, Jason Lawrence
Life of this patent
Estimating the term…
Abstract
A method including capturing at least one image using a plurality of cameras, identifying a plurality of facial features associated with the at least one image, stabilizing a location of at least one facial feature of the plurality of facial features, converting the location of the at least one facial feature to a three-dimensional (3D) location, predicting a future location of the at least one facial feature, and rendering a 3D image, on a flat panel display, using the future location of the at least one facial feature.
Claims22
A method comprising:
- capturing at least one image using a plurality of cameras;
- identifying a plurality of facial features associated with the at least one image;
- stabilizing a location of at least one facial feature of the plurality of facial features;
- converting the location of the at least one facial feature to a three-dimensional (3D) location;
- reducing a noise associated with the 3D location of the at least one facial feature;
- predicting a future location of the at least one facial feature;
- and
- rendering a 3D image, on a flat panel display, using the future location of the at least one facial feature.
A three-dimensional (3D) content system comprising:
- a memory including code segments representing a plurality of computer instructions;
- and
- a processor configured to execute the code segments, the computer instructions including:
- capturing at least one image using a plurality of cameras;
- identifying a plurality of facial features associated with the at least one image;
- stabilizing a location of at least one facial feature of the plurality of facial features;
- converting the location of the at least one facial feature to a three-dimensional (3D) location;
- reducing a noise associated with the 3D location of the at least one facial feature;
- predicting a future location of the at least one facial feature;
- and
- rendering a 3D image, on a flat panel display, using the future location of the at least one facial feature.
A non-transitory computer-readable storage medium having stored thereon computer executable program code which, when executed on a computer system, causes the computer system to perform a method comprising:
- capturing at least one image using a plurality of cameras;
- identifying a plurality of facial features associated with the at least one image;
- stabilizing a location of at least one facial feature of the plurality of facial features;
- converting the location of the at least one facial feature to a three-dimensional (3D) location;
- applying a double exponential filter to the 3D location of the at least one facial feature to reduce a noise associated with the 3D location of the at least one facial feature;
- predicting a future location of the at least one facial feature;
- determining a display position for rendering a 3D image, on a flat panel display, using the future location of the at least one facial feature;
- and
- determining an audio position for generating audio using the future location of the at least one facial feature.
Dependencies are inferred from the claim text.