Online modeling for real-time facial animation
AssigneeApple Inc.
InventorsSofien Bouaziz, Mark Pauly
Life of this patent
Estimating the term…
Abstract
Embodiments relate to a method for real-time facial animation, and a processing device for real-time facial animation. The method includes providing a dynamic expression model, receiving tracking data corresponding to a facial expression of a user, estimating tracking parameters based on the dynamic expression model and the tracking data, and refining the dynamic expression model based on the tracking data and estimated tracking parameters. The method may further include generating a graphical representation corresponding to the facial expression of the user based on the tracking parameters. Embodiments pertain to a real-time facial animation system.
Claims20
A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
- capture, by a local device, first sensor data comprising a face of a user;
- in response to capturing the first sensor data, refine a predefined user-specific model based on the first sensor data to obtain a refined user-specific model;
- and
- upon receiving additional sensor data of the user, generate a graphical representation of the user using the additional sensor data and the refined user-specific model.
A method comprising:
- capturing, by a local device, first sensor data comprising a face of a user;
- in response to capturing the first sensor data, refining a predefined user-specific model based on the first sensor data to obtain a refined user-specific model;
- and
- upon receiving additional sensor data of the user, generating a graphical representation of the user using the additional sensor data and the refined user-specific model.
A system comprising:
- one or more processors;
- and
- one or more computer readable media comprising computer readable code executable by the one or more processors to:
- capture, by a local device, first sensor data comprising a face of a user;
- in response to capturing the first sensor data, refine a predefined user-specific model based on the first sensor data to obtain a refined user-specific model;
- and
- upon receiving additional sensor data of the user, generate a graphical representation of the user using the additional sensor data and the refined user-specific model.
Dependencies are inferred from the claim text.