US 9,898,849 B2 · Facial expression based avatar rendering in video animation and method

Abstract

Apparatuses, methods and storage medium associated with creating an avatar video are disclosed herein. In embodiments, the apparatus may one or more facial expression engines, an animation-rendering engine, and a video generator. The one or more facial expression engines may be configured to receive video, voice and/or text inputs, and, in response, generate a plurality of animation messages having facial expression parameters that depict facial expressions for a plurality of avatars based at least in part on the video, voice and/or text inputs received. The animation-rendering engine may be configured to receive the one or more animation messages, and drive a plurality of avatar models, to animate and render the plurality of avatars with the facial expression depicted. The video generator may be configured to capture the animation and rendering of the plurality of avatars, to generate a video. Other embodiments may be described and/or claimed.

Claims25

Dependent claims

An apparatus for animating and rendering a plurality of avatars, comprising:

one or more processors;
one or more facial expression engines operated by the one or more processors to receive video, voice or text inputs, and generate a plurality of animation messages having facial expression parameters that depict facial expressions for the plurality of avatars based at least in part on the video, voice or text inputs received;
an animation-rendering engine coupled with the one or more facial expression engines and operated by the one or more processors to receive the plurality of animation messages, and drive a plurality of avatar models, in accordance with the plurality of animation messages, to animate and render the plurality of avatars with the facial expressions depicted;
and
a video generator coupled with the animation-rendering engine and operated by the one or more processors to capture the animation and rendering of the plurality of avatars, and generate a video based at least in part on the animation and rendering captured.

2 more elements

A method for animating and rendering a plurality of avatars, comprising:

receiving, by a computing device, video, voice or text inputs;
generating, by the computing device, a plurality of animation messages having facial expression parameters that depict facial expressions for the plurality of avatars based at least in part on the video, voice or text inputs received;
driving, by the computing device, a plurality of avatar models, in accordance with the plurality of animation messages, to animate and render the plurality of avatars with the facial expressions depicted;
and
capturing, by the computing device, the animation and rendering of the plurality of avatars to generate a video based at least in part on the animation and rendering captured.

2 more elements

At least one non-transitory computer-readable medium having instructions to cause a computing device, in response to execution of the instruction by the computing device, to:

receive video, voice or text inputs;
generate a plurality of animation messages having facial expression parameters that depict facial expressions for a plurality of avatars based at least in part on the video, voice or text inputs received;
drive a plurality of avatar models, in accordance with the plurality of animation messages, to animate and render the plurality of avatars with the facial expressions depicted;
and
capture the animation and rendering of the plurality of avatars to generate a video based at least in part on the animation and rendering captured.

2 more elements

Dependencies are inferred from the claim text.

Facial expression based avatar rendering in video animation and method

Life of this patent

Facial expression based avatar rendering in video animation and method

Life of this patent

Abstract

Claims25