Back to results
US 7,257,538 B2Granted
Generating animation from visual and audio input
AssigneeIntel Corporation
InventorRichard J. Qian
Life of this patent
Estimating the term…
Abstract
A technique for generating an animated character based on visual and audio input from a live subject. Further described is a technique of extracting phonemes to select corresponding visemes to model a set of physical positions of the subject or emotional expression of the subject.
Claims23
A machine-readable medium having stored thereon a set of instructions, which when executed by a machine cause the machine to perform a method comprising;
- receiving a visual input and a speech input;
- extracting a phoneme from the speech input;
- and
- identifying a plurality of emotional visemes based upon the phoneme;
- transforming one of the plurality of emotional visemes to generate a transformed emotional viseme.
2 more elements
A method comprising;
- extracting a plurality of phonemes from a speech input;
- selecting a plurality of visemes based upon the plurality of phonemes;
- transforming the plurality of visemes according to a visual input to generate a plurality of transformed visemes;
- and
- morphing the plurality of transformed visemes,
- wherein the visemes are emotional visemes to be modified according to emotional expression types.
3 more elements
An apparatus comprising:
- a first unit to extract phonemes from a speech input;
- a second unit to select visemes corresponding to the phonemes;
- and
- a third unit to modify the visemes according to a visual inputs,
- wherein the visemes are emotional visemes to be modified according to emotional expression types.
2 more elements
A system comprising:
- an image capturing device to capture a plurality of frames of a visual input;
- a sound capturing device to capture a plurality of samples of a sonic input;
- an extraction device to extract phonemes from the plurality of samples of the sonic input;
- a selection device to select visemes corresponding to the phonemes;
- a tracking device to track regions of the visual input;
- a transforming device to spatially transform the visemes according to an affine model;
- and
- a morphing device to morph the visemes after they are transformed by the transforming device.
5 more elements
Dependencies are inferred from the claim text.