Systems And Methods For Machine-Generated Avatars
AssigneeTrue Image Interactive, Inc.
InventorWayne Scholar
Life of this patent
Estimating the term…
Abstract
Systems and methods are disclosed for creating a machine generated avatar. A machine generated avatar is an avatar generated by processing video and audio information extracted from a recording of a human speaking a reading corpora and enabling the created avatar to be able to say an unlimited number of utterances, i.e., utterances that were not recorded. The video and audio processing consists of the use of machine learning algorithms that may create predictive models based upon pixel, semantic, phonetic, intonation, and wavelets.
Claims20
A method for generating viseme and phoneme sequences, comprising:
- receiving recording data comprising video recording data and audio recording data, wherein the recording data is associated with an input utterance;
- timestamping the recording data;
- extracting phoneme clips and viseme clips from the timestamped recording data;
- extracting transition light cones based on the viseme clips;
- extracting audio clips from the phoneme clips;
- associating the transition light cones with the audio clips;
- parsing the audio clips into sentences;
- and
- tagging the sentences with parts of speech.
A device for generating viseme and phoneme sequences, comprising:
- one or more processors;
- and
- memory storing instructions that, when executed by the one or more processors, cause the device to:
- receive recording data comprising video recording data and audio recording data, wherein the recording data is associated with an input utterance;
- timestamp the recording data;
- extract phoneme clips and viseme clips from the timestamped recording data;
- extract transition light cones based on the viseme clips;
- extract audio clips from the phoneme clips;
- associate the transition light cones with the audio clips;
- parse the audio clips into sentences;
- and
- tag the sentences with parts of speech.
A system for generating viseme and phoneme sequences, the system comprising
- a recording device;
- and
- a computing device configured to:
- receive, from the recording device, recording data comprising video recording data and audio recording data, wherein the recording data is associated with an input utterance;
- timestamp the recording data;
- extract phoneme clips and viseme clips from the timestamped recording data;
- extract transition light cones based on the viseme clips;
- extract audio clips from the phoneme clips;
- associate the transition light cones with the audio clips;
- parse the audio clips into sentences;
- and
- tag the sentences with parts of speech.
Dependencies are inferred from the claim text.