System and Method for Talking Avatar

A method for generating a viseme event and corresponding intensity pair, comprising:

• generating, by a server, a viseme and corresponding intensity pair based at least on one of a clean vocal track or corresponding transcription;
• generating, by the server, a compressed audio file based at least on one of the viseme, the corresponding intensity, music, or visual offset;
• and
• inserting, by the server, a viseme generator based at least on one of a processing buffer or the compressed audio file,
• wherein the viseme is scheduled to align with a corresponding phoneme.

A system for generating a viseme event and corresponding intensity pair, comprising:

• a processor;
• and
• a non-transitory computer readable storage medium storing programming for execution by the processor, the programming including instructions to:
• generate a viseme and corresponding intensity pair based at least on one of a clean vocal track or corresponding transcription;
• generate a compressed audio file based at least on one of the viseme, the corresponding intensity, music, or visual offset;
• and
• generate a buffer of raw pulse-code modulated (PCM) data based on decoding at least a part of the compressed audio file,
• wherein the viseme is scheduled to align with a corresponding phoneme.