Avatar synthesis with local code modulation

An apparatus for synthesizing facial features of a three-dimensional (3D) facial model, comprising:

• at least one memory;
• and
• at least one processor coupled to the at least one memory, wherein the at least one processor is configured to:
• obtain a first frame, the first frame including a first portion of a face;
• generate a first facial feature corresponding to the first portion of the face;
• obtain a second frame, the second frame including a second portion of the face, wherein the second portion of the face at least partially overlaps the first portion of the face;
• generate a one-dimensional second facial feature corresponding to the second portion of the face;
• generate a set of weights based on the one-dimensional second facial feature;
• and
• apply the set of weights to the first facial feature to generate a weighted facial feature.

A non-transitory computer-readable medium having stored thereon instructions that, when executed by at least one processor, cause the at least one processor to:

• obtain a first frame, the first frame including a first portion of a face;
• generate a first facial feature corresponding to the first portion of the face;
• obtain a second frame, the second frame including a second portion of the face, wherein the second portion of the face at least partially overlaps the first portion of the face;
• generate a one-dimensional second facial feature corresponding to the second portion of the face;
• generate a set of weights based on the one-dimensional second facial feature;
• and
• apply the set of weights to the first facial feature to generate a weighted facial feature.