Systems for and methods of creating a library of facial expressions
AssigneeProf Jim Inc.
InventorsDeepak Chandra Sekar, Pranav Mehta
Life of this patent
Estimating the term…
Abstract
Methods, systems, and computer readable storage media for using image processing to develop a library of facial expressions. The system can receive digital video of at least one speaker, then execute image processing on the video to identify landmarks within facial features of the speaker. The system can also identify vectors based on the landmarks, then assign each vector to an expression, resulting in a plurality of speaker expressions. The system then scores the expressions based on similarity to one another, and creates subsets based on the similarity scores.
Claims20
A method comprising:
- receiving, at a computer system, digital video of a speaker, resulting in a speaker video;
- executing, via at least one processor of the computer system, image processing of the speaker video to identify landmarks within facial features of the speaker;
- identifying, via the at least one processor, a plurality of vectors based on the landmarks;
- assigning, via the at least one processor, at least a portion of vectors within the plurality of vectors to expressions, resulting in a plurality of speaker expressions;
- scoring, via the at least one processor, the plurality of speaker expressions based on similarity to one another, resulting in speaker expression similarity scores;
- creating, via the at least one processor, at least one subset of similar expressions within the plurality of speaker expressions based on the speaker expression similarity scores;
- and
- generating, via the at least one processor, a video that comprises an animated avatar of the speaker, wherein the animated avatar uses at least one expression from the at least one subset of similar expressions.
A system comprising:
- at least one processor;
- and
- a non-transitory computer-readable storage medium having instructions stored which, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
- receiving digital video of a speaker, resulting in a speaker video;
- executing image processing of the speaker video to identify landmarks within facial features of the speaker;
- identifying a plurality of vectors based on the landmarks;
- assigning at least a portion of vectors within the plurality of vectors to expressions, resulting in a plurality of speaker expressions;
- scoring the plurality of speaker expressions based on similarity to one another, resulting in speaker expression similarity scores;
- creating at least one subset of similar expressions within the plurality of speaker expressions based on the speaker expression similarity scores;
- and
- generating a video that comprises an animated avatar of the speaker, wherein the animated avatar uses at least one expression from the at least one subset of similar expressions.
A non-transitory computer-readable storage medium having instructions stored which, when executed by at least one processor, cause the at least one processor to perform operations comprising:
- receiving digital video of a speaker, resulting in a speaker video;
- executing image processing of the speaker video to identify landmarks within facial features of the speaker;
- identifying a plurality of vectors based on the landmarks;
- assigning at least a portion of the plurality of vectors within to expressions, resulting in a plurality of speaker expressions;
- scoring the plurality of speaker expressions based on similarity to one another, resulting in speaker expression similarity scores;
- creating at least one subset of similar expressions within the plurality of speaker expressions based on the speaker expression similarity scores;
- and
- generating a video that comprises an animated avatar of the speaker, wherein the animated avatar uses at least one expression from the at least one subset of similar expressions.
Dependencies are inferred from the claim text.