Systems for and methods of creating a library of facial expressions
AssigneeProf Jim Inc.
InventorsDeepak Chandra Sekar, Pranav Mehta, Gandham Venkata Sai Anooj
Life of this patent
Estimating the term…
Abstract
Methods, systems, and computer readable storage media for using image processing to develop a library of facial expressions. The system can receive digital video of at least one speaker, then execute image processing on the video to identify landmarks within facial features of the speaker. The system can also identify vectors based on the landmarks, then assign each vector to an expression, resulting in a plurality of speaker expressions. The system then scores the expressions based on similarity to one another, and creates subsets based on the similarity scores.
Claims20
A method comprising:
- receiving, at a computer system from a user, a textbook in electronic form;
- processing, via at least one processor of the computer system, the textbook using at least one neural network, the at least one neural network comprising summarization capabilities and sentiment analysis capabilities, resulting in a sentiment analysis and at least one summary;
- animating, via the at least one processor, an avatar within at least one slide using the sentiment analysis and a narration of the textbook, resulting in at least one animated slide with an animated avatar, wherein the animated avatar explains the at least one slide using the narration, each slide in the at least one slide being based on the at least one summary;
- and
- generating, via the at least one processor, at least one video comprising the animated avatar.
A system comprising:
- at least one processor;
- and
- a non-transitory computer-readable storage medium having instructions stored which, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
- receiving, from a user, a textbook in electronic form;
- processing the textbook using at least one neural network, the at least one neural network comprising summarization capabilities and sentiment analysis capabilities, resulting in a sentiment analysis and at least one summary;
- animating an avatar within at least one slide using the sentiment analysis and a narration of the textbook, resulting in at least one animated slide with an animated avatar, wherein the animated avatar explains the at least one slide using the narration, each slide in the at least one slide being based on the at least one summary;
- and
- generating at least one video comprising the animated avatar.
A non-transitory computer-readable storage medium having instructions stored which, when executed by at least one processor, cause the at least one processor to perform operations comprising:
- receiving, from a user, a textbook in electronic form;
- processing the textbook using at least one neural network, the at least one neural network comprising summarization capabilities and sentiment analysis capabilities, resulting in a sentiment analysis and at least one summary;
- animating an avatar within at least one slide using the sentiment analysis and a narration of the textbook, resulting in at least one animated slide with an animated avatar, wherein the animated avatar explains the at least one slide using the narration, each slide in the at least one slide being based on the at least one summary;
- and
- generating at least one video comprising the animated avatar.
Dependencies are inferred from the claim text.