Creating effects based on facial features
AssigneeLemon Inc.
InventorsNathanael Schager, Zhe Huang, Kewei Chen, Nite Luo, Clement Boissiere
Life of this patent
Estimating the term…
Abstract
The present disclosure describes techniques for creating effects based on facial features. A mesh comprising a set of vertices based on detecting key points of at least one facial part may be created. A mask may be created based on rendering the mesh. A filter may be created by applying a function to a texture based on the mask. A portion of at least one image may be extracted based at least in part on the mask. The portion may correspond to the at least one facial part. An effect may be created on the extracted portion using the filter.
Claims17
A method, comprising:
- generating a mesh comprising a set of vertices based on detecting key points of at least one facial part, wherein the at least one facial part is to be mapped to images depicting other things than the at least one facial part;
- creating a mask based on rendering the mesh by inputting the mesh into a first pass of a multi-pass shader;
- creating, by at least one of a second pass or a third pass of the multi-pass shader, a filter by applying a function to a texture based on the mask, wherein the at least one of the second pass or the third pass is configured to apply the function to the texture output from the first pass or the second pass;
- performing an alpha cutout on an input texture by a fourth pass of the multi-pass shader, a result of the alpha cutout corresponding to the at least one facial part;
- and
- creating an effect based on an extracted portion resulted from the alpha cutout, wherein the effect enables to map the at least one facial part to the images depicting other things than the at least one facial part.
A system, comprising:
- at least one processor;
- and
- at least one memory comprising computer-readable instructions that upon execution by the at least one processor cause the computing device to perform operations comprising:
- generating a mesh comprising a set of vertices based on detecting key points of at least one facial part, wherein the at least one facial part is to be mapped to images depicting other things than the at least one facial part;
- creating a mask based on rendering the mesh by inputting the mesh into a first pass of a multi-pass shader,
- creating, by at least one of a second pass or a third pass of the multi-pass shader, a filter by applying a function to a texture based on the mask, wherein the at least one of the second pass or the third pass is configured to apply the function to the texture output from the first pass or the second pass;
- performing an alpha cutout on an input texture by a fourth pass of the multi-pass shader, a result of the alpha cutout the portion corresponding to the at least one facial part;
- and
- creating an effect based on an extracted portion resulted from the alpha cutout, wherein the effect enables to map the at least one facial part to the images depicting other things than the at least one facial part.
A non-transitory computer-readable storage medium, storing computer-readable instructions that upon execution by a processor cause the processor to implement operations, the operation comprising:
- generating a mesh comprising a set of vertices based on detecting key points of at least one facial part, wherein the at least one facial part is to be mapped to images depicting other things than the at least one facial part;
- creating a mask based on rendering the mesh by inputting the mesh into a first pass of a multi-pass shader;
- creating, by at least one of a second pass or a third pass of the multi-pass shader, a filter by applying a function to a texture based on the mask, wherein the at least one of the second pass or the third pass is configured to apply the function to the texture output from the first pass or the second pass;
- performing an alpha cutout on an input texture by a fourth pass of the multi-pass shader, a result of the alpha cutout corresponding to the at least one facial part;
- and
- creating an effect based on an extracted portion resulted from the alpha cutout, wherein the effect enables to map the at least one facial part to the images depicting other things than the at least one facial part.
Dependencies are inferred from the claim text.