Single image-based real-time body animation

A system for single image-based body animation, the system comprising at least one processor, a memory storing processor-executable codes, wherein the at least one processor is configured to implement the following operations upon executing the processor- executable codes:

• receiving an input image, the input image including a body of a person;
• segmenting the input image into a body portion and a background portion, wherein the body portion includes pixels of the input image, the pixels corresponding to the body of the person;
• fitting a model to the body portion, wherein the model is configured to:
• receive a set of pose parameters representing a pose of the body;
• and
• generate, based on the set of pose parameters, an output image, the output image including an image of the body adopting the pose;
• receiving a series of further sets of pose parameters, each of the series of further pose parameters representing at least one of further poses of the body, wherein the further sets of pose parameters are generated using a generic model, the generation of the series of further sets of pose parameters using the generic model is performed in an editor associated with the generic model;
• providing each of the further sets of pose parameters to the model to generate a series of output images of the body adopting the further poses;
• and
• generating, based on the series of output images, an output video, wherein each frame of the output video includes at least one of the output images.

A non-transitory processor-readable medium having instructions stored thereon, which when executed by one or more processors, cause the one or more processors to implement a method for single image-based body animation, the method comprising:

• receiving an input image, the input image including a body of a person;
• segmenting the input image into a body portion and a background portion, wherein the body portion includes pixels of the input image, the pixels corresponding to the body of the person;
• fitting a model to the body portion, wherein the model is configured to:
• receive pose parameters representing a pose of the body;
• and
• generate, based on the pose parameters, an output image, the output image including an image of the body adopting the pose;
• receiving a series of further sets of pose parameters, each of the series of further sets of pose parameters representing at least one of further poses of the body, wherein the further sets of pose parameters are generated using a generic model, the generation of the series of further sets of pose parameters using the generic model is performed in an editor associated with the generic model;
• providing each further set of the series of further pose parameters to the model to generate a series of output images of the body adopting the further poses;
• and
• generating, based on the series of output images, an output video, wherein each frame of the output video includes at least one of the series of output images.