Apparatus and method for synchronization with virtual avatar, and system for synchronization with virtual avatar

A method for synchronization with a virtual avatar, comprising:

• detecting a body part of a human in an input 2D image;
• estimating a shape and pose of a visible body part based on the detected body part;
• generating a shape and pose of an invisible body part based on the body part and a shape and pose of the body part;
• estimating a full-body shape and pose based on the shape and pose of the visible body part and the shape and pose of the invisible body part;
• and
• encoding and transmitting the estimated full-body shape and pose for synchronization with a virtual avatar that is modeled in advance in a server.

A system for synchronization with a virtual avatar, comprising:

• a body part detection unit for detecting a body part of a human in an input 2D image;
• a visible body part estimation unit for estimating a shape and pose of a visible body part based on the detected body part;
• an invisible body part generation unit for generating a shape and pose of an invisible body part based on the body part and a shape and pose of the body part;
• a body estimation unit for estimating a full-body shape and pose based on the shape and pose of the visible body part and the shape and pose of the invisible body part;
• a server for storing a virtual avatar modeled in advance;
• and
• an avatar synchronization unit for encoding and transmitting the estimated full-body shape and pose for synchronization with the avatar modeled in advance in the server.