Real-time reconstruction of the human body and automated avatar synthesis

A computer-implemented method comprising:

• receiving discrete depth frames Di,j from a depth camera;
• calculating quadratic meshes given by Xi,j=(i−ic)Di,jcd−1, Yi,j=(j−jc)Di,jcd−1, and Zi,j=Di,j, where ic,jc denote coordinates of a central pixel in a depth frame, and cd is a focal length of the depth camera;
• detecting a presence of a particular skeletal geometry from a sequence of data frames by fitting each frame of the discrete depth frames to a skeletal model with parameters defined from
• S={al∈,bl∈,Rl∈SO(3):l∈}
• where is a set of indices of line segments defined by end-points al and bl, and its orientation in the 3D space is given by the rotation matrix Rl;
• segmenting the quadratic mesh into body regions by using the parameters of the skeletal model S;
• and
• fitting a positive-definite tensor spline of a spline model
• f
• d
• ⁡
• (
• x
• ,
• s
• )
• =
• ∑
• i
• =
• 1
• m
• ⁢
• ∑
• j
• =
• 0
• n
• ⁢
• w
• i
• ,
• j
• ⁢
• N
• j
• ,
• k
• +
• 1
• ⁡
• (
• s
• )
• ⁢
• f
• d
• ,
• i
• *
• ⁡
• (
• x
• )
• to a point-set Pl of points that belong to a particular body region of the body regions.