Reconstruction of body motion using a camera system camera system for reconstruction of body motion based on 3D joint heat map

A system, comprising:

• one or more processors;
• one or more non-transitory computer-readable storage media configured to store instructions that, in response to being executed, cause the system to perform operations, the operations comprising:
• collecting first image data and second image data of an object motion, the first image data including a plurality of first frames captured by a first camera and the second image data including a plurality of second frames captured by a second camera;
• identifying an object in each first frame of the plurality of first frames and each second frame of the plurality of second frames;
• modeling two-dimensional pose estimations of the object identified in each of the first frames and each of the second frames, the two-dimensional pose estimations indicating coordinate positions of one or more features of the object that contribute to the object motion;
• generating a first three-dimensional joint heatmap corresponding to the object identified in the plurality of first frames and a second three-dimensional joint heatmap corresponding to the object identified in the plurality of second frames, wherein the first and second three-dimensional joint heatmaps are generated from the features indicated in the two-dimensional pose estimations;
• determining a time delay between the first camera and the second camera based on the first three-dimensional joint heatmap and the second three-dimensional joint heatmap;
• and
• generating a motion journal that summarizes the object motion associated with the object identified in the plurality of first frames and the plurality of second frames based on the time delay.