System for estimating a three dimensional pose of one or more persons in a scene

A system for estimating a three dimensional pose of one or more persons in a scene, the system comprising:

• one or more cameras, the one or more cameras configured to capture one or more images of the scene;
• and
• a data processor including at least one hardware component, the data processor configured to execute computer executable instructions, the computer executable instructions comprising instructions for:
• receiving the one or more images of the scene from the one or more cameras;
• extracting features from the one or more images of the scene for providing inputs to a first branch pose estimation neural network;
• extracting features from the one or more images of the scene for providing inputs to a second branch pose estimation neural network;
• generating, by using a three dimensional reconstruction module, three dimensional reconstructions from two dimensional pose estimates produced by the second branch pose estimation neural network;
• projecting, by using a reprojection module, the three dimensional reconstructions to camera image planes of respective image samples, and uploading the reprojections and image samples to an annotation server;
• retrieving the image samples and associated reprojections from the annotation server, and displaying the image samples and associated reprojections to one or more human annotators using an annotation interface so that the one or more human annotators are able to produce corrected annotations using the annotation interface;
• and
• sending the corrected annotations back to the three dimensional reconstruction module so that the three dimensional reconstruction module is able to generate accurate three dimensional reconstructions.