Apparatus and methods for determining multi-subject performance metrics in a three-dimensional space

A system comprising:

• a first image capture device to generate first image data, the first image data including a first view of a subject;
• a second image capture device to generate second image data, the second image data including a second view of the subject;
• and
• a processor to:
• predict first positions of two-dimensional keypoints of the subject based on the first image data;
• assign a first identifier to the subject in the first image data based on the first positions of the two-dimensional keypoints;
• predict second positions of two-dimensional keypoints of the subject based on the second image data;
• assign a second identifier to the subject in the second image data based on the second positions of two-dimensional keypoints;
• identify the subject as a first subject in the first image data and the second image based on the first identifier and the second identifier;
• predict three-dimensional keypoints for the first subject based on the first positions of the two-dimensional keypoints and the second positions of the two-dimensional keypoints in the second image;
• and
• determine a performance metric for the subject using the three-dimensional keypoints.

At least one non-transitory computer readable medium comprising instructions that, when executed, cause at least one processor to at least:

• identify a first subject in a first image captured by a first image capture device based on a first set of two-dimensional kinematic keypoints in the first image, the first set of two-dimensional kinematic keypoints corresponding to one or more joints of the first subject, the first image capture device associated with a first view of the first subject;
• verify the first subject using the first image and a second image captured by a second image capture device, the second image capture device associated with a second view of the first subject, the second view different than the first view;
• generate three-dimensional keypoints for the first subject using the first set of two-dimensional kinematic keypoints and a second set of keypoints in the second image;
• and
• determine a performance metric for the first subject using the three-dimensional keypoints.