Emotion and action tracking and tracking for video conferencing

A system for extraction of nonverbal communication data from video, comprising:

• a computing device comprising a processor and a camera;
• wherein the camera is configured to capture a video stream of a user;
• and
• wherein the processor is configured to:
• select a plurality of individual frames of the video stream,
• for each of the plurality of individual frames of the video stream:
• extract a plurality of features;
• and
• identify, from the extracted plurality of features, a pose of the user, and
• classify, via a neural network from the identified poses of the user for the plurality of individual frames of the video stream, the video stream as showing one of a predetermined plurality of states.

A non-transitory computer-readable medium comprising instructions that, when executed by a processor of a computing device, cause the processor to perform operations comprising:

• retrieving, from a camera of the computing device, a video stream of a user;
• selecting a plurality of individual frames of the video stream;
• for each of the plurality of individual frames of the video stream:
• extracting a plurality of features, and
• identifying, from the extracted plurality of features, a pose of the user;
• and
• classifying, via a neural network from the identified poses of the user for the plurality of individual frames of the video stream, the video stream as showing one of a predetermined plurality of states.