Systems and methods of using audio and stacked computer vision algorithms in user environment and user behavior detection

A non-transient computer readable medium containing program instructions for causing a computer to perform a method for processing a video feed of a user performing a diagnostic test using a set of stacked computer vision algorithms, the method comprising:

• receiving, from a user device, the video feed of the user performing the diagnostic test, wherein the video feed was evaluated for quality and accuracy using a ground truth stress test applied to an image captured by the user device, wherein the captured image is of a reference card associated with the diagnostic test;
• applying the set of stacked computer vision algorithms to the video feed to extract, from the video feed, a user behavior exhibited while the user performed the diagnostic test;
• evaluating a plurality of markers associated with the exhibited user behavior based on the set of stacked computer vision algorithms;
• generating a marker profile for the exhibited user behavior based on the plurality of markers associated with the exhibited user behavior;
• comparing the marker profile for the exhibited user behavior against marker profiles in an anomalous behavior database;
• identifying a similar marker profile in the anomalous behavior database, wherein the similar marker profile is associated with a type of anomalous user behavior;
• and
• classifying the exhibited user behavior under the type of anomalous user behavior.