Generating physio-realistic avatars for training non-contact models to recover physiological characteristics

A system for training a machine learning model using video sequences including physio-realistic avatars, the system comprising:

• a processor;
• and
• memory storing instructions, which when executed by the processor, cause the processor to:
• receive a request from a requesting entity to train a machine learning model to detect a physiological characteristic;
• receive a plurality of video segments, wherein one or more of the video segments includes a synthetic physio-realistic avatar generated with the physiological characteristic;
• train the machine learning model with the plurality of video segments;
• and
• provide a trained model to the requesting entity.

A computer-readable media including instructions, which when executed by a processor, cause the processor to:

• receive a request to recover a physiological characteristic from a video segment;
• obtain a machine learning model trained with training data that includes physio-realistic avatars generated with the physiological characteristic;
• receive a video segment;
• identify a measure associated with the physiological characteristic from the video segment using the trained machine learning model;
• and
• provide an assessment of the physiological characteristic to the requesting entity based on the measure.