Machine-learning based method for assessing hybrid in-person and remote audience member engagement

A system for machine learning (ML)-based assessment of a live presentation by a presenter and engagement of in-person and remote audience members, comprising:

• at least one memory;
• and
• at least one hardware processor coupled with the at least one memory and configured, individually or in combination, to:
• obtain a live presentation video stream of a live presentation, a live presenter audio stream of the live presentation, and presentation material, wherein the live presentation is associated with the presentation material;
• evaluate the live presentation using a prepared presentation evaluation machine learning model (MLM) configured to generate a presentation score based on the live presentation video stream, the live presenter audio stream, and the presentation material;
• obtain, for each audience member participating in the live presentation as an in-person audience member or a remote audience member, a plurality of video streams capturing each respective audience member, a plurality of audio streams for each respective audience member, and a plurality of capture streams capturing an interaction of each audience member and a respective computing device;
• evaluate an engagement of at least one audience member using a prepared engagement evaluation MLM configured to generate an individual engagement score for the at least one audience member based on the plurality of video streams, the plurality of audio streams, and the plurality of capture streams;
• and
• generate, by a scoring engine, a comprehension score based at least in part on the presentation score and the individual engagement score for the at least one audience member.

A non-transitory computer readable medium storing thereon computer executable instructions for machine learning (ML)-based assessment of a live presentation by a presenter and engagement of in-person and remote audience members, including instructions for:

• obtaining a live presentation video stream of a live presentation, a live presenter audio stream of the live presentation, and presentation material, wherein the live presentation is associated with the presentation material;
• evaluating the live presentation using a prepared presentation evaluation machine learning model (MLM) configured to generate a presentation score based on the live presentation video stream, the live presenter audio stream, and the presentation material;
• obtaining, for each audience member participating in the live presentation as an in-person audience member or a remote audience member, a plurality of video streams capturing each respective audience member, a plurality of audio streams for each respective audience member, and a plurality of capture streams capturing an interaction of each audience member and a respective computing device;
• evaluating an engagement of at least one audience member using a prepared engagement evaluation MLM configured to generate an individual engagement score for the at least one audience member based on the plurality of video streams, the plurality of audio streams, and the plurality of capture streams;
• and
• generating, by a scoring engine, a comprehension score based at least in part on the presentation score and the individual engagement score for the at least one audience member.