User engagement computer system and method of using same

A computer-implemented method for interactive engagement by two or more user devices, each associated with a different user, with a user engagement computer system that is in communication with the two or more user devices, wherein the two or more user devices each has a respective audio sensor, a respective video sensor, and a respective motion sensor, the method comprising:

• (a) detecting, by the user engagement computer system during a video chat session comprising substantially simultaneous presentation of audio and video between the two or more user devices using outputs from at least one of the respective audio sensors, the respective video sensors, and the respective motion sensors, a gestural input by one or more of the respective users of the two or more user devices;
• (b) in response to detecting the gestural input, determining, during the video chat session by the user engagement system, that the detected gestural input matches gestural content stored in a content database, wherein the match is based on a confidence score that reflects how closely the detected gestural input matches the stored gestural content;
• and
• (c) transmitting, by the user engagement system to the one or more of the respective users of the two or more user devices, a command corresponding to the matched stored gestural content, wherein the command initiates
• an automated action to further engage at least one of the respective users.