System and method for determining user interactions with visual content presented in a mixed reality environment

A system for delivering tailored visual content in an augmented reality environment, the system comprising:

• at least one network communication interface;
• at least one processing device;
• and
• at least one non-transitory storage device with computer-readable program code stored thereon and accessible by the at least one processing device, wherein the computer-readable code when executed is configured to cause the at least one processing device to:
• determine that a user is accessing an augmented reality application, via a user device;
• transmit a first set of control signals to cause one or more components of the user device to capture real-time environment data associated with a real-time environment of the user;
• identify from the real-time environment data output by the one or more components of the user device, via neural network models, one or more bodily features of the user captured by the one or more components of the user device;
• generate tailored visual content associated with at least one of the one or more bodily features captured by the one or more components of the user device, wherein the tailored visual content is application specific visual content generated based on an identified type of the augmented reality application;
• transmit the tailored visual content to the user device;
• and
• transmit a second set of control signals to cause the user device to display, via the augmented reality application, the tailored visual content associated with the one or more bodily features of the user in an augmented reality environment of the user.

A computer program product for delivering tailored visual content in an augmented reality environment, the computer program product comprising a non-transitory computer-readable storage medium comprising computer executable instructions for causing a computer processor to perform the steps of:

• determining that a user is accessing an augmented reality application, via a user device;
• transmitting a first set of control signals to cause one or more components of the user device to capture real-time environment data associated with a real-time environment of the user;
• identifying from the real-time environment data output by the one or more components of the user device, via neural network models, one or more bodily features of the user captured by the one or more components of the user device;
• generating tailored visual content associated with at least one of the one or more bodily features captured by the one or more components of the user device, wherein the tailored visual content is application specific visual content generated based on an identified type of the augmented reality application;
• transmitting the tailored visual content to the user device;
• and
• transmitting a second set of control signals to cause the user device to display, via the augmented reality application, the tailored visual content associated with the one or more bodily features of the user in an augmented reality environment of the user.

A computer implemented method for delivering tailored visual content in an augmented reality environment, wherein the method comprises:

• determining that a user is accessing an augmented reality application, via a user device;
• transmitting a first set of control signals to cause one or more components of the user device to capture real-time environment data associated with a real-time environment of the user;
• identifying from the real-time environment data output by the one or more components of the user device, via neural network models, one or more bodily features of the user captured by the one or more components of the user device;
• generating tailored visual content associated with at least one of the one or more bodily features captured by the one or more components of the user device, wherein the tailored visual content is application specific visual content generated based on an identified type of the augmented reality application;
• transmitting the tailored visual content to the user device;
• and
• transmitting a second set of control signals to cause the user device to display, via the augmented reality application, the tailored visual content associated with the one or more bodily features of the user in an augmented reality environment of the user.