Generating and providing personalized digital content in real time based on live user context

A non-transitory computer readable storage medium comprising instructions that, when executed by at least one processor, cause a computing device to:

• collect a stream of digital media comprising a digital video portraying a user while the user accesses one or more web sites via a client device;
• and
• generate personalized digital content to provide for display to the user within the one or more websites based on the digital video portraying the user while the user accesses the one or more websites by:
• analyzing the digital video utilizing a facial detection model and an object detection model to identify characteristics of the user portrayed in the digital video;
• utilizing a context-based digital content machine learning model to select a subset of digital content from a repository of digital content based on the identified characteristics of the user, wherein the context-based digital content machine learning model comprises a neural network trained to increase a machine learning training reward determined from a predict user response to proposed digital content based on training digital content, training user contexts, and ground truth responses;
• and
• while the user accesses the one or more websites:
• modifying the one or more web sites to include the subset of digital content;
• and
• providing the modified one or more websites for display via the client device.

A system comprising:

• at least one processor;
• and
• at least one non-transitory computer readable storage medium storing instructions that, when executed by the at least one processor, cause the system to:
• collect a stream of digital media comprising a digital video portraying a user while the user accesses one or more websites via a client device;
• and
• generate personalized digital content to provide for display to the user within the one or more websites based on the digital video portraying the user while the user accesses the one or more websites by:
• analyzing the digital video utilizing a facial detection model to identify facial characteristics of the user portrayed in the digital video;
• analyzing the digital video utilizing an object detection model comprising a neural network classifier to identify an object portrayed in the digital video;
• utilizing a context-based digital content machine learning model to select a subset of digital content from a repository of digital content based on the identified facial characteristics of the user and the identified object, wherein the context-based digital content machine learning model comprises a reinforcement learning model trained to select digital content based on machine learning training rewards determined from user responses resulting from providing to provided digital content;
• and
• while the user accesses the one or more websites:
• modifying the one or more web sites to include the subset of digital content;
• and
• providing the modified one or more websites for display via the client device.