Machine learning based supervised user experience for an application monitored by multiple secondary applications

A non-transitory computer readable storage medium for storing instructions that when executed by a computer processor cause the computer processor to perform steps for managing content generated by bots for presentation to a user in association with a chat application, the steps comprising:

• monitoring of the chat application by a plurality of bots, wherein a bot generates content items for display at a user interface (UI) of the chat application in response to detecting an occurrence of an event associated with the chat application;
• receiving a plurality of content items generated by the plurality of bots;
• for each content item from the plurality of content items, the content item generated by a bot, providing input based on the content item and associated contextual information to a trained machine learning (ML) model, the associated contextual information comprising:
• (1) contextual information describing the chat application and (2) contextual information describing the bot that generated the content item;
• receiving, from the trained ML model, for each of the plurality of content items, at least one score value based on at least one predicted user response associated with potentially displaying the content item to the user at the UI;
• selecting a subset of the plurality of content items based on the received score values;
• and
• causing a display of the selected subset of the plurality of content items at the UI in addition to a display of content generated by the chat application.

A computer system comprising:

• a computer processor;
• and
• a non-transitory computer readable storage medium for storing instructions that when executed by the computer processor cause the computer processor to perform steps for managing content generated by bots for presentation to a user in association with a chat application, the steps comprising:
• monitoring of the chat application by a plurality of bots, wherein a bot generates content items for display at a user interface (UI) of the chat application in response to detecting an occurrence of an event associated with the chat application;
• receiving a plurality of content items generated by the plurality of bots one or more secondary applications for display to a user at a user interface (UI) of an executing primary user application;
• for each content item from the plurality of content items, the content item generated by a bot, providing input based on the content item and associated contextual information to a trained machine learning (ML) model, the associated contextual information comprising:
• (1) contextual information describing the chat application and (2) contextual information describing the bot that generated the content item;
• receiving, from the trained ML model, for each of the plurality of content items, at least one score value based on at least one predicted user response associated with potentially displaying the content item to the user at the UI;
• selecting a subset of the plurality of content items based on the received score values;
• and
• causing a display of the selected subset of the plurality of content items at the UI in addition to a display of content generated by the chat application.