System and method for rapid and asynchronous multitenant telemetry collection and storage

A computer-implemented method for collection and storage of telemetry data, comprising:

• receiving a telemetry storage request from a telemetry application configured to collect telemetry information from a deployed application, wherein the telemetry storage request comprises telemetry information and associated telemetry tag information;
• queuing the received telemetry storage request into a gatekeeper command queue, wherein the gatekeeper command queue is configured to store the received telemetry storage request;
• retrieving the received telemetry storage request from the gatekeeper command queue;
• generating a decorated telemetry collection event based on the telemetry information and the associated telemetry tag information;
• publishing the decorated telemetry collection event to an event stream by transmitting the decorated telemetry collection event to an event stream component configured to manage the event stream, wherein the event stream is utilized by a notification-and-telemetry processing component to train one or more machine learning algorithms to Dredict an occurrence of one or more breach conditions;
• transmitting a telemetry storage success response to the telemetry application indicating that the telemetry storage request has been properly received and queued;
• caching the telemetry information and the associated telemetry tag information into a gatekeeper cache data store;
• and
• remove, by the gatekeeper worker component, the queued telemetry storage request from the gatekeeper command queue after the decorated telemetry collection event is published by the event stream component.

A non-transitory computer-readable storage device having instructions stored thereon that, when executed by at least one processor, cause the at least one processor to perform operations for collection and storage of telemetry data, the operations comprising:

• receiving a telemetry storage request from a telemetry application configured to collect telemetry information from a deployed application, wherein the telemetry storage request comprises telemetry information and associated telemetry tag information;
• queuing the received telemetry storage request into a gatekeeper command queue, wherein the gatekeeper command queue is configured to store the received telemetry storage request;
• retrieving the received telemetry storage request from the gatekeeper command queue;
• generating a decorated telemetry collection event based on the telemetry information and the associated telemetry tag information;
• publishing the decorated telemetry collection event to an event stream by transmitting the decorated telemetry collection event to an event stream component configured to manage the event stream, wherein the event stream is utilized by a notification-and-telemetry processing component to train one or more machine learning algorithms to predict an occurrence of one or more breach conditions;
• transmitting, a telemetry storage success response to the telemetry application indicating that the telemetry storage request has been properly received and queued;
• and
• caching the telemetry information and the associated telemetry tag information into a gatekeeper cache data store;
• and
• removing, by the gatekeeper worker component, the queued telemetry storage request from the gatekeeper command queue after the decorated telemetry collection event is published by the event stream component.