Method and system that streams real-time, processed data from remote processor-controlled appliances

A system for generating data streams representing characteristic of user interactions, the system comprising:

• a data-collection system, comprising one or more first processors and one or more first memories, the one or more first memories containing first instructions which when executed on the one or more first processors, cause the one or more first processors to perform first actions including:
• receiving, by the data-collection system, a set of event messages from one or more user devices, each event message of the set of event messages including a uniform resource locator (URL) and having been generated at least in part by execution of instrumentation by the one or more user devices, the instrumentation including a monitoring script having been inserted into a code underlying an operation of an application comprising one of a webpage, software application or control program, wherein execution of the instrumentation is configured to:
• detect a current time associated with a current instance of user interaction with an application;
• detect a previous time associated with a previous instance of user interaction with the application;
• determine that a difference between the current time and the previous time exceeds a threshold;
• upon determining that the difference between the current time and the previous time exceeds a threshold sending an interrupt to an operating system of the one or more user devices to trigger execution of the monitoring script, the monitoring script configured to record data representing the current instances of user interaction;
• encode the data representing the current instance of user interaction into a URL, the data including one or more interaction key/value pairs, each interaction key/value pair of the one or more interaction key/value pairs including an interaction value representing a characteristic of the current instances of user interaction;
• and
• request that a browser retrieve a remote resource specified by the URL via transmitting the URL;
• generating, by the data-collection system, a set of events by, for each event message of the set of event messages:
• extracting one or more interaction key/value pairs from the URL;
• defining an event of the set of events to include the one or more interaction key/value pairs;
• and
• encoding each event of the set of events in a binary object notation, the binary object notation is configured to serialize each event of the set of events prior to transmission;
• transmitting the set of events to a consolidation system;
• the consolidation system, comprising one or more second processors and one or more second memories, the one or more second memories containing second instructions which when executed on the one or more second processors, cause the one or more second processors to perform second actions including:
• receiving, by the consolidation system, the set of events encoded in the binary object notation;
• buffering, by the consolidation system, the set of events at a temporary storage for up to a specified duration of time;
• detecting, by the consolidation system, a request for event data;
• in response to the request, transmitting, by the consolidation system, the set of events to a processing center;
• a processing center, comprising one or more third processors and one or more third memories, the one or more third memories containing third instructions which when executed on the one or more third processors, cause the one or more third processors to perform third actions including:
• generating, by the processing center, a set of enriched events by, for each event of the set of events:
• identifying, by the processing center, a new value based on a calculation or extraction using the event;
• and
• defining, by the processing center, an enriched event of the set of enriched events to include at least one of one or more interaction key/value pairs in the event and the new value;
• performing, by the processing center, for each enriched event in the set of enriched events, a query-based filtering of the enriched events such that each value of the one or more interaction values and the new value included in a resultant filtered event corresponds to one or more event constraints associated with a client;
• and
• transmitting, by the processing center, the filtered events in a data stream to a data consumer.