Scalable data enrichment for cloud streaming analytics
AssigneeMicrosoft Technology Licensing, LLC
InventorsOlivier Nano, Ivo Jose Garcia dos Santos, Eldar Akchurin, Tihomir Tarnavski
Life of this patent
Estimating the term…
Abstract
A method is described of pre-processing real-time data to be processed by one or more real-time analytics services. The method includes: receiving, at a stateless ingress node, data from one or more client devices; transforming the data in real-time at the stateless ingress node; determining in real-time, at the stateless ingress node, a real-time analytics service for the transformed data; and forwarding in real-time the transformed data to the determined real-time analytics service for stateful processing.
Claims20
A method of pre-processing data at a stateless ingress node, the method comprising:
- receiving, at one or more listeners of the stateless ingress node, the data from one or more client devices;
- performing, at the stateless ingress node, stateless pre-processing on the data to output transformed data formatted for a real-time analytics service, the stateless pre-processing being performed on the data received at the one or more listeners of the stateless ingress node from the one or more client devices;
- and
- forwarding the transformed data to the real-time analytics service for performance of stateful real-time analytics.
A stateless ingress node of a front-end service, the stateless ingress node comprising:
- at least one listener that receives data from one or more client devices;
- an event pipeline engine that performs stateless pre-processing on the data to output transformed data, the event pipeline engine performs the stateless pre-processing on the data received at the at least one listener of the stateless ingress node from the one or more client devices;
- and
- a transport component that sends the transformed data to a compute node for performance of stateful real-time analytics.
Computer readable storage media that comprises computer-executable instructions that, when executed by at least one processor, cause the at least one processor to perform acts including:
- receiving, at one or more listeners of a stateless ingress node, data from one or more data collecting devices;
- performing, at the stateless ingress node, stateless pre-processing on the data to output transformed data formatted for a real-time analytics service, the stateless pre-processing being performed on the data received at the one or more listeners of the stateless ingress node from the one or more data collecting devices with the data only being stored in and pre-processed from memory;
- and
- sending the transformed data from the stateless ingress node to a real-time analytics service for performance of stateful real-time analytics.
Dependencies are inferred from the claim text.