Method and System for Delivering Data to a Batch Consumer and a Streaming Consumer
AssigneeInMobi PTE Ltd.
InventorsInderbir Singh Pall, Sharad Agarwal
Life of this patent
Estimating the term…
Abstract
A method and system delivers data to a batch consumer and a streaming consumer. The method and system include retrieving data from a plurality of data centers, storing the data in a first directory, bundling the data into plurality of batches in the first directory, transferring each batch of the plurality of batches to the second directory, delivering the each batch of the plurality of batches in the second directory to the batch consumer and the streaming consumer and delivering the data in the first directory to the streaming consumer.
Claims8
A method for providing data to a batch consumer and a streaming consumer, the method comprising:
- retrieving data from a plurality of data centers, wherein the data is continuously streamed from the plurality of data centers;
- storing the data in a first directory;
- bundling the data into a plurality of batches in the first directory, wherein bundling the data is in accordance with a predefined time period;
- transferring the plurality of batches to a second directory, wherein each batch of the plurality of batches is immutable;
- delivering the each batch of the plurality of batches in the second directory to the batch consumer;
- and
- delivering the data in the first directory and each batch of the plurality of batches in the second directory to the streaming consumer.
A system for providing data to a batch consumer and a streaming consumer, the system comprising:
- a data retrieval module, wherein the data retrieval module is configured to retrieve data from a plurality of data centers;
- a storage module, wherein the storage module is configured to store the data;
- wherein the storage module comprises a first directory and a second directory;
- a bundler, wherein the bundler is configured to bundle the data into a plurality of batches in the first directory;
- a transmitting module, wherein the transmitting module is configured to transmit the each batch of the plurality of batches to the second directory;
- and
- a delivery module, wherein the delivery module is configured to deliver the data in the first directory to the streaming consumer and each batch of the plurality of batches to the batch consumer and the streaming consumer.
Dependencies are inferred from the claim text.