Bulk data processing system
AssigneeAT&T Intellectual Property I, L.P.
InventorsLetian Chen, Baofeng Jiang, Christopher Du, Yew-Aik Lim
Life of this patent
Estimating the term…
Abstract
The system allows real time collection and processing of massive data from many network elements. It has an elastic architecture that scales horizontally to support different network sizes. The system in a uniform data format for downstream consumption. It employs a pub/sub data distribution mechanism that supports multiple concurrent downstream subscribers efficiently in real-time.
Claims20
A method comprising:
- partitioning, by a processing system including a processor, data into chunks, wherein the chunks are based on a cell identifier, the partitioning resulting in partitioned data;
- publishing, by the processing system, the partitioned data in a standardized format in a first topic;
- responsive to publishing the partitioned data in the standardized format in the first topic, obtaining, by the processing system, the partitioned data in the standardized format in a second topic;
- and
- publishing, by the processing system, the partitioned data in the standardized format to a subscriber of the second topic.
A system comprising:
- one or more processors;
- and
- memory coupled with the one or more processors, the memory storing executable instructions that when executed by the one or more processors cause the one or more processors to effectuate operations, the operations comprising:
- transforming data obtained from a wireless network into a standardized format;
- partitioning the data into chunks, wherein the chunks are based on a cell identifier, the partitioning resulting in partitioned data;
- publishing the partitioned data in the standardized format in a first topic;
- responsive to publishing the partitioned data in the standardized format in the first topic, obtaining the partitioned data in the standardized format in a second topic;
- and
- publishing the partitioned data in the standardized format to a subscriber of the second topic.
A tangible computer readable storage medium storing computer executable instructions that when executed by a processing system including a processor cause said processing system to effectuate operations, the operations comprising:
- determining a type of obtained data;
- based on the determining, transforming the obtained data into a standardized format;
- partitioning the obtained data into chunks, resulting in partitioned data;
- publishing the partitioned data in the standardized format in a first topic;
- responsive to publishing the partitioned data in the standardized format in the first topic, obtaining the partitioned data in the standardized format in a second topic;
- and
- publishing the partitioned data in the standardized format to a subscriber of the second topic.
Dependencies are inferred from the claim text.