Bulk data processing system
AssigneeAT&T Intellectual Property I, L.P.
InventorsLetian Chen, Baofeng Jiang, Christopher Du, Yew-Aik Lim
Life of this patent
Estimating the term…
Abstract
The system allows real time collection and processing of massive data from many network elements. It has an elastic architecture that scales horizontally to support different network sizes. The system in a uniform data format for downstream consumption. It employs a pub/sub data distribution mechanism that supports multiple concurrent downstream subscribers efficiently in real-time.
Claims19
A method comprising:
- obtaining data from a network device, wherein the network device processes the data from a wireless network;
- determining a type of the data from the network device;
- based on the type of data, transforming the data into a standardized format;
- partitioning the data into chunks, wherein the chunks are based on a cell identifier;
- obtaining the data in the standardized format by a messaging layer, wherein the messaging layer comprises messaging layer devices that partition the data in the standardized format into a first topic;
- and
- based on the first topic, publishing the partitioned data in the standardized format to a correlation layer, wherein the correlation layer comprises correlation layer devices that further processes the partitioned data in the standardized format to add information that places the data into a second topic.
A computer readable storage medium storing computer executable instructions that when executed by a computing device cause said computing device to effectuate operations comprising:
- obtaining data from a network device, wherein the network device processes the data from a wireless network;
- determining a type of the data from the network device;
- based on the type of data, transforming the data into a standardized format;
- partitioning the data into chunks, wherein the chunks are based on a type of network device;
- obtaining the data in the standardized format by a messaging layer, wherein the messaging layer comprises messaging layer devices that partition the data in the standardized format into a first topic;
- and
- based on the first topic, publishing the partitioned data in the standardized format to a correlation layer, wherein the correlation layer comprises correlation layer devices that further processes the partitioned data in the standardized format to add information that places the data into a second topic.
A system comprising:
- one or more processors;
- and
- memory coupled with the one or more processors, the memory storing executable instructions that when executed by the one or more processors cause the one or more processors to effectuate operations comprising:
- obtaining data from a network device, wherein the network device processes the data from a wireless network;
- determining a type of the data from the network device;
- based on the type of data, transforming the data into a standardized format;
- partitioning the data into chunks;
- obtaining the data in the standardized format by a messaging layer, wherein the messaging layer comprises messaging layer devices that partition the data in the standardized format into a first topic;
- and
- based on the first topic, publishing the partitioned data in the standardized format to a correlation layer, wherein the correlation layer comprises correlation layer devices that further processes the partitioned data in the standardized format to add information that places the data into a second topic.
Dependencies are inferred from the claim text.