Telemetry data table creation and merging in time series for optimal data storage in cluster networks

A method of improving extraction of telemetry data from a cluster network having a plurality of pods, comprising:

• collating streaming telemetry data received from each pod as a resource of the network, wherein a defined epoch delineates the streaming data into a plurality of metric datasets;
• storing each metric dataset as a database table created for the epoch in a respective cache created in a telemetry pipeline for each resource;
• and
• merging cached data for a specific resource for the epoch in a merged database table that combines metric datasets per epoch to remove duplicative information created by the plurality of metric datasets and facilitating more efficient searching and extraction of the streaming telemetry data.

A system processing for improving extraction of telemetry data from a cluster network having a plurality of pods, the system comprising:

• a telemetry pipeline receiving streaming data from each pod and constituting a resource of the network;
• a processing component defining an epoch to collate the streaming data for storing as a dataset in a database table;
• a plurality of caches created in the telemetry pipeline, with one cache for created for each resource to temporarily store the dataset for respective streaming data collated in an epoch;
• and
• a merging component in the telemetry pipeline merging cached data for a specific resource for the epoch in a merged database table.