Telemetry data processing in cluster file system with dynamic registration of new metrics from telemetry producers
AssigneeDell Products L.P.
InventorsSupriya Kannery, Rajat Badola, Philip Shilane
Life of this patent
Estimating the term…
Abstract
A telemetry processing system in a cluster network generates telemetry data from a plurality of telemetry producers and formats it into a structured format for storage in a datastore. Producers can define new metrics for use in a running network. Schema for a new metric is validated by a schema validator and stored in a telemetry catalog. Telemetry datasets for the new metric are sent from the producer for storage in a datastore. Consumers are notified as to the availability of the new metric, and those who elect to receive the new metric are sent the new datasets along with their previous datasets.
Claims20
A method of processing telemetry data in a cluster network having a plurality of nodes, comprising:
- storing the telemetry data as generated by telemetry producers in the network in a datastore as metric datasets having a defined schema;
- receiving a new metric schema for a new telemetry metric generated by a producer;
- validating the new metric schema in a schema validator component of a telemetry transmitter;
- storing the validated new metric schema in a telemetry catalog;
- and
- storing a new telemetry metric dataset for the new telemetry metric in the datastore for transmission to appropriate telemetry consumers.
A method of processing telemetry data in a cluster network having a plurality of telemetry producers each periodically generating metric datasets, comprising:
- first receiving schema definitions of metric datasets of the telemetry data produced by the telemetry producers;
- storing the schema definitions in a telemetry catalog accessed by a telemetry transmitter;
- second receiving a new schema definition for a new metric dataset produced by a producer;
- validating the new schema definition for inclusion in the telemetry catalog;
- and
- transmitting the new metric dataset to through a selected transport mechanism to subscribing consumers.
A system processing telemetry data in a cluster network having nodes each containing a plurality of pods, the system comprising:
- a datastore storing the telemetry data as generated by telemetry producers in the network in a datastore as metric datasets having a defined schema
- an interface receiving a new metric schema for a new telemetry metric generated by a producer;
- a schema validator component of a telemetry transmitter validating the new metric schema;
- a telemetry catalog storing the validated new metric schema;
- and
- a datastore storing a new telemetry metric dataset for the new telemetry metric in the datastore for transmission to appropriate telemetry consumer by the telemetry transmitter.
Dependencies are inferred from the claim text.