Telemetry data abstraction

A system comprising:

• an interface that receives one or more user-defined functions for the system;
• and one or more processors to:
• implement programmatically the one or more user-defined functions;
• collect telemetry data at a plurality of Operating System (OS) layers in a telemetry pipeline based on the one or more user-defined functions;
• calculate smart metrics at different layers in the plurality of OS layers in the telemetry pipeline, wherein the smart metrics are built in a hierarchal manner with increasing complexity from a lower layer to an upper layer, and wherein the smart metrics are calculated at a layer closest to where associated telemetry data is collected;
• and
• aggregate the telemetry data and the smart metrics across the plurality of OS layers in the telemetry pipeline.

A method of using a telemetry pipeline to abstract telemetry data, the method comprising:

• receiving one or more user-defined functions for a system;
• implementing programmatically the one or more user-defined functions;
• collecting telemetry data at a plurality of Operating System (OS) layers in the telemetry pipeline based on the one or more user-defined functions;
• calculating smart metrics at different layers in the plurality of OS layers in the telemetry pipeline, wherein calculating the smart metrics comprises taking a mathematical function of the telemetry data, wherein the smart metrics are built in a hierarchal manner with increasing complexity from a lower layer to an upper layer, and wherein the smart metrics are calculated at a layer closest to where respective telemetry data is collected;
• and
• aggregating the telemetry data and the smart metrics across the plurality of OS layers in the telemetry pipeline.