Analyzing tags associated with high-latency and error spans for instrumented software

A system for analyzing spans and traces associated with a micro services-based application executing in a distributed computing environment, the system comprising:

• at least one memory having instructions stored thereon;
• and
• at least one processor configured to execute the instructions, wherein the at least one processor is configured to:
• aggregate a plurality of ingested spans associated with one or more applications executing in the distributed computing environment into a plurality of traces, wherein each trace of the plurality of traces comprises one or more of the plurality of ingested spans comprising a same trace identifier, wherein each of the plurality of ingested spans is annotated with a plurality of tags, wherein each tag of the plurality of tags is associated with a tag attribute and a corresponding value, wherein each tag corresponds to a context pertaining to an execution environment associated with a respective span, and wherein at least one tag associated with an ingested span of the plurality of ingested spans comprises dependency information between spans in an associated trace;
• compare durations of a set of related traces of the plurality of traces to determine patterns for the plurality of tags;
• generate a histogram representing a distribution of the durations of the set of related traces;
• and
• provide alerts for a tag from the plurality of tags associated with traces having a duration above a threshold based on the distribution of the durations
• retrieve additional information associated with the alerts by querying a data set using the tag;
• and
• annotate the additional information associated with the alerts on a dependency graph rendered for display in a graphical user interface, wherein edges for the dependency graph are rendered based on the dependency information.

A non-transitory computer-readable storage medium comprising instructions stored thereon, which when executed by one or more processors, cause the one or more processors to perform operations for analyzing spans and traces associated with a micro services-based application executing in a distributed computing environment, comprising:

• aggregating a plurality of ingested spans associated with one or more applications executing in the distributed computing environment into a plurality of traces, wherein each trace of the plurality of traces comprises one or more of the plurality of ingested spans comprising a same trace identifier, wherein each of the plurality of ingested spans is annotated with a plurality of tags, wherein each tag of the plurality of tags is associated with a tag attribute and a corresponding value, wherein each tag corresponds to a context pertaining to an execution environment associated with a respective span, and wherein at least one tag associated with an ingested span of the plurality of ingested spans comprises dependency information between spans in an associated trace;;
• comparing durations of a set of related traces of the plurality of traces to determine patterns for the plurality of tags;
• generating a histogram representing a distribution of the durations of the set of related traces;
• providing alerts for a tag from the plurality of tags associated with traces having a duration above a threshold based on the distribution of the durations
• retrieving additional information associated with the alerts by querying a data set using the tag;
• and
• annotating the additional information associated with the alerts on a dependency graph rendered for display in a graphical user interface, wherein edges for the dependency graph are rendered based on the dependency information.