Practical overlay network latency measurement in datacenter

A non-transitory machine readable medium storing a program which when executed by a set of processing units of a controller identifies packet latency in a software defined datacenter (SDDC), the SDDC comprising a network, a plurality of host computers executing a plurality of machines, and at least one controller, the program comprising sets of instructions for:

• receiving, for a packet flow sent from a source machine executing on a source host computer to a destination machine executing on a destination host computer, a first plurality of processing time values comprising at least one processing time value for each packet-processing operation in a first plurality of packet-processing operations performed on the flow at the source host computer and a second plurality of processing time values comprising at least one processing time value for each packet-processing operation in a second plurality of packet-processing operations performed on the flow at the destination host computer;
• receiving, for the flow, a plurality of transmission time values associated with packet flow transmission between the source and destination host computers through the SDDC network;
• and
• processing the first and second pluralities of processing time values and the plurality of transmission time values to identify first and second pluralities of processed latencies and a transmission latency, the first plurality of processed latencies including one processed latency value experienced by the flow for each packet-processing operation at the source host computer, the second plurality of processed latencies including one processed latency value experienced by the flow for each packet-processing operation at the destination host computer, and the transmission latency specifying a latency experienced by the flow in the transmission from the source host computer to the destination host computer through the SDDC network.