Method and system for resource coherency and analysis in a network

A system, comprising:

• a switch fabric comprising a plurality of output ports (OPs);
• and
• a resource coherency and analytics engine (RCAE) comprising a virtual traffic shaper (VTS), wherein the RCAE is operatively connected to the switch fabric, wherein the VTS comprises a plurality of virtual output queues (VOQs), wherein each VOQ is associated with a virtualizable resource group (VRG)-OP pair, wherein each OP is one of the plurality of OPs and wherein each VRG is one of a plurality of VRGs, wherein the VTS is configured to:
• receive a first packet,
• make a first determination that the first packet is to be sent to a first OP of the plurality of OPs,
• make a second determination that the first packet is associated with a first VRG of a plurality of VRGs,
• store, based on the first and second determinations, the first packet in a VOQ associated with a first VRG-OP pair corresponding to the first VRG and the first OP, wherein the VOQ is one of the plurality of VOQs, and
• schedule the first packet for transmission from the VOQ to the switch fabric, wherein the VTS is further configured to:
• receive a second packet,
• make a third determination that the second packet is to be sent to a second OP of the plurality of OPs,
• make a fourth determination that the second packet is associated with a second VRG,
• obtain a second VRCL associated with the second VRG, wherein the second VRCL further specifies a cut-through policy for the second VRG, and
• schedule the second packet for transmission to the switch fabric without storing the second packet in any of the plurality of VOQs based on the cut-through policy.

A system, comprising:

• a switch fabric comprising a plurality of output ports (OPs);
• and
• a resource coherency and analytics engine (RCAE) comprising a virtual traffic shaper (VTS), wherein the RCAE is operatively connected to the switch fabric, wherein the VTS comprises a plurality of virtual output queues (VOQs), wherein each VOQ is associated with a virtualizable resource group (VRG)-OP pair, wherein each OP is one of the plurality of OPs and wherein each VRG is one of a plurality of VRGs, wherein the VTS is configured to:
• receive a first packet,
• make a first determination that the first packet is to be sent to a first OP of the plurality of OPs,
• make a second determination that the first packet is associated with a first VRG of a plurality of VRGs,
• store, based on the first and second determinations, the first packet in a VOQ associated with a first VRG-OP pair corresponding to the first VRG and the first OP,
• wherein the VOQ is one of the plurality of VOQs, and
• schedule the first packet for transmission from the VOQ to the switch fabric, wherein the VTS is further configured to:
• receive a second packet,
• make a third determination that the second packet is to be sent to a second OP of the plurality of OPs,
• make a fourth determination that the second packet is associated with the first VRG,
• store, based on the third and fourth determinations, the second packet in a second VOQ associated with a second VRG-OP pair corresponding to the first VRG and the second OP, and
• schedule the second packet for transmission from the second VOQ to the switch fabric.

A system, comprising:

• a switch fabric comprising a plurality of output ports (OPs);
• and
• a resource coherency and analytics engine (RCAE) comprising a virtual traffic shaper (VTS), wherein the RCAE is operatively connected to the switch fabric, wherein the VTS comprises a plurality of virtual output queues (VOQs), wherein each VOQ is associated with a virtualizable resource group (VRG)-OP pair, wherein each OP is one of the plurality of OPs and wherein each VRG is one of a plurality of VRGs, wherein the VTS is configured to:
• receive a first packet,
• make a first determination that the first packet is to be sent to a first OP of the plurality of OPs,
• make a second determination that the first packet is associated with a first VRG of a plurality of VRGs,
• store, based on the first and second determinations, the first packet in a VOQ associated with a first VRG-OP pair corresponding to the first VRG and the first OP,
• wherein the VOQ is one of the plurality of VOQs, and
• schedule the first packet for transmission from the VOQ to the switch fabric, wherein the VTS is further configured to:
• receive a second packet,
• make a third determination that the second packet is to be sent to the first OP,
• make a fourth determination that the second packet is associated with a second VRG,
• store, based on the third and fourth determinations, the second packet in a second VOQ associated with a second VRG-OP pair corresponding to the second VRG and the first OP, and
• schedule the second packet for transmission from the second VOQ to the switch fabric, wherein the first packet is scheduled for transmission based on a first drain rate, wherein the second packet is scheduled for transmission based on a second drain rate, wherein the first drain rate is different than the second drain rate.

A network device, comprising:

• a switch fabric comprising a plurality of output ports (OPs);
• and
• a resource coherency and analytics engine (RCAE) comprising:
• a plurality of input ports each configured to receive packets,
• a plurality of virtual traffic shapers (VTSs) each associated with one of the plurality of input ports, wherein each of the plurality of VTSs comprises a plurality of virtual output queues (VOQs) and a plurality of virtualizable resource groups (VRG), wherein each VOQ is associated with a VRG-OP pair for an OP from the plurality of OPs and a VRG from the plurality of VRGs, wherein at least one of the plurality of VRGs is associated with one or more virtual networks,
• a vResource Snooper configured to obtain RCAE statistics from each of the plurality of VTSs,
• a vCoherency Controller configured to obtain the RCAE statistics from the vResource Snooper and set VTS operating parameters based on the RCAE statistics, and
• a vResource Policy Feedback Module configured to obtain the VTS operating parameters from the vCoherency controller and provide the VTS operating parameters to at least one of the plurality of VTSs, wherein a first VRG of the plurality of VRGs is associated with a first virtual network comprising a first virtual machine located on a first host and a second virtual machine located on a second host, wherein the RCAE is configured to initiate a migration of the second virtual machine to the first host when a latency for packets communicated between the first virtual machine and the second virtual machine exceeds a pre-determined threshold.

A network device, comprising:

• a switch fabric comprising a plurality of output ports (OPs);
• and
• a resource coherency and analytics engine (RCAE) comprising:
• a first input port;
• a first Virtual Traffic Shaper (VTS) comprising:
• a first virtual output queue (VOQ) associated with a first virtualizable resource group (VRG)-OP pair corresponding to a first VRG and a first OP, wherein the first VOQ is configured to receive packets from the first input port;
• and
• a first VOQ drainer is associated with a first drain rate, wherein the first drain rate specifies a rate at which packets in the first VOQ are scheduled for transmission to the switch fabric, and wherein the first VOQ drainer is configured to schedule a first packet in the first VOQ for transmission based on the first drain rate;
• a vCoherency Controller configured to obtain RCAE statistics from the first VTS and update the first drain rate to obtain an updated first drain rate using the RCAE statistics obtained from the first VTS, wherein the RCAE is configured to provide the first VOQ drainer with the updated first drain rate;
• a second input port;
• and
• a second VTS comprising:
• a second virtual output queue (VOQ) associated with a second VRG-OP pair corresponding to a first VRG and a second OP, wherein the second VOQ is configured to receive packets from the second input port;
• and
• a second VOQ drainer is associated with a second drain rate, wherein the second drain rate specifies a rate at which packets in the second VOQ are scheduled for transmission to the switch fabric, and wherein the second VOQ drainer is configured to schedule a second packet in the second VOQ for transmission based on the second drain rate, wherein the vCoherency Controller is further configured to obtain RCAE statistics from the second VTS and update the second drain rate to obtain an updated second drain rate based on the RCAE statistics obtained from first VTS and the RCAE statistics obtained from the second VTS, wherein the RCAE is further configured to provide the second VOQ drainer with the updated second drain rate.