Method and apparatus for dynamic load balancing over a network link bundle

A method for distributing data packets over a bundle of communication links between two network devices, the method comprising:

• receiving in an output data queue a current data packet based on a data packet received at an ingress port;
• receiving state data that indicates a physical state of a first port buffer of a plurality of port buffers for active egress ports connected to the bundle of communication links with one particular network device other than a fill level for the first port buffer;
• wherein the plurality of port buffers for the plurality of active egress ports is different from a plurality of output data queues that include the output data queue;
• determining whether the state data indicates the first port buffer is unsuitable for receiving additional data;
• and
• if it is determined that the state data indicates the first port buffer is unsuitable for receiving the additional data, then directing the queued current data packet to a second different port buffer of the plurality of port buffers for the active egress ports.

An apparatus for distributing data packets over a bundle of communication links between two network devices, the apparatus comprising:

• means for receiving first commitment data that indicates an amount of data in a data flow queue directed to a buffer for a port of a plurality of active egress ports connected to the bundle of communication links with one particular network device, wherein:
• a plurality of buffers for the plurality of active egress ports is different from a plurality of data flow queues that include the data flow queue;
• and
• a plurality of data packets in such data flow queue are to be received at the particular network device in a same sequence as stored in the data flow queue;
• means for receiving an output data packet from a particular data flow queue that is not directed to any buffer of the plurality of buffers;
• means for determining a particular buffer based at least in part on the first commitment data;
• and
• means for directing the output data packet to the particular buffer.

An apparatus for distributing data packets over a bundle of communication links between two network devices, the apparatus comprising:

• an ingress network interface that is coupled to a network for receiving from the network an inbound data packet;
• an egress network interface that includes a plurality of active egress ports coupled to the bundle of communication links with one particular network device for sending a current data packet to that particular device;
• a plurality of output data flow queues;
• a plurality of buffers for the plurality of active egress ports, wherein the output data flow queues are different than the buffers;
• a computer-readable medium for storing information;
• one or more processors;
• and
• one or more sequences of instructions stored on the computer-readable medium, which, when executed by the one or more processors, results in:
• storing an output data packet in a data flow queue of the plurality of output data flow queues based on a flow identification associated with the output data packet, wherein:
• the output data packet is based on the inbound data packet;
• and
• the flow identification indicates a set of one or more data packets including the output data packet that are to be sent in a same sequence as received on the ingress network interface;
• receiving state data that indicates a physical status of a first buffer of the plurality of buffers;
• determining a particular output data flow queue based at least in part on the state data;
• and
• directing a next data packet from the particular output data flow queue to a second different buffer of the plurality of buffers.

An apparatus for distributing data packets over a bundle of communication links between two network devices, the apparatus comprising:

• an ingress network interface that is coupled to a network for receiving from the network an inbound data packet;
• an egress network interface that includes a plurality of active egress ports coupled to the bundle of communication links with one particular network device for sending a current data packet to that particular device;
• a computer-readable medium for storing information;
• one or more processors;
• and
• one or more sequences of instructions stored on the computer-readable medium, which, when executed by the one or more processors, results in:
• receiving first commitment data that indicates an amount of data in a data flow queue directed to a buffer for a port of the plurality of active egress ports, wherein:
• a plurality of buffers for the plurality of active egress ports is different from a plurality of data flow queues that include the data flow queue;
• and
• a plurality of data packets in such data flow queue are to be received at the particular network device in a same sequence as stored in the data flow queue;
• receiving an output data packet from a particular data flow queue that is not directed to any buffer of the plurality of buffers;
• determining a particular buffer for a data flow queue that is not already directed to any buffer of the plurality of buffers based at least in part on the first commitment data;
• and
• directing a particular output data packet from the data flow queue that is not already directed to any buffer to the particular buffer.

An apparatus for distributing data packets over a bundle of communication links between two network devices, the apparatus comprising:

• an ingress network interface that is coupled to a network for receiving from the network an inbound data packet, the ingress network interface associated with a plurality of data flow queues;
• an egress network interface that includes a plurality of active egress ports coupled to the bundle of communication links with one particular network device for sending a current data packet to that particular device, wherein each egress port is associated with a buffer, wherein the associated buffers are different than the data flow queues;
• a computer-readable medium for storing information;
• one or more processors;
• and
• one or more sequences of instructions stored on the computer-readable medium, which, when executed by the one or more processors, results in:
• receiving the current data packet based on the inbound data packet in the data flow queues;
• receiving state data that indicates a physical state of a first buffer of the plurality of buffers other than a fill level for the first buffer;
• determining whether the state data indicates the first buffer is unsuitable for receiving additional data;
• and
• if it is determined that the state data indicates the first buffer is unsuitable for receiving the additional data, then directing the current data packet stored in the data flow queues to a second different buffer of the plurality of buffers.