US 11,381,509 B2Granted

Increased packet scheduling throughput and efficiency using úber batching

AssigneeCitrix Systems, Inc.

InventorsSeth Kenneth Keith, Mustafa Kutluk Testicioglu

Life of this patent

Estimating the term…

Loading patent…

Abstract

Described embodiments improve the performance of a computer network via selectively forwarding packets to bypass quality of service (QoS) processing, avoiding processing delays during critical periods of high demand, increasing throughput and efficiency may be increased by sacrificing a small amount of QoS accuracy. QoS processing may be applied to a subset of packets of a flow or connection, referred to herein as “lazy” processing or lazy byte batching. Packets that bypass QoS processing may be immediately forwarded with the same QoS settings as packets of the flow for which QoS processing is applied, resulting in tremendous overhead savings with only minimal decline in accuracy. In case of backlog, packets may be collected together into an aggregated or ‘uber’ packet, with QoS processing applied based on a virtual size of the aggregated packet.

Claims18

Dependent claims

A method for improving network efficiency, comprising:

receiving, by a device, a plurality of packets of a flow to be transmitted via a connection;
determining, by the device, that the flow is not backlogged;
transmitting, by the device, a first subset of the received plurality of packets of the flow, responsive to the determination that the flow is not backlogged;
subsequently determining, by the device, that the flow is backlogged;
aggregating, by the device, a second subset of the plurality of packets in a virtual aggregate packet having a virtual packet size equal to a sum of sizes of the second subset of the plurality of packets, responsive to the determination that the flow is backlogged;
determining, by the device, that a throughput credit for the virtual aggregate packet exceeds a threshold, the throughput credit based upon the virtual packet size;
applying quality of service (QoS) processing to the virtual aggregate packet, by the device, responsive to the throughput credit for the virtual aggregate packet exceeding the threshold;
and
transmitting, by the device, the virtual aggregate packet.

6 more elements

A system for improving network efficiency, comprising:

a device, comprising a network interface, a processor, and a memory storing a throughput credit for a flow;
wherein the network interface is configured to receive a plurality of packets of the flow;
and
wherein the processor is configured to:
determine that the flow is not backlogged,
transmit a first subset of the received plurality of packets of the flow, responsive to the determination that the flow is not backlogged;
subsequently determine that the flow is backlogged,
aggregate a second subset of the plurality of packets in a virtual aggregate packet having a virtual packet size equal to a sum of sizes of the second subset of the plurality of packets, responsive to the determination that the flow is backlogged,
determine that a throughput credit for the virtual aggregate packet exceeds a threshold, the throughput credit based upon a number of packets added to the virtual aggregate packet,
apply quality of service (QoS) processing to the virtual aggregate packet, responsive to the throughput credit for the virtual aggregate packet exceeding the threshold, and
transmit the virtual aggregate packet.

8 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/007,560Filed 13 Jun 2018 · continuation in part
Priority: 17 Mar 2017
Published: US 2018/0270156 A118 Oct 2018
Granted: 5 Jul 2022
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

H04L 47/24
Flow control; Congestion control: traffic characterised by specific attributes, e.g. priority or QoS
H04L 43/026
Capturing of monitoring data: using flow identification
H04L 43/0888
Network utilisation, e.g. volume of load or congestion level: throughput
H04L 43/16
Arrangements for monitoring or testing data switching networks: threshold monitoring

Family

Application15/462,524Parent of this continuation-in-part · filed 17 Mar 2017
US 2018/0302328 A1Pre-grant publication · published 18 Oct 2018
US 10,567,285 B2Parent of this continuation-in-part
US 2018/0270156 A1Published application
US 11,381,509 B2This patent

From the US filing history. Foreign family members aren’t listed.