US 10,592,298 B2Granted

Method for distributing load in a multi-core system

AssigneeNfware, Inc.

InventorsAlexander Britkin, Viacheslav Morozov, Igor Pavlov

Life of this patent

Estimating the term…

Loading patent…

Abstract

A system and method for processing a data packet. The method comprises initiating processing of a received plurality of data packets by CPU cores; tracking, by a scale management routine, processing queues for the CPU cores and their load. In response to an average size of a processing queue being lower than a first pre-determined queue threshold, and a CPU core load being lower than a first pre-determined load threshold, preventing adding new data packets to the processing queue, monitoring emptying of processing queues for each processing CPU core. In response to an average size of a processing queue or a CPU core load being above a second pre-determined upper queue threshold or the second pre-determined load threshold, transmitting all data from processing queues for each processing CPU core to a memory buffer, increasing the number of processing cores by one; and initiating data packet processing.

Claims10

Dependent claims

A method for processing a data packet, the method executable by an electronic device, the electronic device including a plurality of CPU cores, the electronic device executing a scale management routine, the method comprising:

receiving a plurality of data packets to be processed;
initiating processing of the plurality of data packets by the plurality of CPU cores;
tracking, by the scale management routine, processing queues for the plurality of CPU cores and their load;
in response to an average size of a processing queue being lower than a first pre-determined queue threshold, and a CPU core load being lower than a first pre-determined load threshold,
preventing, by the scale management routine, adding new data packets to the processing queue,
monitoring emptying of processing queues for each processing CPU core,
in response to a given queue for a given processing core having been emptied, decreasing a number of processing cores by one,
initiating data packet processing using a decreased number of processing cores;
in response to at least one of:
an average size of a processing queue or a CPU core load being above than a second pre-determined upper queue threshold or the second pre-determined load threshold, respectively:
transmitting, by the scale management routine, all data from processing queues for each processing CPU core to a memory buffer,
increasing the number of processing cores by one;
and
initiating data packet processing using an increased number of cores.

11 more elements

A device for data packet processing, comprising:

an input interface configured to receive data packets;
a plurality of cores configured to process data packets;
a memory configured to store data;
an output interface configured to transmit data packets that have been processed;
a scale management routine configured to redirect data packets and determine the number of cores;
the plurality of cores including;
a plurality of receiving cores configured to process data packets sent by the input interface in their queues and then to send these packets to the queues of processing cores;
a plurality of processing cores configured to process data packets sent in their queues and then to send processed packets to the queues of transmitting cores;
a plurality of transmitting cores configured to process data packets sent in their queues and then to send these packets to the output interface;
wherein the device for data packet processing is configured to:
receive a plurality of data packets to be processed;
initiate processing of the plurality of data packets by the plurality of CPU cores;
track, by the scale management routine, processing queues for the plurality of CPU cores and their load;
in response to an average size of a processing queue being lower than a first pre-determined queue threshold, and a CPU core load being lower than a first pre-determined load threshold,
prevent, by the scale management routine, adding new data packets to the processing queue,
monitor emptying of processing queues for each processing CPU core,
in response to a given queue for a given processing core having been emptied, decreasing a number of processing cores by one,
initiate data packet processing using a decreased number of processing cores;
in response to at least one of:
an average size of a processing queue or a CPU core load being above than a second pre-determined upper queue threshold or the second pre-determined load threshold, respectively:
transmit, by the scale management routine, all data from processing queues for each processing CPU core to a memory buffer,
increase the number of processing cores by one;
and initiating data packet processing using an increased number of cores.

20 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/881,174Filed 26 Jan 2018
Priority: RU 20171355685 Oct 2017
Published: US 2019/0108068 A111 Apr 2019
Granted: 17 Mar 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

G06F 9/5083
Allocation of resources, e.g. of the central processing unit [CPU]: techniques for rebalancing the load in a distributed system
G06F 9/48
Multiprogramming arrangements: program initiating; Program switching, e.g. by interrupt
G06F 9/505
The resource being a machine, e.g. CPUs, Servers, Terminals: considering the load
G06F 9/544
Interprogram communication: buffers; Shared memory; Pipes