US 11,599,393 B2Granted

Guaranteed quality of service in cloud computing environments

AssigneeState Street Corporation

InventorsFadi Gebara, Ram Rajamony, Ahmed Gheith

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems, methods, apparatuses, and computer-readable media for guaranteed quality of service (QoS) in cloud computing environments. A workload related to an immutable log describing a transaction may be received. A determination is made based on the immutable log that a first compute node stores at least one data element to process the transaction. Utilization levels of computing resources of the first compute node may be determined. Utilization levels of links connecting the first compute node to the fabric may be determined. A determination may be made, based on the utilization levels, that processing the workload on the first compute node satisfies one or more QoS parameters specified in a service level agreement (SLA). The workload may be scheduled for processing on the first compute node based on the determination that processing the workload on the first compute node satisfies the one or more QoS parameters specified in the SLA.

Claims15

Dependent claims

A method for guaranteed quality of service (QoS) in cloud computing environments, comprising:

receiving, by a cloud controller, a workload related to a first transaction of multiple transactions described in entries of an immutable log, for processing by at least one compute node of a plurality of compute nodes communicably coupled by a fabric in a cloud computing environment, the immutable log to comprise a persistent log that allows entries to be written but not deleted or changed;
accessing at least one of the entries of the immutable log to access data associated with the first transaction;
determining the data from the at least one entries of the immutable log, the data to describe the information to process for the first transaction, wherein the data specifies an account identifier, an asset, and a transaction type for trading the asset;
determining, based on the data associated with the first transaction, that a first compute node stores at least one data element required to process the first transaction, wherein the at least one data element comprises a current price of the asset;
determining utilization levels of a plurality of computing resources of the first compute node and nodes proximate to the at least one data element;
determining utilization levels of a plurality of links connecting the first compute node to the fabric and the nodes proximate to the at least one data element;
determining a score, based on the utilization levels of the computing resources and the links, for the first compute node and each of the nodes proximate to the at least one data element, the scores reflecting a suitability of each node to process the workload in accordance with QoS parameters for a service level agreement (SLA), wherein the QoS parameters comprise:
a latency, a jitter, a workload execution time, a throughput, and a bandwidth;
determining, based on at least the scores, that processing the workload on the first compute node satisfies one or more of the QoS parameters specified in the SLA;
selecting at least the first compute node to deploy the workload;
scheduling, by the cloud controller, the workload for processing on the first compute node based on the determination that processing the workload on the first compute node satisfies the one or more QoS parameters specified in the SLA;
and
processing the workload on the first compute node.

10 more elements

A non-transitory computer-readable medium storing instructions for guaranteed quality of service (QoS) in cloud computing environments, executable by one or more processor circuits cause the one or more processor circuits to:

receive a workload, related to a first transaction of multiple transactions described in entries of an immutable log, for processing by at least one compute node of a plurality of compute nodes communicably coupled by a fabric in a cloud computing environment, the immutable log to comprise a persistent log that allows entries to be written but not deleted or changed;
access at least one of the entries of the immutable log to access data associated with the first transaction;
determine the data from the at least one entries of the immutable log, the data to describe the information to process for the first transaction, wherein the data specifies an account identifier, an asset, and a transaction type for trading the asset;
determine, based on the data associated with the first transaction, that a first compute node stores at least one data element required to process the first transaction, wherein the at least one data element comprises a current price of the asset;
determine utilization levels of a plurality of computing resources of the first compute node and nodes proximate to the at least one data element;
determine utilization levels of a plurality of links connecting the first compute node to the fabric and the nodes proximate to the at least one data element;
determine a score, based on the utilization levels of the computing resources and the links, for the first compute node and each of the nodes proximate to the at least one data element, the scores reflecting a suitability of each node to process the workload in accordance with QoS parameters for a service level agreement (SLA), wherein the QoS parameters comprise:
a latency, a jitter, a workload execution time, a throughput, and a bandwidth;
determine, based on at least the scores, that processing the workload on the first compute node satisfies one or more of the QoS parameters specified in the SLA;
select at least the first compute node to deploy the workload;
and
schedule the workload for processing on the first compute node based on the determination that processing the workload on the first compute node satisfies the one or more QoS parameters specified in the SLA;
and
processing the workload on the first compute node.

11 more elements

An apparatus for guaranteed quality of service (QoS) in cloud computing environments, comprising:

one or more processor circuits;
and
memory storing instructions executable by the processor circuit to cause the processor circuit to:
receive a workload, related to a first transaction of multiple transactions described in entries of an immutable log, for processing by at least one compute node of a plurality of compute nodes communicably coupled by a fabric in a cloud computing environment, the immutable log to comprise a persistent log that allows entries to be written but not deleted or changed;
access at least one of the entries of the immutable log to access data associated with the first transaction;
determine the data from the at least one entries of the immutable log, the data to describe the information to process for the first transaction, wherein the data specifies an account identifier, an asset, and a transaction type for trading the asset;
determine, based on the data associated with the first transaction that a first compute node stores at least one data element required to process the first transaction, wherein the at least one data element comprises a current price of the asset;
determine utilization levels of a plurality of computing resources of the first compute node and nodes proximate to the at least one data element;
determine utilization levels of a plurality of links connecting the first compute node to the fabric and the nodes proximate to the at least one data element;
determine a score, based on the utilization levels of the computing resources and the links, for the first compute node and each of the nodes proximate to the at least one data element, the scores reflecting a suitability of each node to process the workload in accordance with QoS parameters for a service level agreement (SLA), wherein the QoS parameters comprise:
a latency, a jitter, a workload execution time, a throughput, and a bandwidth;
determine, based on at least the scores, that processing the workload on the first compute node satisfies one or more of the QoS parameters specified in a the SLA;
select at least the first compute node to deploy the workload;
schedule the workload to process on the first compute node based on the determination that the utilization levels of the computing resources and the links satisfy the one or more QoS parameters specified in the SLA;
and
processing the workload on the first compute node.

13 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/700,980Filed 22 Mar 2022 · continuation
Priority: 16 Apr 2018
Published: US 2022/0283860 A18 Sep 2022
Granted: 7 Mar 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification16 codes

G06F 9/505
The resource being a machine, e.g. CPUs, Servers, Terminals: considering the load
G06F 9/4881
By program, e.g. task dispatcher, supervisor, operating system: scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
G06N 3/084
Learning methods: backpropagation, e.g. using gradient descent
G06N 20/00
Machine learning

Family

Application62/658,060Us provisional application · filed 16 Apr 2018
Application62/663,477Us provisional application · filed 27 Apr 2018
Application16/385,442Parent of this continuation · filed 16 Apr 2019
US 2022/0283860 A1Pre-grant publication · published 8 Sep 2022
US 2019/0317812 A1Published application
US 11,599,393 B2This patent

From the US filing history. Foreign family members aren’t listed.