US 11,381,468 B1Granted

Identifying correlated resource behaviors for resource allocation

AssigneeAmazon Technologies, Inc.

InventorsJames Michael Thompson, Marc Stephen Olson, Marc John Brooker

Life of this patent

Estimating the term…

Loading patent…

Abstract

A distributed system may implement identifying correlated workloads for resource allocation. Resource data for resources hosted at resource hosts in a distributed system may be analyzed to determine behavioral similarities. Historical behavior data or resource configuration data, for instance, may be compared between resources. Behaviors between resources may be identified as correlated according to the determined behavioral similarities. An allocation of one or more resource hosts in the distributed system may be made for a resource based on the behaviors identified as correlated. For instance, resources may be migrated from a current resource host to another resource host, new resources may be placed at a resource host, or resources may be reconfigured into different resources. Machine learning techniques may be implemented to refine techniques for identifying correlated behaviors.

Claims20

Dependent claims

A system, comprising:

a plurality of resource hosts of a provider network, the plurality of resource hosts comprising respective hardware processors and memory, configured to host a plurality of resources of the provider network, wherein the resources comprise computing resources, storage resources, or networking resources;
one or more compute nodes comprising respective hardware processors and memory that implement a resource placement engine, configured to:
access respective historical behavioral data pertaining to prior usage of the plurality of resources hosted at one or more of the plurality of resource hosts;
evaluate the respective historical behavioral data to determine one or more historical behavioral similarities between respective ones of the plurality of resources;
identify two or more resources of the plurality of resources of the provider network as having one or more correlated resource behaviors based, at least in part, on the determined one or more historical behavioral similarities, such that the one or more correlated resource behaviors of the two or more resources share one or more patterns, frequencies, or effects in common with one another based at least in part on the two or more resources' respective historical behavior data pertaining to prior usage, wherein the two or more resources are computing resources, storage resources, or networking resources, wherein a first resource of the two or more resources is hosted on a first resource host of the plurality of resource hosts, and wherein a second resource of the two or more resources is hosted on a second resource host of the plurality of resource hosts;
store an identification the two or more resources of the provider network having the one or more correlated resource behaviors;
based, at least in part, on the stored identification of the two or more resources having the one or more correlated resource behaviors, generate a placement decision to place at least the first resource at a third resource host of the plurality of resource hosts that is different than the first or second resource hosts, wherein the placement decision of the first resource takes into account a placement at the second resource host of the second resource whose one or more resource behaviors are correlated with the one or more resource behaviors of the first resource;
and
based, at least in part, on the placement decision, place the first resource at the third resource host, such that the first resource is accessible via the provider network.

6 more elements

A method, comprising:

performing, by one or more computing devices comprising respective hardware processors and memory:
analyzing respective resource data for a plurality of resources of a provider network, comprising computing resources, storage resources, or networking resources, allocated amongst a plurality of infrastructure units of the provider network to determine one or more behavioral similarities between respective ones of the plurality of resources;
identifying two or more resources of the plurality of resources of the provider network as having one or more correlated resource behaviors based at least in part on the determined one or more behavioral similarities, such that the one or more correlated resource behaviors of the two or more resources of the provider network share one or more patterns, frequencies, or effects in common with one another based at least in part on the two or more resources' respective resource data, wherein the two or more resources are computing resources, storage resources, or networking resources, and wherein the two or more resources comprise a first resource and a second resource;
storing an identification of the two or more resources of the provider network having the one or more correlated resource behaviors;
based, at least in part, on the stored identification of the two or more resources having the one or more correlated resource behaviors, determining an alternate allocation of the infrastructure units for at least the first resource that is different from a current allocation of infrastructure units for the first resource, wherein determining the alternate allocation of the infrastructure units for the first resource takes into account a different allocation of the infrastructure units for the second resource whose one or more resource behaviors are correlated with the one or more resource behaviors of the first resource;
and
based, at least in part, on the determined alternate allocation of the infrastructure units for at least the first resource, allocating the infrastructure units for at least the first resource, such that the first resource is accessible via the provider network.

4 more elements

A non-transitory, computer-readable storage medium, storing program instructions that when executed by one or more computing devices cause the one or more computing devices to implement:

analyzing respective resource historical behavior data or respective resource configuration data for a plurality of resources of a provider network, comprising computing resources, storage resources, or networking resources, allocated amongst a plurality of infrastructure units of the provider network to determine one or more behavioral similarities between respective ones of the plurality of resources;
identifying of two or more resources of the plurality of resources of the provider network as having one or more correlated resource behaviors based at least in part on the determined one or more behavioral similarities, such that the one or more correlated resource behaviors of the two or more resources share one or more patterns, frequencies, or effects in common with one another based at least in part on the two or more resources' respective resource data, wherein the two or more resources are computing resources, storage resources, or networking resources, and wherein the two or more resources comprise a first resource and a second resource;
storing an identification of the two or more resources of the provider network having the one or more correlated resource behaviors;
based, at least in part, on the stored identification of the two or more resources having the one or more correlated resource behaviors, generating an alternate allocation decision for at least the first resource amongst the infrastructure units that is different than a current allocation decision for the first resource, wherein generating the alternate allocation decision for the first resource takes into account a different allocation decision for the second resource whose one or more resource behaviors are correlated with the one or more resource behaviors of the first resource;
and
based, at least in part, on the generated alternate allocation decision for at least the first resource, allocating at least the first resource amongst the infrastructure units, such that the first resource is accessible via the provider network.

3 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/658,941Filed 16 Mar 2015
Granted: 5 Jul 2022
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

H04L 41/0897
Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities: by horizontal or vertical scaling of resources, or by…
H04L 41/147
Network analysis or design: for predicting network behaviour
H04L 41/0823
Configuration setting: characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
H04L 67/101
Server selection for load balancing: based on network conditions