# US 10,768,994 B2 · Method and system for modeling and analyzing computing resource requirements of software applications in a shared and distributed computing environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,768,994 B2
- Document ID: US10768994B2
- Status: Granted
- Kind: B2
- Application number: 16/269,467
- Filed: 2019-02-06
- Published: 2019-09-19
- Granted: 2020-09-08
- Earliest claimed: 2007-03-30
- Assignees: ServiceNow, Inc.
- Applicants: ServiceNow, Inc.
- Inventors: Wai Ming Wong; Michael C. Hui
- Web page: https://patentgrep.com/patent/US10768994B2

## CPC

- G06F 9/5083: {Techniques for rebalancing the load in a distributed system}
- G06F 9/50: Allocation of resources, e.g. of the central processing unit [CPU]
- G06F 9/5005: {to service a request}
- G06F 9/5011: {the resources being hardware resources other than CPUs, Servers and Terminals}
- G06F 9/5016: {the resource being the memory}
- G06F 9/5022: {Mechanisms to release resources}
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/5033: {considering data affinity}
- G06F 9/5038: {considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration (scheduling strategies G06F9/4881 and subgroups)}
- G06F 9/5044: {considering hardware capabilities}
- G06F 9/505: {considering the load}
- G06F 9/5055: {considering software capabilities, i.e. software resources associated or available to the machine}
- G06F 9/5061: {Partitioning or combining of resources}
- G06F 9/5072: {Grid computing}
- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- H04L 47/70: Admission control; Resource allocation
- G06F 2209/5022: Workload threshold
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

An application manager receives or defines a service specification for a first application that defines a set of required computing resources that are necessary to run each application component of the first application. A resource supply manager in communication with the application manager manages a plurality of computing resources in a shared computing environment. The application manager is operable to request the set of required computing resources from the computing resource supply manager, and wherein the resource supply manager determines the availability of the required computing resources within the shared computing environment according to resource allocation policies and allocates computing resources to the application manager, and wherein the application manager is operable manage allocation of the computing resources to the first application, the application manager operable to create and manage deployment of instances of each application component of the first application on the allocated computing resources.

## Claims

### Claim 1

A system to manage a plurality of applications in a distributed computing environment, the system comprising:
an application manager executable by one or more processors in a distributed environment, wherein the application manager is configured to:
receive a service specification for a first application of the plurality of applications in the distributed computing environment, wherein the service specification defines a first plurality of computing resources used to execute the first application; and
request the first plurality of computing resources out of a plurality of potential computing resources that include the first plurality of computing resources; and
a resource supply manager executable by one or more processors in the distributed computing environment, wherein the resource supply manager is in communication with the application manager and is configured to:
manage the plurality of potential computing resources in the distributed computing environment,
receive the request from the application manager;
responsive to the request, determine availability of the first plurality of computing resources within the distributed computing environment according to resource allocation policies; and
allocate the first plurality of computing resources to the application manager, wherein the application manager is configured to manage allocation of the first plurality of computing resources to the first application.

### Claim 2 (depends on 1)

The system of claim 1, wherein the service specification defines a set of constraints for the plurality of potential computing resources, and wherein the application manager takes the constraints into account when requesting the first plurality of computing resources from the resource supply manager.

### Claim 3 (depends on 2)

The system of claim 2, wherein the constraints define which computing resources of the plurality of potential computing resources can be allocated to the application manager to execute the first application.

### Claim 4 (depends on 2)

The system of claim 2, wherein the request is based at least in part on the set of constraints in relation to constraints for a second application.

### Claim 5 (depends on 4)

The system of claim 4, wherein the second application utilizes a second plurality of computing resources to execute the second application.

### Claim 6 (depends on 2)

The system of claim 2, wherein the set of constraints define the first plurality of computing resources to prevent the first application from having a single point of fail tire.

### Claim 7 (depends on 1)

The system of claim 1, wherein the service specification defines a priority for one or more of the plurality of applications, and wherein the application manager manages the plurality of applications based at least in part on the priority.

### Claim 8 (depends on 1)

The system of claim 1, wherein the application manager monitors a status of the first plurality of computing resources on which the first application is running, and where there is an instance of failure, the application manager restarts a portion of the first application on corresponding allocated computing resource of the first plurality of computing resources.

### Claim 9 (depends on 1)

The system of claim 1, wherein the application manager monitors a status of the first plurality of computing resources on which the first application is running, and where there is an instance of failure, the application manager requests a replacement computing resource from the resource supply manager and restarts a portion of the first application that has failed on the corresponding replacement computing resource.

### Claim 10

A method, comprising:
managing, via an application manager, a plurality of applications in a distributed computing environment;
receiving, at the application manager, a service specification for a first application of the plurality of applications, wherein the service specification defines a plurality of computing resources used to execute the first application;
requesting, via the application manager, the plurality of computing resources from a resource supply manager of the distributed computing environment, Wherein the resource supply manager determines availability of the plurality of computing resources in accordance with resource allocation policies and allocates computing resources to the application manager;
managing, via the application manager, allocation of the plurality of computing resources to the first application; and
deploying and managing instances of portions of the first application on the allocated plurality of computing resources via the application manager.

### Claim 11 (depends on 10)

The method of claim 10, wherein each application of the plurality of applications is a managed service or a composite service.

### Claim 12 (depends on 11)

The method of claim 11, wherein the composite service comprises a service that utilizes sub-services to perform functions.

### Claim 13 (depends on 11)

The method of claim 11, wherein the application manager utilizes an object-based model to model the plurality of applications.

### Claim 14 (depends on 13)

The method of claim 13, wherein the object-based model comprises a managed service object to represent the first application, wherein the managed service object comprises properties, metrics, and actions for the first application.

### Claim 15 (depends on 14)

The method of claim 14, wherein the managed service object is defined in the service specification.

### Claim 16

Tangible, non-transitory, and computer-readable media having stored thereon instructions, that when executed, are configured to cause one or more processors to:
implement an application manager that is configured to manage a plurality of applications by:
receiving a service specification for an application of the plurality of applications in a distributed computing environment, wherein the service specification defines a plurality of computing resources used to execute the application; and
requesting the plurality of computing resources out of a plurality of potential computing resources that includes the plurality of computing resources; and
implement a resource supply manager that is configured to manage the plurality of potential computing resources in the distributed computing environment by:
receiving the request from the application manager;
responsive to the request, determining availability of the plurality of potential computing resources within the distributed computing environment according to resource allocation policies; and
allocating the plurality of computing resources to the application manager, wherein the application manager is configured to manage allocation of the plurality of computing resources to the application.

### Claim 17 (depends on 16)

The tangible, non-transitory, and computer-readable media of claim 16, wherein the instructions are configured to cause the application manager to determine whether the application experiences a demand of resources.

### Claim 18 (depends on 17)

The tangible, non-transitory, and computer-readable media of claim 17, wherein the application experiences the demand of resources at an initiation of the application.

### Claim 19 (depends on 17)

The tangible, non-transitory, and computer-readable media of claim 17, wherein the application experiences the demand of resources due to increased demand during execution of the application.

### Claim 20 (depends on 17)

The tangible, non-transitory, and computer-readable media of claim 17, wherein the instructions are configured to cause the application manager to:
determine whether the application has obtained the plurality of computing resources in response to the request;
responsive to the application not obtaining the plurality of computing resources, retry obtaining the plurality of computing resources; and
responsive to a number of retries of obtaining the plurality of computing resources exceeding a retry threshold, output an error indicating a failure to allocate the plurality of computing resources to the application.
