# US 2024/0202008 A1 · Shutdown of preemptible nodes on managed clusters

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202008 A1
- Document ID: US20240202008A1
- Status: Published application
- Kind: A1
- Application number: 18/537,278
- Filed: 2023-12-12
- Published: 2024-06-20
- Earliest claimed: 2022-12-16
- Assignees: Oracle International Corporation
- Applicants: Oracle International Corporation
- Inventors: Ravi Prakash Palacherla; Aseem Bajaj; Kayla Nicole Carrera; Joshua Aaron Horwitz
- Web page: https://patentgrep.com/patent/US20240202008A1

## CPC

- G06F 9/442: {Shutdown}
- G06F 8/60: Software deployment
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Conventional techniques for shutting down preempted nodes includes drawbacks to cloud users and service providers alike. The disclosed techniques are directed to mitigating or eliminating these drawbacks. Upon receiving a preemptible node request, a preemptible node may be generated, labeled as having a particular capacity type, and added to a cluster managed by a cluster manager. In response to detecting the label, the cluster manager may deploy a containerized application to the preemptible node. The containerized application may monitor node metadata to detect preemption of the node. Node metadata may be provided by node metadata service executing at a smart network interface card connected to a host on which the preemptible node executes. In response to detecting preemption, the containerized application may initiate shutdown and/or replacement operations of the preemptible node to reduce or eliminate the negative impact of preemption.

## Claims

### Claim 1

A computer-implemented method, comprising:
executing a cluster management service configured to manage a cluster comprising a plurality of nodes that are individually configured to execute one or more containerized applications;
receiving, by the cluster management service, a request for a preemptible node;
executing operations that cause the preemptible node to be generated and associated with a label that indicates a preemptible capacity type; and
responsive to detecting that the preemptible node is associated with the label, deploying, by the cluster management service, a containerized application to the preemptible node, the containerized application being configured to detect preemption of the preemptible node and trigger the cluster management service to execute a set of shutdown operations corresponding to the preemptible node.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising implementing, by the cluster management service, a deployment controller that is configured to deploy the containerized application to preemptible nodes that are individually associated with the label indicating the preemptible capacity type.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein executing the operations that cause the preemptible node to be generated and associated with the label comprises:
transmitting, to a compute service, instructions to generate the preemptible node according to a preemptible node configuration, wherein generating the preemptible node causes the compute service to associate the preemptible node with preemptible metadata defined by the preemptible node configuration.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein generating the preemptible node causes a script to be executed that 1) identifies the preemptible node as being of the preemptible capacity type based at least in part on the preemptible metadata associated with the preemptible node and 2) associates the preemptible node with the label that indicates the preemptible capacity type.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein triggering the cluster management service to execute the set of shut down operations comprises transmitting, by the containerized application to the cluster management service, a preemption message that indicates that a preemption event corresponding to the preemptible node has occurred.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising, responsive to receiving a preemption message from the containerized application, removing one or more containers executing on the preemptible node from a list of candidate containers to which new workloads are assignable.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the containerized application is configured to detect the preemption of the preemptible node based at least in part on obtaining data from a node metadata service component executing at a device associated with the preemptible node.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein the device executing the node metadata service component executes at a smart network interface card that is communicatively connected to a host device on which the preemptible node executes.

### Claim 9

A cloud computing system, comprising:
one or more processors; and
one or more memories storing computer-executable instructions that, when executed by the one or more processors, cause the cloud computing system to:
execute a cluster management service configured to manage a cluster comprising a plurality of nodes that are individually configured to execute one or more containerized applications;
receive a request for a preemptible node;
execute operations that cause the preemptible node to be generated and associated with a label that indicates a preemptible capacity type; and
responsive to detecting that the preemptible node is associated with the label, deploy a containerized application to the preemptible node, the containerized application being configured to detect preemption of the preemptible node and trigger the cluster management service to execute a set of shutdown operations corresponding to the preemptible node.

### Claim 10 (depends on 9)

The cloud computing system of claim 9, wherein executing the computer-executable instructions further causes the cloud computing system to, responsive to receiving a preemption message from the containerized application, transmit a shutdown signal to one or more workloads being executed by the preemptible node.

### Claim 11 (depends on 9)

The cloud computing system of claim 9, wherein the preemptible capacity type identifies the preemptible node as being reclaimable capacity that lacks a time guarantee.

### Claim 12 (depends on 9)

The cloud computing system of claim 9, wherein the containerized application monitors node metadata provided by a node metadata service, wherein the node metadata indicates that the preemption of the preemptible node has been initiated.

### Claim 13 (depends on 9)

The cloud computing system of claim 9, wherein executing the computer-executable instructions further causes the cloud computing system to assign low priority workloads to the preemptible node.

### Claim 14 (depends on 9)

The cloud computing system of claim 9, wherein the containerized application is configured to detect the preemption of the preemptible node based at least in part on monitoring messages issued by a node metadata service.

### Claim 15

A non-transitory computer-readable medium comprising computer-executable instructions that, when executed by one or more processors of a cloud computing system, cause the one or more processors of the cloud computing system to:
execute a cluster management service configured to manage a cluster comprising a plurality of nodes that are individually configured to execute one or more containerized applications;
receive a request for a preemptible node;
execute operations that cause the preemptible node to be generated and associated with a label that indicates a preemptible capacity type; and
responsive to detecting that the preemptible node is associated with the label, deploy a containerized application to the preemptible node, the containerized application being configured to detect preemption of the preemptible node and trigger the cluster management service to execute a set of shutdown operations corresponding to the preemptible node.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the preemption of the preemptible node is triggered based at least in part on a second request for an on-demand node that is unavailable due to current on-demand capacity of the cloud computing system.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the request for the preemptible node requests addition of a pool of preemptible nodes.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein executing the operations that cause the preemptible node to be associated with the label further comprises associated each preemptible node of the pool of preemptible nodes with the label.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the set of shutdown operations comprise cordon and drain operations provided by a Kubernetes engine.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein executing the computer-executable instructions further causes the one or more processors of the cloud computing system to transmit one or more requests for a replacement preemptible node corresponding to the preemptible node.
