US 11,144,359 B1Granted

Managing sandbox reuse in an on-demand code execution system

AssigneeAmazon Technologies, Inc.

InventorsMarc John Brooker, Dylan Owen Marriner

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods are described for managing reuse of sandboxed computing environments in a network-based on-demand code execution system. Users may generate tasks on the system by submitting code to a frontend, which may interact with multiple worker managers that manage task execution in sandboxed computing environments such as containers or virtual machine instances. A sandbox may be reusable once provisioned, but the resources required to definitively locate an idle sandbox may be significant relative to the cost of provisioning a new sandbox. The system may therefore manage reuse by randomly or semi-randomly selecting a worker manager and requesting that it provide an existing sandbox if one is available. If not, then the system may select a different worker manager and repeat the request, or after consuming a threshold amount of resources may request that the next worker manager provision a new sandbox if an existing one is not available.

Claims21

Dependent claims

A system for managing reuse of sandboxes in an on-demand code execution system, the system comprising:

a non-transitory data store configured to store identifications of worker managers and computer-executable instructions;
and
a computing device in communication with the non-transitory data store, wherein the computer-executable instructions, when executed by the computing device, configure the computing device to:
obtain a request to execute a user-submitted task on an on-demand code execution system;
obtain an identification of a plurality of worker managers, each of the plurality of worker managers managing one or more computing devices provisioned with one or more sandboxes for executing user-submitted tasks on the on-demand code execution system, each of the one or more sandboxes providing an isolated code execution environment;
randomly select a first worker manager from the plurality of worker managers;
transmit, to the first worker manager, a first reservation request for a previously provisioned sandbox on the one or more computing devices managed by the first worker manager;
receive, from the first worker manager, a first response indicating that no previously provisioned sandbox is available to fulfill the first reservation request;
randomly select a second worker manager from the plurality of worker managers;
transmit, to the second worker manager, a second reservation request for a sandbox on the one or more computing devices managed by the second worker manager;
receive, from the second worker manager, a second response, the second response including information enabling access to the sandbox;
and
cause the user-submitted task to be executed in the sandbox.

10 more elements

Non-transitory computer-readable media including computer-executable instructions that, when executed by a processor, cause the processor to perform operations including:

obtaining a request to execute a user-submitted task on an on-demand code execution system;
repeatedly transmitting a first sandbox reservation request to individual worker managers of a plurality of worker managers until either a response is received that fulfills the first sandbox reservation request or a threshold is satisfied, wherein the first sandbox reservation request specifies fulfilling the request with a previously provisioned sandbox on a computing device managed by the individual worker manager;
in response to a determination that the threshold has been satisfied, transmitting a second sandbox reservation request to a worker manager of the plurality of worker managers, wherein the second sandbox reservation request specifies fulfilling the request with either a previously provisioned sandbox or a newly provisioned sandbox, and wherein the worker manager is selected based at least in part on a first criterion;
receiving, from the worker manager, a response that enables access to a sandbox on a computing device managed by the worker manager;
and
causing the user-submitted task to be executed in the sandbox.

3 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/447,725Filed 20 Jun 2019
Granted: 12 Oct 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

G06F 9/505
The resource being a machine, e.g. CPUs, Servers, Terminals: considering the load
G06F 9/45558
Hypervisors; Virtual machine monitors: hypervisor-specific management and integration aspects
G06F 9/5011
To service a request: the resources being hardware resources other than CPUs, Servers and Terminals
G06F 9/5055
The resource being a machine, e.g. CPUs, Servers, Terminals: considering software capabilities, i.e. software resources associated or available to…