# US 2021/0081233 A1 · Execution of auxiliary functions in an on-demand network code execution system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0081233 A1
- Document ID: US20210081233A1
- Status: Published application
- Kind: A1
- Application number: 17/107,663
- Filed: 2020-11-30
- Published: 2021-03-18
- Earliest claimed: 2018-06-25
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Niall Mullen; Philip Daniel Piwonka; Timothy Allen Wagner; Marc John Brooker
- Web page: https://patentgrep.com/patent/US20210081233A1

## CPC

- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- G06F 9/455: Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F 9/45533: {Hypervisors; Virtual machine monitors}
- G06F 9/48: Program initiating; Program switching, e.g. by interrupt
- G06F 9/4806: {Task transfer initiation or dispatching}
- G06F 9/4843: {by program, e.g. task dispatcher, supervisor, operating system}
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/50: Allocation of resources, e.g. of the central processing unit [CPU]
- G06F 9/5005: {to service a request}
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/5038: {considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration (scheduling strategies G06F9/4881 and subgroups)}
- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- G06F 2009/45562: {Creating, deleting, cloning virtual machine instances}
- G06F 2009/4557: {Distribution of virtual machine instances; Migration and load balancing}
- G06F 2009/45575: {Starting, stopping, suspending or resuming virtual machine instances}
- G06F 2009/45591: {Monitoring or debugging support}
- G06F 2009/45595: {Network integration; Enabling network access in virtual machine instances}
- G06F 2209/5011: Pool
- G06F 2209/509: Offload
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods are described for providing auxiliary functions in an on-demand code execution system in a manner that enables efficient execution of code. A user may generate a task on the system by submitting code. The system may determine the auxiliary functions that the submitted code may require when executed on the system, and may provide these auxiliary functions by provisioning or configuring sidecar virtualized execution environments that work in conjunction with the main virtualized execution environment executing the submitted code. Sidecar virtualized execution environments may be identified and obtained from a library of preconfigured sidecar virtualized execution environments, or a sidecar agent that provides the auxiliary function may be identified from a library, and then a virtualized execution environment may be provisioned with the agent and/or configured to work in conjunction with the main virtualized execution environment.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving a request to execute user-submitted code on an on-demand code execution system;
obtaining configuration information associated with the user-submitted code, the configuration information specifying at least a main virtualized execution environment configured to execute the user-submitted code and an auxiliary function expected to be required during execution of the user-submitted code;
identifying, based at least in part on the auxiliary function expected to be required during execution of the user-submitted code, a sidecar virtualized execution environment from a library of sidecar virtualized execution environments;
configuring the sidecar virtualized execution environment to perform the auxiliary function for the main virtualized execution environment;
causing the main virtualized execution environment to execute the user-submitted code in accordance with the configuration information;
causing the sidecar virtualized execution environment to perform the auxiliary function in accordance with the configuration information;
determining that the main virtualized execution environment has completed execution of the user-submitted code; and
deprovisioning the main virtualized execution environment and the sidecar virtualized execution environment.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the library of sidecar virtualized execution environments comprises a library of agents that perform auxiliary functions.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the sidecar virtualized execution environment comprises an agent that performs the auxiliary function expected to be required during execution of the user-submitted code.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the sidecar virtualized execution environment further comprises an operating system.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein configuring the sidecar virtualized execution environment to perform the auxiliary function for the main virtualized execution environment comprises configuring the sidecar virtualized execution environment to communicate with the main virtualized execution environment.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1 further comprising provisioning the sidecar virtualized execution environment with an agent that performs the auxiliary function.

### Claim 7

A system comprising:
a physical data store storing configuration information; and
a computing device configured with executable instructions to perform operations including:
receiving a request to execute user-submitted code on an on-demand code execution system;
obtaining, from the physical data store, configuration information associated with the user-submitted code, the configuration information specifying an auxiliary function expected to be required during execution of the user-submitted code;
identifying, based at least in part on the auxiliary function expected to be required during execution of the user-submitted code, a sidecar configuration from a library of sidecar configurations;
configuring a sidecar virtualized execution environment in accordance with the sidecar configuration to perform the auxiliary function for a main virtualized execution environment configured to execute the user-submitted code;
causing the main virtualized execution environment to execute the user-submitted code in accordance with the configuration information;
causing the sidecar virtualized execution environment to perform the auxiliary function;
determining that the main virtualized execution environment has completed execution of the user-submitted code; and
deprovisioning one or more of the main virtualized execution environment and the sidecar virtualized execution environment.

### Claim 8 (depends on 7)

The system of claim 7, wherein the configuration information is determined based at least in part on a prior execution of the user-submitted code on the on-demand code execution system.

### Claim 9 (depends on 7)

The system of claim 7, wherein the request includes a debugging flag, header information, execution mode, application programming interface (“API”) call, or other indicator associated with the auxiliary function.

### Claim 10 (depends on 7)

The system of claim 7, wherein the sidecar virtualized execution environment performs the auxiliary function for a plurality of main virtualized execution environments.

### Claim 11 (depends on 10)

The system of claim 10, wherein the computing device is configured with further executable instructions to perform further operations including determining that each of the plurality of main virtualized execution environments has been deprovisioned, and wherein deprovisioning one or more of the main virtualized execution environment and the sidecar virtualized execution environment comprises deprovisioning the sidecar virtualized execution environment.

### Claim 12 (depends on 7)

The system of claim 7, wherein configuring the sidecar virtualized execution environment in accordance with the sidecar configuration to perform the auxiliary function for the main virtualized execution environment comprises one or more of redirecting input, redirecting output, monitoring execution, monitoring resource utilization, or collecting metrics.

### Claim 13 (depends on 7)

The system of claim 7, wherein the sidecar configuration specifies the sidecar virtualized execution environment.

### Claim 14 (depends on 7)

The system of claim 7, wherein the sidecar configuration is identified based at least in part on a user selection from the library of sidecar configurations.

### Claim 15 (depends on 7)

The system of claim 7, wherein the main virtualized execution environment provides an application programming interface (“API”) that enables access to profiling information.

### Claim 16

One or more non-transitory computer-readable media including computer-executable instructions that, when executed on an on-demand code execution system, cause the on-demand code execution system to:
obtain configuration information associated with user-submitted code, the configuration information specifying an auxiliary function expected to be required during execution of the user-submitted code;
identify, from a library of sidecar configurations, a sidecar configuration associated with performing the auxiliary function;
configure a sidecar virtualized execution environment in accordance with the sidecar configuration to perform the auxiliary function for a main virtualized execution environment that executes the user-submitted code in accordance with the configuration information; and
cause the sidecar virtualized execution environment to perform the auxiliary function during execution of the user-submitted code.

### Claim 17 (depends on 16)

The one or more non-transitory computer-readable media of claim 16 including further computer-executable instructions that, when executed by the on-demand code execution system, configure the on-demand code execution system to provision the sidecar virtualized execution environment.

### Claim 18 (depends on 16)

The one or more non-transitory computer-readable media of claim 16 including further computer-executable instructions that, when executed by the on-demand code execution system, configure the on-demand code execution system to:
determine that the main virtualized execution environment has completed execution of the user-submitted code; and
configure the sidecar virtualized execution environment to cease performing the auxiliary function for the main virtualized execution environment.

### Claim 19 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, wherein the sidecar virtualized execution environment is configured to read one or more of a filesystem or a memory location of the main virtualized execution environment.

### Claim 20 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, wherein the execution of the user-submitted code is triggered by a triggering event.
