US 11,695,840 B2Granted

Dynamically routing code for executing

AssigneeAmazon Technologies, Inc.

InventorsGeorge Steven McPherson, Mehul A. Shah, Supratik Chakraborty, Prajakta Datta Damle, Gopinath Duddi, Anurag Windlass Gupta

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

Code may be dynamically routed to computing resources for execution. Code may be received for execution on behalf of a client. Execution criteria for the code may be determined and computing resources that satisfy the execution criteria may be identified. The identified computing resources may then be procured for executing the code and then the code may be routed to the procured computing resources for execution. Permissions or authorization to execute the code may be shared to ensure that computing resources executing the code have the same permissions or authorization when executing the code.

Claims20

Dependent claims

A system, comprising:

at least one processor;
and
a memory, storing program instructions that when executed by the at least one processor, cause the at least one processor to:
receive, at a network endpoint, source code of a job to transfer data from a data source to a on behalf of a client;
in response to the receipt of the source code:
evaluate the job to determine a criteria for the request to execute the source code, wherein the evaluating comprises:
identify use of one or more Graphics Processing Unit (GPUs) that are utilized via one or more application programming interfaces (APIs) as part of executing the source code and identifying that a driver is used to interact with the one or more GPUs in order to execute the source code;
evaluate respective capabilities of available computing resources with respect to the determined criteria to identify one or more computing resources from the available computing resources with the respective capabilities to execute the source code that satisfy the determined criteria including one or more GPUs;
procure the identified one or more computing resources with the respective capabilities to execute the source code, wherein the procuring causes configuration of a software image for a software container that implements operating system virtualization at the identified one or more computing resources to use the driver to interact with the one or more GPUs via the one or more APIs to execute the source code;
and
initiate execution of the source code at the procured computing resources.

8 more elements

One or more non-transitory, computer-readable storage media, storing program instructions that when executed on or across one or more computing devices, cause the one or more computing devices to implement:

receiving, at a network endpoint, source code of a job to transfer data from a data source to a on behalf of a client;
in response to receiving the source code:
evaluating the job to determine a criteria for the request to execute the source code, wherein the evaluating comprises:
identifying use of one or more Graphics Processing Unit (GPUs) that are utilized via one or more application programming interfaces (APIs) as part of executing the source code and identifying that a driver is used to interact with the one or more GPUs in order to execute the source code;
evaluating respective capabilities of available computing resources with respect to the determined criteria to identify one or more computing resources from the available computing resources with the respective capabilities to execute the source code that satisfy the determined criteria including one or more GPUs;
procuring the identified one or more computing resources with the respective capabilities to execute the source code, wherein the procuring causes configuration of a software image for a software container that implements operating system virtualization at the identified one or more computing resources to use the driver to interact with the one or more GPUs via the one or more APIs to execute the source code;
and
initiating execution of the source code at the procured computing resources.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/694,585Filed 14 Mar 2022 · continuation
Priority: 27 Nov 2016
Published: US 2022/0279049 A11 Sep 2022
Granted: 4 Jul 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

H04L 67/141
Session management: setup of application sessions
G06F 9/4411
Bootstrapping: configuring for operating with peripheral devices; Loading of device drivers
G06F 9/5005
Allocation of resources, e.g. of the central processing unit [CPU]: to service a request
G06F 9/5055
The resource being a machine, e.g. CPUs, Servers, Terminals: considering software capabilities, i.e. software resources associated or available to…

Family

Application62/426,584Us provisional application · filed 27 Nov 2016
Application15/385,784Parent of this continuation · filed 20 Dec 2016
US 2022/0279049 A1Pre-grant publication · published 1 Sep 2022
US 11,277,494 B1Parent of this continuation
US 11,695,840 B2This patent

From the US filing history. Foreign family members aren’t listed.