Multi-tenant optimized serverless placement using smart network interface cards and commodity storage
AssigneeCisco Technology, Inc.
InventorsKyle Andrew Donald Mestery, Ian James Wells
Life of this patent
Estimating the term…
Abstract
Multi-tenant optimized serverless placement using network interface card and commodity storage may be provided. A first request to execute a first function may be received. Next, it may be determined to execute the first function at a first network interface card. The first network interface card may include a plurality of processors. Then, a container may be created at the first network interface card. The container may have at least one processor of the plurality of processors. The first function may be executed at the container.
Claims20
A method comprising:
- receiving, at a first network interface card, a first request to execute a first function;
- determining, by the first network interface card, whether to execute the first function at the first network interface card, the first network interface card comprising a plurality of processors, wherein determining whether to execute the first function at the first network interface card comprises:
- determining, by the first network interface card, that the first function is not associated with a latency requirement,
- determining, by the first network interface card in response to determining that the first function is associated with the latency requirement, that the latency requirement is less than a predetermined latency value,
- determining, by the first network interface card in response to determining that the latency requirement is less than the predetermined latency value, that a load on the first network interface card is more than a predetermined load value, and
- determining, by the first network interface card in response to determining that the load on the first network interface card is not more than the predetermined load value, to execute the first function on the first network interface card, wherein the first network interface card to execute the first function is determined from a plurality of network interface cards based on closeness of a location of a data storage, the data storage storing data corresponding to the first function;
- creating, in response to determining to execute the first function at the first network interface card, a container at the first network interface card, the container comprising at least one processor of the plurality of processors;
- and
- executing the first function at the container.
An apparatus comprising:
- a memory storage;
- and
- a processing unit coupled to the memory storage, wherein the processing unit is operative to:
- receive, by a first network interface card, a first data traffic comprising a first request to execute a first function;
- determine, by the first network interface card, whether to execute the first function at the first network interface card, the first network interface card comprising a plurality of processors, wherein the processing unit being operative to determine whether to execute the first function at the first network interface card comprises the processing unit being operative to:
- determine, by the first network interface card, that the first function is not associated with a latency requirement,
- determine, by the first network interface card in response to determining that the first function is associated with the latency requirement, that the latency requirement is less than a predetermined latency value,
- determine, by the first network interface card in response to determining that the latency requirement is less than the predetermined latency value, that a load on the first network interface card is more than a predetermined load value, and
- determine, by the first network interface card in response to determining that the load on the first network interface card is not more than the predetermined load value, to execute the first function on the first network interface card, wherein the first network interface card to execute the first function is determined from a plurality of network interface cards based on closeness of a location of a data storage, the data storage storing data corresponding to the first function;
- create, by the first network interface card in response to determining to execute the first function at the first network interface card, a container at the first network interface card to execute the first function;
- and
- execute the first function in the container.
A non-transitory computer readable medium that stores a set of instructions, which when executed by a processor, cause the performance a method comprising:
- receiving, by a first network interface card, a first request to execute a first function;
- determining, by the first network interface card, whether to execute the first function at the first network interface card of a plurality of network interface cards, each of the plurality of network interface cards comprising a plurality of processors, wherein determining whether to execute the first function at the first network interface card comprises:
- determining, by the first network interface card, that the first function is not associated with a latency requirement,
- determining, by the first network interface card in response to determining that the first function is associated with the latency requirement, that the latency requirement is less than a predetermined latency value,
- determining, by the first network interface card in response to determining that the latency requirement is less than the predetermined latency value, that a load on the first network interface card is more than a predetermined load value, and
- determining, by the first network interface card in response to determining that the load on the first network interface card is not more than the predetermined load value, to execute the first function on the first network interface card, wherein the first network interface card to execute the first function is determined from a plurality of network interface cards based on closeness of a location of a data storage, the data storage storing data corresponding to the first function;
- creating, by the first network interface card in response to determining to execute the first function at the first network interface card of the plurality of network interface cards, a container at the first network interface card;
- and
- executing the first function at the container.
Dependencies are inferred from the claim text.