Session coordination for auto-scaled virtualized graphics processing
AssigneeAmazon Technologies, Inc.
InventorsMihir Sadruddin Surani, Adithya Bhat, Malcolm Featonby, Yuxuan Liu, Douglas Cotton Kurtz, Umesh Chandani
Life of this patent
Estimating the term…
Abstract
A graphic session coordinator is established to enable remote virtualized graphics operations on behalf of a set of graphics request generators. A request generator submits a graphics session request to the session coordinator. A configuration operation is performed at one or more routing devices to enable graphics operation request packets from the request generator to be delivered to a first remote virtualized graphics device and to enable graphics operation response packets to be transmitted to a destination.
Claims20
A system, comprising:
- a configuration manager executing on one or more computing devices of a provider network;
- wherein the configuration manager includes instructions that upon execution on a processor cause the one or more computing devices to:
- establish a first graphics session coordinator within an isolated virtual network, wherein at least a first network address of the first graphics session coordinator is accessible from one or more application compute instances in the isolated virtual network;
- in response to determining that a scaling policy would not be violated as a result of establishing a first graphics session and a request for the first graphics session is directed to the first graphics session coordinator from a first application compute instance of the isolated virtual network:
- instantiate a first remote virtualized graphics device using a first host comprising one or more graphics processing units (GPUs), wherein the first remote virtualized graphics device is accessible to the first application compute instance over a network to perform one or more graphics operations;
- and
- cause a configuration operation at one or more routing devices to enable (a) request packets of the one or more graphics operations from the first application compute instance to be delivered over the network to the first remote virtualized graphics device and (b) response packets of the one or more graphics operations from the first virtualized remote virtualized graphics device to be delivered over the network to the first application compute instance;
- and
- in response to determining that the scaling policy would be violated, cause a message indicating a violation of the scaling policy to be delivered to a destination.
A method, comprising:
- performing, by on one or more computing devices:
- assigning a first network address to a first graphics session coordinator, wherein the first network address is accessible from one or more graphics request generators;
- and
- in response to determining that a first request for a first graphics session has been submitted on behalf of a first graphics request generator to the first network address and that a resource constraint associated with the one or more graphics request generators would not be violated by establishing the first graphics session:
- selecting a first remote virtualized graphics device using a first host comprising one or more graphics processing units (GPUs), wherein the first remote virtualized graphics device is accessible to the first graphics request generator over a network to perform one or more graphics operations;
- and
- causing a first configuration operation at one or more routing devices to enable (a) one or more graphics operation request packets from the first graphics request generator to be delivered over a network to the first remote virtualized graphics device and (b) one or more graphics operation response packets from the first virtualized remote virtualized graphics device to be delivered over the network to the first graphics request generator.
A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors cause the one or more processors to:
- in response to a request for a graphics session coordinator, establish a first graphics session coordinator with a first network address, wherein the first network address is accessible from one or more graphics request generators;
- determine that a first request for a first graphics session on behalf of a first graphics request generator has been submitted to the first network address;
- select a first remote virtualized graphics device accessible to the first graphics request generator over a network to perform one or more graphics operations;
- and
- cause a first configuration operation at one or more routing devices to enable (a) one or more graphics operation request packets from the first graphics request generator to be delivered over a network to the first remote virtualized graphics device and (b) one or more graphics operation response packets from the first virtualized remote virtualized graphics device to be delivered over the network to a graphics results destination.
Dependencies are inferred from the claim text.