Techniques for artificial intelligence capabilities at a network switch
AssigneeIntel Corporation
InventorsFrancesc GUIM BERNAT, Suraj PRABHAKARAN, Kshitij A. DOSHI, Brinda GANESH, Timothy VERRALL
Life of this patent
Estimating the term…
Abstract
Examples include techniques for artificial intelligence (AI) capabilities at a network switch. These examples include receiving a request to register a neural network for loading to an inference resource located at the network switch and loading the neural network based on information included in the request to support an AI service to be provided by users requesting the AI service.
Claims23
At least one non-transitory machine readable medium storing instructions to be executed by at least one machine to be associated with a network switch, the network switch being configurable to comprise graphics processing unit (GPU) resource circuitry, data traffic processing circuitry, and management data processing circuitry, the network switch to be used in association with multiple tenants, the instructions, when executed by the at least one machine, resulting in the network switch being configured for performance of operations comprising:
- receiving, at the network switch, management data and tenant service-related data, the tenant service-related data being configurable to correspond, at least in part, to artificial intelligence (AI) service requests of the multiple tenants, respective portions of the tenant service-related data being associated with respective of the multiple tenants;
- generating, by the management data processing circuitry, configuration data, the configuration data to be based upon the management data, the configuration data to configure the GPU resource circuitry of the network switch to implement multi-tenant services associated with the respective of the multiple tenants, the multi-tenant services to be accessed by the respective of the multiple tenants based upon the respective portions of the tenant service-related data;
- and
- routing, by the data traffic processing circuitry, the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch so as to permit the respective of the multiple tenants to access, based upon the respective portions of the tenant service-related data, the multi-tenant services associated with the respective of the multiple tenants;
- wherein:
- the data traffic processing circuitry is configurable to implement load balancing in association with the routing of the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch;
- the multiple tenants are to be associated with respective tenant identification data;
- and
- the data traffic processing circuitry is configurable to implement the routing of the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch based upon priority data.
A method to be implemented in association with a network switch, the network switch being configurable to comprise graphics processing unit (GPU) resource circuitry, data traffic processing circuitry, and management data processing circuitry, the network switch to be used in association with multiple tenants, the method comprising:
- receiving, at the network switch, management data and tenant service-related data, the tenant service-related data being configurable to correspond, at least in part, to artificial intelligence (AI) service requests of the multiple tenants, respective portions of the tenant service-related data being associated with respective of the multiple tenants;
- generating, by the management data processing circuitry, configuration data, the configuration data to be based upon the management data, the configuration data to configure the GPU resource circuitry of the network switch to implement multi-tenant services associated with the respective of the multiple tenants, the multi-tenant services to be accessed by the respective of the multiple tenants based upon the respective portions of the tenant service-related data;
- and
- routing, by the data traffic processing circuitry, the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch so as to permit the respective of the multiple tenants to access, based upon the respective portions of the tenant service-related data, the multi-tenant services associated with the respective of the multiple tenants;
- wherein:
- the data traffic processing circuitry is configurable to implement load balancing in association with the routing of the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch;
- the multiple tenants are to be associated with respective tenant identification data;
- and
- the data traffic processing circuitry is configurable to implement the routing of the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch based upon priority data.
Circuitry to implement a network switch, the network switch being configurable to comprise graphics processing unit (GPU) resource circuitry, the network switch to be used in association with multiple tenants, the circuitry to implement the network switch comprising:
- circuitry to receive, at the network switch, management data and tenant service-related data, the tenant service-related data being configurable to correspond, at least in part, to artificial intelligence (AI) service requests of the multiple tenants, respective portions of the tenant service-related data being associated with respective of the multiple tenants;
- management data processing circuitry to generate, based upon the management data, configuration data, the configuration data to configure the GPU resource circuitry of the network switch to implement multi-tenant services associated with the respective of the multiple tenants, the multi-tenant services to be accessed by the respective of the multiple tenants based upon the respective portions of the tenant service-related data;
- and
- data traffic processing circuitry to route the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch so as to permit the respective of the multiple tenants to access, based upon the respective portions of the tenant service-related data, the multi-tenant services associated with the respective of the multiple tenants;
- wherein:
- the data traffic processing circuitry is configurable to implement load balancing in association with the routing of the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch;
- the multiple tenants are to be associated with respective tenant identification data;
- and
- the data traffic processing circuitry is configurable to implement the routing of the respective portions of the tenant service-related data to the GPU resource circuitry of the network switch based upon priority data.
A cloud-based networked system to be used in association with multiple tenants, the cloud-based networked system comprising:
- compute resources;
- and
- network switch circuitry to be communicatively coupled to the compute resources, the network switch circuitry comprising:
- graphics processing unit (GPU) resource circuitry;
- circuitry to receive management data and tenant service-related data, the tenant service-related data being configurable to correspond, at least in part, to artificial intelligence (AI) service requests of the multiple tenants, respective portions of the tenant service-related data being associated with respective of the multiple tenants;
- management data processing circuitry to generate, based upon the management data, configuration data, the configuration data to configure the GPU resource circuitry to implement, at least in part, multi-tenant services associated with the respective of the multiple tenants, the multi-tenant services to be accessed by the respective of the multiple tenants based upon the respective portions of the tenant service-related data;
- and
- data traffic processing circuitry to route the respective portions of the tenant service-related data to the GPU resource circuitry and to the compute resources so as to permit the respective of the multiple tenants to access, based upon the respective portions of the tenant service-related data, the multi-tenant services associated with the respective of the multiple tenants;
- wherein:
- the data traffic processing circuitry is configurable to implement load balancing in association with the routing of the respective portions of the tenant service-related data to the GPU resource circuitry and to the compute resources;
- the multiple tenants are to be associated with respective tenant identification data;
- and
- the data traffic processing circuitry is configurable to implement the routing of the respective portions of the tenant service-related data based upon priority data.
Dependencies are inferred from the claim text.