US 2026/0228052 A1 · ARTIFICIAL INTELLIGENCE (AI) CPU PROCESSING WITH SELF-DIRECTED APPLICATION CLUSTER DEPLOYMENTS

Abstract

Various aspects of configuring and executing artificial intelligence (AI) computing operations on a central processing unit (CPU) with self-directed application deployment at an edge device are described. In an example, an edge computing system improves AI model inferencing within mixed-generation or mixed-capability CPU clusters (e.g., server nodes) by dynamically reassigning tasks based on real-time instruction-usage patterns. High-performance AI nodes can be tagged to ensure deterministic and high-quality inferencing, improving performance on nodes with native AI acceleration capabilities. By binding inference tasks to nodes with AI extensions and distributing other service pods across available nodes, the disclosed approach enhances AI processing throughput while supporting diverse hardware configurations, including CPUs with varying AI inference capabilities (e.g., CPUs that include Advanced Matrix Extensions (AMX) tiles or similar hardware blocks).

Claims20

Dependent claims

A processing device, comprising:

circuitry comprising at least one compute die providing multiple central processing unit (CPU) cores, the CPU cores including:
a first set of cores, wherein a respective core of the first set of cores is provided with a corresponding artificial intelligence (AI) computation unit;
and
a second set of cores, wherein a respective core of the second set of cores is provided without a corresponding AI computation unit;
and
circuitry to track performance from execution of respective processing workloads among the CPU cores;
wherein the processing device is configured to:
identify the respective processing workloads that include operations capable of execution on at least one AI computation unit of the first set of cores;
and
allocate the identified processing workloads to be executed on at least a portion of the first set of cores, based on a capability to be executed by the first set of cores or meet performance conditions.

7 more elements

A computer system, comprising:

processing circuitry, including:
at least one compute die providing multiple central processing unit (CPU) cores, the CPU cores including:
a first set of cores, wherein a respective core of the first set of cores is provided with a corresponding artificial intelligence (AI) computation unit;
and
a second set of cores, wherein a respective core of the second set of cores is provided without a corresponding AI computation unit;
and
at least one counter to track performance conditions from execution of respective processing workloads among the CPU cores;
and
at least one memory device including instructions embodied thereon, wherein the instructions, when executed by the processing circuitry, configure the processing circuitry to:
identify the respective processing workloads that include operations capable of execution on at least one AI computation unit of the first set of cores;
and
allocate the identified processing workloads to be executed on at least a portion of the first set of cores, based on a capability to be executed by the first set of cores or meet the performance conditions.

9 more elements

Dependencies are inferred from the claim text.

Artificial intelligence (ai) cpu processing with self-directed application cluster deployments

Life of this patent

Artificial intelligence (ai) cpu processing with self-directed application cluster deployments

Life of this patent

Abstract

Claims20