Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsZhuo RUAN, Edward GAMSARAGAN, Arijit CHATTOPADHYAY, Simanti LAHIRI
Estimating the term…
A method implemented in an artificial intelligence (AI) offload die within a system-in-a-package involves hybrid inferencing of an AI model by a remote computing system and a compute die in the system-in-a-package. The method includes identifying a portion of the AI model for use by the compute die, utilizing a network controller in the AI offload die to fetch this portion from the remote computing system, and communicating it to the compute die. Additionally, the network controller in the AI offload die synchronizes AI model inferencing state between the compute die and the remote computing system, ensuring coordinated hybrid AI model inferencing. This approach facilitates efficient distribution and execution of AI tasks between the compute die and the remote computing system, enhancing computational performance and resource utilization.
A method implemented in an artificial intelligence (AI) offload die that comprises a network controller, and that is communicatively coupled with a compute die in a system-in-a-package, the method comprising, during a hybrid inferencing of an AI model by a remote computing system and the compute die:
An artificial intelligence (AI) offload die comprising:
A system-in-a-package, comprising:
Dependencies are inferred from the claim text.