# US 2026/0099366 A1 · Systems and methods for performing operations with heterogeneous compute and memory resources > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2026/0099366 A1 - Document ID: US20260099366A1 - Status: Published application - Kind: A1 - Application number: 19/287,779 - Filed: 2025-07-31 - Published: 2026-04-09 - Earliest claimed: 2024-10-08 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Marie Mai NGUYEN; Rekha PITCHUMANI; Usman SAJID; Yangwook KANG; Yang Seok KI - Web page: https://patentgrep.com/patent/US20260099366A1 ## CPC - G06F 9/5011: {the resources being hardware resources other than CPUs, Servers and Terminals} - G06F 9/5044: {considering hardware capabilities} - G06N 3/045: Combinations of networks - G06N 3/047: Probabilistic or stochastic networks - G06N 3/0475: Generative networks - G06N 3/063: using electronic means - G06N 3/08: Learning methods - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Systems and methods for performing operations with heterogeneous compute and memory resources are disclosed. Data identifying a first portion of an operation and a second portion of the operation may be received. A first set of resources may be caused to perform the first portion of the operation. A second set of resources may be identified based on the operation. The second set of resources may include a first base die including a processing circuit, a memory die attached to the first base die, and a second base die connected to the first base die. The second base die may include a second processing circuit. The second set of resources may be caused to perform the second portion of the operation. ## Claims ### Claim 1 A method comprising: receiving data identifying a first portion of an operation and a second portion of the operation; causing a first set of resources to perform the first portion of the operation; identifying a second set of resources based on the operation, the second set of resources comprising: a first base die comprising a first processing circuit; a memory die attached to the first base die; and a second base die connected to the first base die, the second base die comprising a second processing circuit; and causing the second set of resources to perform the second portion of the operation. ### Claim 2 (depends on 1) The method according to claim 1, wherein the operation comprises an inference using a generative large language model. ### Claim 3 (depends on 2) The method according to claim 2, wherein the first set of resources is identified based on a time to first to token using the generative large language model. ### Claim 4 (depends on 1) The method according to claim 1, wherein the first set of resources is identified based on a latency for performing the first portion of the operation. ### Claim 5 (depends on 1) The method according to claim 1, wherein the first set of resources comprises: a compute device; and a third base die connected to the compute device, the third base die comprising a third processing circuit. ### Claim 6 (depends on 1) The method according to claim 1, wherein the first set of resources comprises one or more graphics processing units. ### Claim 7 (depends on 1) The method according to claim 1, wherein performing the first portion of the operation comprises: generating context data by the first set of resources; and transferring the context data to the second set of resources. ### Claim 8 A method comprising: receiving data identifying an operation to be performed; identifying a first set of resources based on a first portion of the operation, the first set of resources comprising: a first base die comprising a first processing circuit; a first memory die attached to the first base die; and a compute device connected to the first base die; causing the first set of resources to perform the first portion of the operation; and causing a second set of resources to perform a second portion of the operation. ### Claim 9 (depends on 8) The method according to claim 8, wherein the second set of resources comprises: a second base die comprising a second processing circuit; a second memory die attached to the second base die; and a third base die connected to the second base die, the third base die comprising a third processing circuit. ### Claim 10 (depends on 8) The method according to claim 8, wherein the operation comprises an inference using a generative large language model. ### Claim 11 (depends on 8) The method according to claim 8, wherein the second set of resources is identified based on a latency for performing the second portion of the operation. ### Claim 12 (depends on 8) The method according to claim 8, wherein performing the first portion of the operation comprises: generating context data by the first set of resources; and transferring the context data to the second set of resources. ### Claim 13 (depends on 12) The method according to claim 12, wherein the second set of resources performs the second portion of the operation using the context data. ### Claim 14 (depends on 8) The method according to claim 8, further comprising: identifying a third set of resources based on an additional operation, the third set of resources comprising a graphics processing unit; and causing the third set of resources to perform the additional operation. ### Claim 15 A method comprising: receiving data identifying a first portion of an operation and a second portion of the operation; identifying a set of resources to perform the operation, the set of resources comprising: a compute device; a base die connected to the compute device, the base die comprising one or more processing circuits; and a memory die attached to the base die; causing the set of resources in a first configuration to perform the first portion of the operation; and causing the set of resources in a second configuration to perform the second portion of the operation. ### Claim 16 (depends on 15) The method according to claim 15, wherein the compute device performs the first portion of the operation. ### Claim 17 (depends on 15) The method according to claim 15, wherein the one or more processing circuits perform the second portion of the operation. ### Claim 18 (depends on 15) The method according to claim 15, wherein performing the first portion of the operation comprises generating context data. ### Claim 19 (depends on 18) The method according to claim 18, wherein performing the second portion of the operation comprises using the context data. ### Claim 20 (depends on 15) The method according to claim 15, wherein the set of resources comprises a network device configured to interface with a memory controller.