# US 2024/0202046 A1 · Hot-Plug Events In A Pool Of Reconfigurable Data Flow Resources

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202046 A1
- Document ID: US20240202046A1
- Status: Published application
- Kind: A1
- Application number: 18/083,403
- Filed: 2022-12-16
- Published: 2024-06-20
- Earliest claimed: 2022-12-16
- Assignees: SambaNova Systems, Inc.
- Applicants: SambaNova Systems, Inc.
- Inventors: Anand MISRA; Conrad Alexander TURLIK; Maran WILSON; Anand VAYYALA; Raghu SHENBAGAM; Ranen CHATTERJEE; Pushkar Shridhar NANDKAR; Shivam RAIKUNDALIA
- Web page: https://patentgrep.com/patent/US20240202046A1

## CPC

- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- G06F 9/5016: {the resource being the memory}
- G06F 13/4081: {Live connection to bus, e.g. hot-plugging (current or voltage limitation during live insertion H02H9/004)}
- G06F 13/4221: {being an input/output bus, e.g. ISA bus, EISA bus, PCI bus, SCSI bus}
- G06F 2209/5011: Pool
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A data processing system comprises a pool of reconfigurable data flow resources with arrays of physical configurable units, a controller, and a runtime processor. The controller is configured to generate a hot-plug event in response to detecting a removal of an unallocated array of physical configurable units from the pool of reconfigurable data flow resources. The runtime processor is configured to execute user applications on a subset of the arrays of physical configurable units and to receive the hot-plug event from the controller. The runtime processor is further configured to make the removed unallocated array of physical configurable units unavailable for subsequent allocations of subsequent virtual data flow resources and subsequent executions of subsequent user applications, while the subset of the arrays of physical configurable units continues the execution of the user applications.

## Claims

### Claim 1

(canceled)

### Claim 2 (depends on 18)

The data processing system of claim 18, wherein the removal of the at least one reconfigurable processor of the plurality of reconfigurable processors from the pool of reconfigurable data flow resources is reactive to an error event in the the at least one reconfigurable processor.

### Claim at position 3

3-14. (canceled)

### Claim 15 (depends on 18)

The data processing system of claim 18, wherein the runtime processor comprises:
a daemon module;
a kernel module; and
a fault management module that is configured to determine that a memory resource of a plurality of memory resources of an allocated array of physical configurable units in the pool of reconfigurable data flow resources is in a faulty state; and
transmit a file descriptor data structure to the kernel module using an input-output control (IOCTL) system call, wherein the file descriptor data structure specifies that the memory resource of the plurality of memory resources of the allocated array of physical configurable units in the pool of reconfigurable data flow resources is in the faulty state.

### Claim 16 (depends on 15)

The data processing system of claim 15, wherein the kernel module is configured to respond to the IOCTL system call by putting the allocated array of physical configurable units in a drain mode,
wherein in the drain mode, after the execution of one or more of the user applications on the allocated array of physical configurable units, the kernel module removes the allocated array of physical configurable units from the pool of reconfigurable data flow resources, thereby transforming the allocated array of physical configurable units into an unavailable array of physical configurable units that is unavailable for the subsequent allocation of the subsequent virtual data flow resources and the subsequent execution of the subsequent user applications.

### Claim 17 (depends on 16)

The data processing system of claim 16, wherein the kernel module is configured to transmit an interrupt to the daemon module,
wherein the interrupt requests a reconfiguration of the plurality of memory resources of the unavailable array of physical configurable units without the memory resource that is in the faulty state.

### Claim 18

A data processing system, comprising:
a pool of reconfigurable data flow resources having a plurality of reconfigurable processors, and memory; and
a runtime processor connected to the pool of reconfigurable data flow resources, and configured to provide unified access to the plurality of reconfigurable processors via a file system,
wherein the file system is configured as a rollup file structure representation of the plurality of reconfigurable processors into a root device directory,
wherein the file system is configured to decouple the root device directory from changes to the pool of reconfigurable data flow resources, and
wherein the changes comprise a removal of at least one reconfigurable processor of the plurality of reconfigurable processors from the pool of reconfigurable data flow resources.

### Claim 19 (depends on 18)

The data processing system of claim 18, wherein the changes further comprise an addition of at least one of a previously removed reconfigurable processor or an additional reconfigurable processor to the pool of reconfigurable data flow resources.

### Claim 20

(canceled)
