# US 2024/0004776 A1 · User-space emulation framework for heterogeneous soc design

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004776 A1
- Document ID: US20240004776A1
- Status: Published application
- Kind: A1
- Application number: 18/249,885
- Filed: 2021-10-22
- Published: 2024-01-04
- Earliest claimed: 2020-10-22
- Assignees: Arizona Board of Regents on behalf of Arizona State University; Arizona Board of Regents on Behalf of the University of Arizona; Board of Regents, The University of Texas System; Carnegie Mellon University
- Applicants: Arizona Board of Regents on Behalf of Arizona State University; Arizona Board of Regents on Behalf of the University of Arizona; Board of Regents, The University of Texas System; Carnegie Mellon University
- Inventors: Umit Ogras; Radu Marculescu; Ali Akoglu; Chaitali Chakrabarti; Daniel Bliss; Samet Egemen Arda; Anderson Sartor; Nirmal Kumbhare; Anish Krishnakumar; Joshua Mack; Ahmet Goksoy; Sumit Mandal
- Web page: https://patentgrep.com/patent/US20240004776A1

## CPC

- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 11/3457: {Performance evaluation by simulation}
- G06F 9/5038: {considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration (scheduling strategies G06F9/4881 and subgroups)}
- G06F 11/3024: {where the computing system component is a central processing unit [CPU]}
- G06F 11/3414: {Workload generation, e.g. scripts, playback}
- G06F 11/3419: {by assessing time}
- G06F 11/3636: {by tracing the execution of the program}
- G06F 13/105: {where the program performs an input/output emulation function}
- G06F 30/331: with hardware acceleration, e.g. by using field programmable gate array [FPGA] or emulation
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06F 2209/503: Resource availability
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A user-space emulation framework for heterogeneous system-on-chip (SoC) design is provided. Embodiments described herein propose a portable, Linux-based emulation framework to provide an ecosystem for hardware-software co-design of heterogenous SoCs (e.g., domain-specific SoCs (DSSoCs)) and enable their rapid evaluation during the pre-silicon design phase. This framework holistically targets three key challenges of heterogeneous SoC design: accelerator integration, resource management, and application development. These challenges are addressed via a flexible and lightweight user-space runtime environment that enables easy integration of new accelerators, scheduling heuristics, and user applications, and the utility of each is illustrated through various case studies. A prototype compilation toolchain is introduced that enables automatic mapping of unlabeled C code to heterogeneous SoC platforms. Taken together, this environment offers a unique ecosystem to rapidly perform functional verification and obtain performance and utilization estimates that help accelerate convergence towards a final heterogeneous SoC design.

## Claims

### Claim 1

An emulation environment for heterogeneous system-on-chip (SoC) design, comprising:
a workload manager configured to schedule application tasks onto heterogeneous processing elements (PEs) in a heterogeneous SoC based on a scheduling policy; and
a resource manager configured to simulate a test hardware configuration using the heterogeneous PEs and execute the application tasks scheduled by the workload manager.

### Claim 2 (depends on 1)

The emulation environment of claim 1, wherein the application tasks comprise heterogeneous application tasks.

### Claim 3 (depends on 1)

The emulation application of claim 1, further comprising an application handler configured to generate a workload comprising the application tasks.

### Claim 4 (depends on 2)

The emulation environment of claim 2, wherein the application handler is further configured to generate workloads for different applications from hardware-agnostic application code.

### Claim 5 (depends on 2)

The emulation environment of claim 2, wherein the application handler is further configured to receive an application code in form of:
a directed acyclic graph (DAG) for the application tasks; and
a binary compilation of the application.

### Claim 6 (depends on 5)

The emulation environment of claim 5, workload manager is further configured to receive the DAG from the application handler and manage dependencies between the application tasks.

### Claim 7 (depends on 1)

The emulation environment of claim 1, wherein the workload manager comprises:
an application tracker configured to track application tasks for each of a plurality of applications;
a resource tracker configured to track availability of the heterogeneous PEs; and
a modular scheduler configured to provide the scheduling policy.

### Claim 8 (depends on 7)

The emulation environment of claim 7, wherein the modular scheduler is further configured to map the application tasks to corresponding PEs based on the availability of the heterogeneous PEs.

### Claim 9 (depends on 1)

The emulation environment of claim 1, wherein the resource manager is further configured to dispatch to hardware resources via application threads.

### Claim 10 (depends on 9)

The emulation environment of claim 9, wherein the resource manager is further configured to coordinate data flow between the hardware resources during simulation.

### Claim 11 (depends on 1)

The emulation environment of claim 1, wherein the heterogeneous PEs of the heterogeneous SoC comprises one or more general processor clusters and one or more hardware accelerator clusters.

### Claim 12 (depends on 11)

The emulation environment of claim 11, wherein the one or more hardware accelerator clusters comprises at least one of: a cluster of matrix multipliers, a cluster of Viterbi decoders, a cluster of fast Fourier transform (FFT) accelerators, a cluster of graphical processing units (GPUs), a cluster of digital signal processors (DSPs), or a cluster of tensor processing units (TPUs).

### Claim 13

A method for developing an application for heterogeneous system-on-chip (SoC) implementation, the method comprising:
obtaining an application code;
converting the application code into a platform-independent hardware representation; and
generating an object notation-based representation of the application code for heterogeneous SoC implementation from the platform-independent hardware representation.

### Claim 14 (depends on 13)

The method of claim 13, wherein the application code is for an application comprising a plurality of heterogeneous application tasks.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
generating a directed acyclic graph (DAG) for the plurality of heterogeneous application tasks; and
using the DAG to manage dependencies between the plurality of heterogeneous application tasks for the heterogeneous SoC implementation.

### Claim 16 (depends on 13)

The method of claim 13, further comprising scheduling execution of the object notation-based representation of the application code onto heterogeneous processing elements (PEs) in the heterogeneous SoC.

### Claim 17 (depends on 16)

The method of claim 16, further comprising emulating a hardware configuration of the heterogeneous SoC and executing the object notation-based representation of the application code therein.

### Claim 18 (depends on 17)

The method of claim 17, further comprising generating workloads for emulating a plurality of different applications using the hardware configuration of the heterogeneous SoC.

### Claim 19 (depends on 16)

The method of claim 16, wherein scheduling execution of the object notation-based representation of the application code further comprises:
tracking application tasks for the application code; and
tracking availability of the heterogeneous PEs.

### Claim 20 (depends on 19)

The method of claim 19, further comprising mapping the application tasks to corresponding PEs based on the availability of the heterogeneous PEs.
