Processor compiler for scheduling instructions to reduce execution delay due to dependencies
AssigneeGroq, Inc.
InventorsJonathan Alexander Ross, Gregory M. Thorson
Life of this patent
Estimating the term…
Loading patent…
AssigneeGroq, Inc.
InventorsJonathan Alexander Ross, Gregory M. Thorson
Estimating the term…
A system receives a predictive model and receives one or more runtime constraints. The system generates a directed acyclic graph (DAG) of the predictive model indicating dependencies. The system compiles the predictive model into first instructions for a first processor based on the one or more runtime constraints and the DAG. The system packages first instructions, the one or more runtime constraints, and the DAG of the predictive model in a first binary. The system recompiles the predictive model into second instructions for a second processor based on the runtime constraints and the DAG stored in the first processor. The system packages the second instructions, the DAG, and the runtime constraints in a second binary.
A method, comprising:
A system comprising:
Dependencies are inferred from the claim text.