Method for managing tasks of a neural processing device
AssigneeRebellions Inc.
InventorsWongyu Shin, Miock Chi, Hongyun Kim, Jinwook Oh, Juyeong Yoon
Life of this patent
Estimating the term…
Abstract
A neural processing device and a method for managing tasks thereof are provided. The neural processing device includes a neural core configured to perform a task and generate a completion signal for completion of the task, a core global configured to transfer task information for the task to the neural core and receive the completion signal of the task from the neural core, and a task manager configured to generate and transmit the task information to the core global, receive the completion signal from the core global, generate a completion report, and transmit the completion report.
Claims20
Task manager circuitry comprising:
- task buffer circuitry configured to receive a task from a command processor and to generate a task descriptor for the task;
- task queue circuitry in which the task descriptor received from the task buffer circuitry waits;
- and
- runtime handle circuitry configured to generate task information corresponding to the task descriptor transferred from the task queue circuitry and to transfer the task information to a core global,
- wherein the task descriptor comprises a wait field associated with control of an execution time of the task, and
- wherein the runtime handle circuitry is further configured to check whether the task descriptor includes the wait field for the task and to determine a state of the task descriptor as a run state or a waiting state.
A neural processing device comprising:
- task manager circuitry configured to generate task information corresponding to a task descriptor;
- a neural core configured to perform a task according to the task information and to generate a completion signal of the task;
- and
- a core global configured to receive task information for the task, to transfer the task information to the neural core, and to receive the completion signal of the task from the neural core,
- wherein the task descriptor comprises a wait field associated with control of an execution time of the task, and
- wherein the task manager circuitry is further configured to check whether the task descriptor includes the wait field for the task and to determine a state of the task descriptor as a run state or a waiting state.
A method for managing tasks of a neural processing device, comprising:
- receiving, by task buffer circuitry of the neural processing device, a task from a command processor of the neural processing device;
- generating, by the task buffer, a task descriptor for the task;
- receiving, by task queue circuitry of the neural processing device, the task descriptor from the task buffer, wherein the task descriptor comprises a wait field associated with control of an execution time of the task;
- generating, by runtime handle circuitry of the neural processing device, task information corresponding to the task descriptor transferred from the task queue;
- transferring by the runtime handle circuitry, the task information to a core global of the neural processing device;
- checking, by runtime handle circuitry, whether the task descriptor includes the wait field for the task;
- and
- determining, by the runtime handle circuitry, a state of the task descriptor as a run state or a waiting state, based on whether the task descriptor includes the wait field.
Dependencies are inferred from the claim text.