# US 2025/0165747 A1 · Scalable neural network processing engine

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165747 A1
- Document ID: US20250165747A1
- Status: Published application
- Kind: A1
- Application number: 19/030,867
- Filed: 2025-01-17
- Published: 2025-05-22
- Earliest claimed: 2018-05-04
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Erik Norden; Liran FISHEL; Sung Hee PARK; Jaewon SHIN; Christopher L. MILLS; Seungjin LEE; Fernando A. MUJICA
- Web page: https://patentgrep.com/patent/US20250165747A1

## CPC

- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/063: using electronic means
- G06F 1/3296: by lowering the supply or operating voltage
- G06N 3/045: Combinations of networks
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Embodiments relate to a neural processor circuit with scalable architecture for instantiating one or more neural networks. The neural processor circuit includes a data buffer coupled to a memory external to the neural processor circuit, and a plurality of neural engine circuits. To execute tasks that instantiate the neural networks, each neural engine circuit generates output data using input data and kernel coefficients. A neural processor circuit may include multiple neural engine circuits that are selectively activated or deactivated according to configuration data of the tasks. Furthermore, an electronic device may include multiple neural processor circuits that are selectively activated or deactivated to execute the tasks.

## Claims

### Claim 1

A system, comprising:
a processor circuit configured to:
receive a task identifier of a task; and
stop execution of tasks after the task identified by the task identifier is queued for execution; and
an interconnect circuit communicatively coupled to the processor circuit, the interconnect circuit configured to provide kernel coefficients associated with the task to the processor circuit, wherein the processor circuit is further configured to:
receive an indication that the kernel coefficients were provided to the processor circuit; and
resume the execution of tasks, including the task, based on the indication.

### Claim 2 (depends on 1)

The system of claim 1, wherein the interconnect circuit comprises a data buffer circuit and a direct memory access (DMA) circuit, wherein the DMA circuit is configured to obtain configuration data for the task from a memory communicatively coupled to the processor circuit and to store the configuration data in the data buffer circuit.

### Claim 3 (depends on 2)

The system of claim 2, wherein the DMA circuit is further configured to provide the configuration data to the processor circuit.

### Claim 4 (depends on 1)

The system of claim 1, wherein the processor circuit comprises a breakpoint register, and wherein the processor circuit is configured to store the task identifier in the breakpoint register.

### Claim 5 (depends on 4)

The system of claim 4, wherein the interconnect circuit is further configured to provide additional kernel coefficients associated with another task to the processor circuit, and wherein the indication comprises another task identifier for the other task.

### Claim 6 (depends on 5)

The system of claim 5, wherein the processor circuit is further configured to replace the task identifier stored in the breakpoint register with the other task identifier.

### Claim 7 (depends on 1)

The system of claim 1, wherein the processor circuit is implemented in a first integrated circuit, and wherein the interconnect circuit is implemented in a second integrated circuit.

### Claim 8

A method, comprising:
receiving, by a processing circuit, a task identifier of a task;
stopping, by the processing circuit, execution of tasks after the task identified by the task identifier is queued for execution;
providing, by an interconnect circuit and to the processor circuit, kernel coefficients associated with the task;
receiving, by the processing circuit, an indication that the kernel coefficients were received; and
resuming, by the processing circuit, the execution of tasks, including the task, based on the indication.

### Claim 9 (depends on 9)

The method of claim 9, further comprising:
obtaining, by the interconnect circuit, configuration data for the task from a memory communicatively coupled to the processor circuit; and
storing, by the interconnect circuit, the configuration data.

### Claim 10 (depends on 10)

The method of claim 10, further comprising providing the configuration data to the processor circuit.

### Claim 11 (depends on 9)

The method of claim 9, comprising storing the task identifier in a breakpoint register of the processor circuit.

### Claim 12 (depends on 11)

The method of claim 11, wherein the interconnect circuit is further configured to provide additional kernel coefficients associated with another task to the processor circuit, and wherein the indication comprises another task identifier for the other task.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
replacing the task identifier stored in the breakpoint register with the other task identifier.

### Claim 14 (depends on 8)

The method of claim 8, wherein the processor circuit is implemented in a first integrated circuit, and wherein the interconnect circuit is implemented in a second integrated circuit.

### Claim 15

A processor circuit, comprising:
a task manager circuit configured to:
receive a task identifier of a task;
stop execution of tasks after the task identified by the task identifier is queued for execution; and
a kernel direct memory access (DMA) engine circuit configured to:
receive kernel coefficients associated with the task from an interconnect circuit communicatively coupled to the processor circuit, wherein the task manager circuit is further configured to resume the execution of tasks, including the task, based on receiving the kernel coefficients.

### Claim 16 (depends on 15)

The processor circuit of claim 15, wherein the task manager circuit is further configured to receive configuration data for the task from the interconnect circuit.

### Claim 17 (depends on 15)

The processor circuit of claim 15, wherein the task manager circuit comprises a breakpoint register, and wherein the task manager circuit is configured to store the task identifier in the breakpoint register.

### Claim 18 (depends on 17)

The processor circuit of claim 17, wherein the kernel DMA engine circuit is further configured to receive additional kernel coefficients associated with another task from the interconnect circuit.

### Claim 19 (depends on 18)

The processor circuit of claim 18, wherein the task manager circuit is further configured to replace the task identifier stored in the breakpoint register with the other task identifier.

### Claim 20 (depends on 15)

The processor circuit of claim 15, wherein the processor circuit is implemented in a first integrated circuit, and wherein the interconnect circuit is implemented in a second integrated circuit.
