Processor system and method for increasing data-transfer bandwidth during execution of a scheduled parallel process

The method of claim [0012]:

• wherein broadcasting the first input tensor from the second source address to the first relative destination address comprises:
• via a direct memory access core of the processor system, issuing a first read request for the first input tensor at the second source address;
• in response to the first read request, loading the first input tensor into a data buffer;
• via the direct memory access core, issuing a first write request specifying the first relative destination address;
• and
• via a set of broadcast buses of the processor system, transferring the first input tensor from the data buffer to the first relative destination address in each primary memory unit in the set of primary memory units;
• and
• wherein broadcasting the second weight tensor from the third source address to the second relative destination address comprises:
• via the direct memory access core of the processor system, issuing a second read request for the second weight tensor at the third source address;
• in response to the second read request, loading the second weight tensor into the data buffer;
• and
• via the direct memory access core, issuing a second write request specifying the second relative destination address;
• and
• via the set of broadcast buses, transferring the second weight tensor from the data buffer to the second relative destination address in each primary memory unit in the set of primary memory units.

The method of claim [0012]:

• wherein, for each processing unit in the set of processing units, transferring the weight tensor partition in the set of weight tensor partitions from the first source address to the first destination address comprises, for each processing unit in the set of processing units:
• via a direct memory access core of the processor system, issuing a read request for the weight tensor partition at the first source address;
• in response to the read request for the weight tensor partition, loading the weight tensor partition into a data buffer;
• selecting a unicast mode for a broadcast bus in the set of broadcast buses corresponding to the primary memory unit of the processing unit;
• and
• transferring the weight tensor partition from the data buffer to the first destination address in the primary memory unit of the processing unit;
• and
• wherein, for each processing unit in the set of processing units, transferring the input tensor partition in the set of input tensor partitions from the fourth source address to a second destination address comprises, for each processing unit in the set of processing units:
• via the direct memory access core of the processor system, issuing a read request for the input tensor partition at the fourth source address;
• in response to the read request for the input tensor partition, loading the weight tensor partition into the data buffer;
• selecting the unicast mode for the broadcast bus in the set of broadcast buses corresponding to the primary memory unit of the processing unit;
• and
• transferring the input tensor partition from the data buffer to the second destination address in the primary memory unit of the processing unit.

A method for executing a neural network by a processor system comprising a shared memory unit, a set of primary memory units, a set of processing units, a direct memory access core, and a broadcast subsystem, the method comprising:

• storing, in the shared memory unit:
• an input tensor at a first source address, the input tensor characterized by a first set of dimensions;
• and
• a weight tensor at a second source address, the weight tensor:
• comprising a set of weight tensor partitions;
• and
• characterized by a second set of dimensions smaller than the first set of dimensions;
• via the broadcast subsystem, broadcasting the input tensor from the first source address to a relative destination address in a target set of primary memory units from the set of primary memory units;
• and
• for each primary memory unit in the target set of primary memory units:
• transferring a weight tensor partition in the set of weight tensor partitions from the second source address to a destination address in the primary memory unit;
• and
• via a processing unit corresponding to the primary memory unit, generating an output tensor partition of an output tensor based on the input tensor and the weight tensor partition.

A method for executing a neural network by a processor system comprising a shared memory unit, a set of primary memory units, a set of processing units, and a broadcast subsystem, the method comprising:

• storing, in the shared memory unit:
• a weight tensor at a first source address, the weight tensor characterized by a first set of dimensions;
• and
• an input tensor at a second source address, the input tensor:
• comprising a set of input tensor partitions;
• and
• characterized by a second set of dimensions smaller than the first set of dimensions;
• broadcasting, via the broadcast subsystem, the weight tensor from the first source address to a relative destination address in a target set of primary memory units in the set of primary memory units;
• and
• for each primary memory unit in the target set of primary memory units:
• transferring an input tensor partition in the set of input tensor partitions from the second source address to a destination address in the primary memory unit;
• and
• via a processing unit corresponding to the primary memory unit, generating an output tensor partition of an output tensor based on the weight tensor and the input tensor partition.