# US 2025/0156185 A1 · Inserting predefined pad values into a stream of vectors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0156185 A1
- Document ID: US20250156185A1
- Status: Published application
- Kind: A1
- Application number: 19/027,028
- Filed: 2025-01-17
- Published: 2025-05-15
- Earliest claimed: 2013-07-15
- Assignees: Texas Instruments Incorporated
- Applicants: Texas Instruments Incorporated
- Inventors: Asheesh Bhardwaj; Timothy David Anderson; Son Hung Tran
- Web page: https://patentgrep.com/patent/US20250156185A1

## CPC

- G06F 9/3016: {Decoding the operand specifier, e.g. specifier format}
- G06F 9/30014: {with variable precision}
- G06F 9/30036: {Instructions to perform operations on packed data, e.g. vector, tile or matrix operations}
- G06F 9/30038: {using a mask}
- G06F 9/30043: {LOAD or STORE instructions; Clear instruction}
- G06F 9/30047: {Prefetch instructions; cache control instructions}
- G06F 9/30098: {Register arrangements}
- G06F 9/30112: {comprising data of variable length}
- G06F 9/30145: {Instruction analysis, e.g. decoding, instruction word fields}
- G06F 9/32: Address formation of the next instruction, e.g. by incrementing the instruction counter (G06F9/38 takes precedence)
- G06F 9/345: of multiple operands or results {(addressing multiple banks G06F12/06)}
- G06F 9/3455: {using stride}
- G06F 9/3802: {Instruction prefetching}
- G06F 9/383: {Operand prefetching (cache prefetching G06F12/0862)}
- G06F 9/3867: {using instruction pipelines}
- G06F 11/00: Error detection; Error correction; Monitoring (error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00)
- G06F 11/1048: {using arrangements adapted for a specific error detection or correction feature}
- G06F 12/0862: with prefetch
- G06F 12/0875: with dedicated cache, e.g. instruction or stack
- G06F 12/0897: with two or more cache hierarchy levels (with multilevel cache hierarchies G06F12/0811)
- G06F 12/1027: using associative or pseudo-associative address translation means, e.g. translation look-aside buffer [TLB]
- G06F 7/74: Selecting or encoding within a word the position of one or more bits having a specified value, e.g. most or least significant one or zero detection, priority encoders {(with shifting G06F5/01)}
- G06F 9/3822: {Parallel decoding, e.g. parallel decode units}
- G06F 11/10: Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06F 2212/452: Instruction code
- G06F 2212/60: Details of cache memory
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Software instructions are executed on a processor within a computer system to configure a streaming engine with stream parameters to define a multidimensional array. The stream parameters define a size for each dimension of the multidimensional array and a pad value indicator. Data is fetched from a memory coupled to the streaming engine responsive to the stream parameters. A stream of vectors is formed for the multidimensional array responsive to the stream parameters from the data fetched from memory. A padded stream vector is formed that includes a specified pad value without accessing the pad value from system memory.

## Claims

### Claim 1

A device comprising:
a matrix processing circuit that includes:
a buffer configured to store a first matrix, wherein the first matrix; and
processing circuitry configured to perform an operation on the first matrix to produce a second matrix;
a memory configured to store a set of data associated with the first matrix; and
a memory control circuit coupled between the memory and the buffer of the matrix processing circuit, wherein the memory control circuit is configured to:
retrieve the set of data from the memory according to a set of parameters that specifies a data size associated with the set of data;
provide the set of data to the matrix processing circuit as a first portion of the first matrix;
generate a second portion of the first matrix as a number of repetitions of a padding value, wherein the set of parameters specifies the padding value; and
provide the second portion of the first matrix to the matrix processing circuit.

### Claim 2 (depends on 1)

The device of claim 1, wherein the operation is a pooling operation.

### Claim 3 (depends on 2)

The device of claim 2, wherein the pooling operation includes at least one of:
maximum, minimum, or average pooling.

### Claim 4 (depends on 1)

The device of claim 1, wherein set of parameters specifies the padding value from among: an unsigned minimum value, an unsigned maximum value, a signed minimum valued, and a signed maximum value.

### Claim 5 (depends on 1)

The device of claim 1, wherein:
the set of parameters specifies a count of iterations for each of a set of loops; and
the memory control circuit is configured to determine the number of repetitions of the padding value based on the count of iterations and the data size.

### Claim 6 (depends on 5)

The device of claim 5, wherein the set of parameters specifies, for an innermost loop of the set of loops, a number of data elements to retrieve from the memory and a size of each of the data elements.

### Claim 7 (depends on 1)

The device of claim 1 further comprising a processor core that includes:
an interface coupled to the memory control circuit coupled and to the buffer of the matrix processing circuit; and
a functional unit configured to:
receive the first portion of the first matrix and the second portion of the first matrix from the memory control circuit via the interface; and
provide the first portion of the first matrix and the second portion of the first matrix to the buffer of the matrix processing circuit via the interface.

### Claim 8 (depends on 1)

The device of claim 1, wherein:
the retrieving of the set of data associated with the first matrix includes receiving a data element that is not associated with the first matrix; and
the generating of the second portion of the first matrix includes replacing the data element with the padding value.

### Claim 9 (depends on 1)

The device of claim 1, wherein the generating of the second portion of the first matrix is performed without accessing the memory.

### Claim 10 (depends on 1)

The device of claim 1, wherein the memory is a level-two (L2) cache memory.

### Claim 11 (depends on 10)

The device of claim 10, wherein the memory control circuit is coupled between the L2 cache memory and the buffer of the matrix processing circuit in a data path that does not include a level-one (L1) cache memory.

### Claim 12

A method comprising:
retrieving, by a memory control circuit, a set of data from a memory based on a set of parameters that specifies the set of data;
providing, by the memory control circuit, the set of data to a matrix processing circuit as a first portion of a matrix;
generating a second portion of the matrix that includes a number of repetitions of a padding value, wherein the set of parameters specifies the padding value;
providing, by the memory control circuit, the second portion of the matrix to the matrix processing circuit; and
performing, by the matrix processing circuit, an operation on the matrix.

### Claim 13 (depends on 12)

The method of claim 12, wherein the operation is a pooling operation.

### Claim 14 (depends on 13)

The method of claim 13, wherein the pooling operation includes at least one of: maximum, minimum, or average pooling.

### Claim 15 (depends on 12)

The method of claim 12, wherein set of parameters specifies the padding value from among: an unsigned minimum value, an unsigned maximum value, a signed minimum valued, and a signed maximum value.

### Claim 16 (depends on 12)

The method of claim 12, wherein:
the set of parameters specifies:
a count of iterations for each of a set of loops; and
a data size of the set of data; and
the memory control circuit is configured to determine the number of repetitions of the padding value based on the count of iterations and the data size.

### Claim 17 (depends on 16)

The method of claim 16, wherein the set of parameters specifies, for an innermost loop of the set of loops, a number of data elements to retrieve from the memory and a size of each of the data elements.

### Claim 18 (depends on 12)

The method of claim 12, wherein the retrieving of the set of includes receiving a data element that is not associated with the matrix; and
the generating of the second portion of the matrix includes replacing the data element with the padding value.

### Claim 19 (depends on 12)

The method of claim 12, wherein the generating of the second portion of the matrix is performed without accessing the memory.

### Claim 20 (depends on 12)

The method of claim 12, wherein the memory is a level-two (L2) cache memory.
