Data processing method and apparatus

A chip, comprising a computing core, wherein the computing core comprises a memory and a processor, the memory is configured to store computer instructions, when the processor run the computer instructions, the processor is caused to:

• perform, by the computing core, calculation on a first matrix, a first submatrix K′, and a second submatrix V′ based on a self-attention mechanism, to obtain a first result O′, wherein the first matrix is a submatrix Q′ of a query matrix Q or the first matrix is the query matrix Q, the first submatrix K′ is a submatrix of a key matrix K, the second submatrix V′ is a submatrix of a value matrix V, Q,K,V∈N×d, K′,V′∈y1×d, x, y1, N, and d are positive integers, x<N, and y1<N;
• perform, by the computing core, calculation on the first matrix, a third submatrix K″, and a fourth submatrix V″ based on the self-attention mechanism, to obtain a second result O″, wherein the third submatrix K″ is a submatrix of the matrix K other than the first submatrix K′, the fourth submatrix V″ is a submatrix of the matrix V other than the second submatrix V′, K″,V″∈y2×d, y2 is a positive integer less than N−y1, and Q″ ∈x×d;
• and
• determining, by the computing core, a third result based on at least the first result O′ and the second result O″, wherein the third result is a matrix O obtained by performing calculation on the matrix Q, the matrix K, and the matrix V based on the self-attention mechanism, or the third result is a submatrix of the matrix O, and O∈N×d.

A computer-readable storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the processor is caused to:

• perform, by the computing core, calculation on a first matrix, a first submatrix K′, and a second submatrix V′ based on a self-attention mechanism, to obtain a first result O′, wherein the first matrix is a submatrix Q of a query matrix Q or the first matrix is the query matrix Q, the first submatrix K′ is a submatrix of a key matrix K, the second submatrix V′ is a submatrix of a value matrix V, Q,K,V∈N×d, Q, ∈x×d, K′,V′∈y1×d, x, y1, N, and d are positive integers, x<N, and y1<N;
• perform, by the computing core, calculation on the first matrix, a third submatrix K″, and a fourth submatrix V″ based on the self-attention mechanism, to obtain a second result O″, wherein the third submatrix K″ is a submatrix of the matrix K other than the first submatrix K′, the fourth submatrix V″ is a submatrix of the matrix V other than the second V′, K″,V″∈y2×d, y2 is a positive integer less than N−y1, and Q″∈x×d;
• and
• determining, by the computing core, a third result based on at least the first result O′ and the second result O″, wherein the third result is a matrix O obtained by performing calculation on the matrix Q, the matrix K, and the matrix V based on the self-attention mechanism, or the third result is a submatrix of the matrix O, and O, and O∈N×d.