Image processing apparatus, image processing method, and computer-readable recording medium

An image processing method in which an image processing apparatus executes a plurality of sparse transformer processes,

• wherein the sparse transformer processes each execute:
• an extraction process that:
• uses a matrix formed such that a plurality of first feature vectors at a first time point constitute rows and a matrix formed such that a plurality of second feature vectors at a second time point that is earlier than the first time point constitute rows to calculate, for each of the first feature vectors, the difference between the first feature vector and a second feature vector corresponding to the first feature vector;
• and, based on the difference, extracts a feature vector that is a computation target from among the first feature vectors;
• and
• a transformer process that includes a plurality of matrix multipliers that execute matrix multiplication computation using the plurality of first feature vectors, wherein each of the matrix multipliers:
• executes matrix multiplication computation for the feature vector that is a computation target;
• and does not execute matrix multiplication computation and uses a result of the matrix multiplication computation at the second time point for a feature vector that is not a computation target among the first feature vectors.

A non-transitory computer readable recording medium that includes a program recorded thereon,

• wherein the program causes a computer to execute a plurality of sparse transformer processes, and
• the sparse transformer processes each execute:
• an extraction process that:
• uses a matrix formed such that a plurality of first feature vectors at a first time point constitute rows and a matrix formed such that a plurality of second feature vectors at a second time point that is earlier than the first time point constitute rows to calculate, for each of the first feature vectors, the difference between the first feature vector and a second feature vector corresponding to the first feature vector;
• and, based on the difference, extracts a feature vector that is a computation target from among the first feature vectors;
• and
• a transformer process that includes a plurality of matrix multipliers that execute matrix multiplication computation using the plurality of first feature vectors, wherein each of the matrix multipliers:
• executes matrix multiplication computation for the feature vector that is a computation target;
• and does not execute matrix multiplication computation and uses a result of the matrix multiplication computation at the second time point for a feature vector that is not a computation target among the first feature vectors.