Electronic device and method of training transformer model and performing inference using transformer model

A method of training a transformer model comprising a plurality of encoders and a plurality of decoders, wherein each of the plurality of encoders and the plurality of decoders comprises a transformer block comprising an attention block, and the method is performed by an electronic device and comprises:

• receiving target data and training data;
• and
• training the transformer model to output the target data with respect to the training data,
• wherein the training of the transformer model comprises skipping performing one or more of a key embedding computation, a query embedding computation, and a value embedding computation on input data of the attention block.

A method of performing inference by using a transformer model comprising a plurality of encoders and a plurality of decoders, wherein each of the plurality of encoders and the plurality of decoders comprises a transformer block comprising an attention block, and the method is performed by an electronic device and comprises:

• receiving input data;
• and
• using the transformer model to perform inference on the input data, thereby generating output data,
• wherein the generating of the output data comprises skipping performing one or more of a key embedding computation, a query embedding computation, and a value embedding computation on input data of the attention block.