Electronic device and operation method thereof

An operation method of an electronic device for processing a word by using a language model, the operation method comprising:

• storing, in a first memory configured to operate and a first speed, a compressed embedding matrix including a plurality of compressed vectors respectively corresponding to a plurality of words and scaling factors corresponding to the plurality of compressed vectors;
• storing, in a second memory configured to operate at a second speed that is faster than the first speed, a first group of the plurality of compressed vectors identified based on first frequency information of the plurality of compressed vectors;
• storing, in the second memory, a first group of the scaling factors identified based on second frequency information of the scaling factors;
• obtaining, from the first memory or the second memory, a first compressed vector and a first scaling factor corresponding to an input word;
• and
• processing the obtained first compressed vector and the obtained first scaling factor by using a neural network.

One or more computer-readable recording media having stored therein a program for controlling an electronic device to perform a method, the method comprising:

• storing, in a first memory configured to operate and a first speed, a compressed embedding matrix including a plurality of compressed vectors respectively corresponding to a plurality of words and scaling factors corresponding to the plurality of compressed vectors;
• storing, in a second memory configured to operate at a second speed that is faster than the first speed, a first group of the plurality of compressed vectors identified based on first frequency information of the plurality of compressed vectors;
• storing, in the second memory, a first group of the scaling factors identified based on second frequency information of the scaling factors;
• obtaining, from the first memory or the second memory, a first compressed vector and a first scaling factor corresponding to an input word;
• and
• processing the obtained first compressed vector and the obtained first scaling factor by using a neural network.