Method for processing user query, electronic device and storage medium

An electronic device, comprising:

• at least one processor;
• and
• a memory connected in communication with the at least one processor;
• wherein the memory stores an instruction executable by the at least one processor, and the instruction, when executed by the at least one processor, enables the at least one processor to execute operations comprising:
• receiving a first user query;
• performing word segmentation on the first user query to obtain a token list corresponding to the first user query;
• determining a reusable key-value cache of the first user query according to the token list;
• and
• in a case where the reusable key-value cache is in a process of transmission from a graphics processing unit to a central processing unit, stopping the transmission of the reusable key-value cache, and allocating the reusable key-value cache to the first user query.

A non-transitory computer-readable storage medium storing a computer instruction thereon, wherein the computer instruction is used to cause a computer to execute operations comprising:

• receiving a first user query;
• performing word segmentation on the first user query to obtain a token list corresponding to the first user query;
• determining a reusable key-value cache of the first user query according to the token list;
• and
• in a case where the reusable key-value cache is in a process of transmission from a graphics processing unit to a central processing unit, stopping the transmission of the reusable key-value cache, and allocating the reusable key-value cache to the first user query.