Method, device, and computer program product for batch processing a plurality of user requests

An electronic device, comprising:

• at least one processor;
• and
• a memory coupled to the at least one processor and having instructions stored therein, wherein the instructions, when executed by the at least one processor, cause the electronic device to perform actions comprising:
• processing a plurality of user requests in a batch request by using a pre-trained language model;
• inputting a candidate user request into the pre-trained language model when it is detected that the pre-trained language model outputs a response result corresponding to at least one user request;
• and
• processing the candidate user request and other user requests in the batch request by using the pre-trained language model, the other user requests comprising user requests other than the at least one user request in the batch request.

A computer program product, the computer program product being tangibly stored on a non-transitory computer-readable storage medium and comprising machine-executable instructions, wherein the machine-executable instructions, when executed by a machine, cause the machine to perform:

• processing a plurality of user requests in a batch request by using a pre-trained language model;
• inputting a candidate user request into the pre-trained language model when it is detected that the pre-trained language model outputs a response result corresponding to at least one user request;
• and
• processing the candidate user request and other user requests in the batch request by using the pre-trained language model, the other user requests comprising user requests other than the at least one user request in the batch request.