Method and apparatus for improving model based on pre-trained semantic model

An electronic device, comprising:

• at least one processor;
• and
• a memory communicating with the at least one processor, wherein the memory stores instructions executable by the at least one processor, and the instructions, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
• obtaining, based on a pre-trained semantic model, an initial improved model, wherein semantic result information of an input vector is determined in the initial improved model based on a hash search method;
• and
• training, based on a model distillation method, the initial improved model to obtain an improved model, wherein determining the semantic result information of the input vector in the initial improved model based on the hash search method comprises:
• obtaining, based on a fully connected layer, a transformation vector of the input vector in the initial improved model;
• and
• determining a target position corresponding to the transformation vector in a hash storage module storing semantic information according to the hash search method, and using semantic information stored in the target position as the semantic result information of the input vector.

A non-transitory computer readable storage medium storing computer instructions, wherein the computer instructions, when executed by a computer, cause the computer to perform operations, the operations comprising:

• obtaining, based on a pre-trained semantic model, an initial improved model, wherein semantic result information of an input vector is determined in the initial improved model based on a hash search method;
• and
• training, based on a model distillation method, the initial improved model to obtain an improved model, wherein determining the semantic result information of the input vector in the initial improved model based on the hash search method comprises:
• obtaining, based on a fully connected layer, a transformation vector of the input vector in the initial improved model;
• and
• determining a target position corresponding to the transformation vector in a hash storage module storing semantic information according to the hash search method, and using semantic information stored in the target position as the semantic result information of the input vector.