Method, apparatus, device, and storage medium for training generative model

An electronic device, comprising:

• at least one processor;
• and
• at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform operations comprising:
• constructing a training prompt;
• and
• performing a plurality of rounds of iterative training based on the training prompt, wherein each round of iterative training comprises:
• obtaining a plurality of response contents generated by the generative model based on the training prompt;
• determining a first response content and a second response content from the plurality of response contents based on evaluation information of the plurality of response contents, wherein an evaluation of the first response content is superior to an evaluation of the second response content;
• and
• adjusting a parameter of the generative model to increase a first probability of outputting the first response content and reduce a second probability of outputting the second response content.

A non-transitory computer-readable storage medium having stored thereon a computer program executable by a processor to perform operations comprising:

• constructing a training prompt;
• and
• performing a plurality of rounds of iterative training based on the training prompt, wherein each round of iterative training comprises:
• obtaining a plurality of response contents generated by the generative model based on the training prompt;
• determining a first response content and a second response content from the plurality of response contents based on evaluation information of the plurality of response contents, wherein an evaluation of the first response content is superior to an evaluation of the second response content;
• and
• adjusting a parameter of the generative model to increase a first probability of outputting the first response content and reduce a second probability of outputting the second response content.