Audio generation

An electronic device, comprising:

• at least one processor;
• and
• at least one memory coupled to the at least one processor, the at least one memory storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform acts comprising:
• processing video content with a video encoder to determine a video feature;
• and
• processing the video feature with a generation model to generate a target audio, wherein the video encoder is trained based on following processes:
• obtaining a sample video and a sample audio;
• determining a first feature representation of the sample video with the video encoder, and determining a second feature representation of the sample audio with an audio encoder;
• determining a training loss based on the first feature representation, the second feature representation, and reference information, the reference information indicating whether the sample video and the sample audio correspond to a same media file;
• and
• training the video encoder based on the training loss.

A non-transitory computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement acts comprising:

• processing video content with a video encoder to determine a video feature;
• and
• processing the video feature with a generation model to generate a target audio, wherein the video encoder is trained based on following processes:
• obtaining a sample video and a sample audio;
• determining a first feature representation of the sample video with the video encoder, and determining a second feature representation of the sample audio with an audio encoder;
• determining a training loss based on the first feature representation, the second feature representation, and reference information, the reference information indicating whether the sample video and the sample audio correspond to a same media file;
• and
• training the video encoder based on the training loss.