Method for generating speech translation model, translation method, and apparatus

An electronic device, comprising:

• a processor;
• and
• a memory coupled with the processor, wherein the memory has instructions stored therein which, when executed by the processor, cause the electronic device to:
• extract, by the semantic feature extractor, a source semantic unit sequence of source language audio and a target semantic unit sequence of target language audio, wherein the source language audio corresponds to the target language audio;
• adjust a first decoder of the plurality of decoders based on the source semantic unit sequence and the target semantic unit sequence;
• and
• adjust a second decoder of the plurality of decoders based on the source semantic unit sequence, the target semantic unit sequence, a source acoustic unit sequence of the source language audio, and a target acoustic unit sequence of the target language audio, wherein the semantic feature extractor remains unchanged during the adjustment of the first decoder and the second decoder.

A non-transitory computer-readable storage medium, having computer-executable instructions stored therein which, when executed by a processor, cause the processor to:

• extract, by the semantic feature extractor, a source semantic unit sequence of source language audio and a target semantic unit sequence of target language audio, wherein the source language audio corresponds to the target language audio;
• adjust a first decoder of the plurality of decoders based on the source semantic unit sequence and the target semantic unit sequence;
• and
• adjust a second decoder of the plurality of decoders based on the source semantic unit sequence, the target semantic unit sequence, a source acoustic unit sequence of the source language audio, and a target acoustic unit sequence of the target language audio, wherein the semantic feature extractor remains unchanged during the adjustment of the first decoder and the second decoder.