Method and device for cross-modal information retrieval, and storage medium

A device for cross-modal information retrieval, comprising a processor and memory,

• wherein the memory is adapted to storing an instruction executable by the processor,
• wherein the processor is adapted to executing the executable instruction stored in the memory to implement:
• acquiring first modal information and second modal information;
• determining a first semantic feature of the first modal information and a first attention feature of the first modal information according to a modal feature of the first modal information;
• determining a second semantic feature of the second modal information and a second attention feature of the second modal information according to a modal feature of the second modal information;
• and
• determining a similarity between the first modal information and the second modal information based on the first attention feature, the second attention feature, the first semantic feature, and the second semantic feature.

A non-transitory computer-readable storage medium, having stored therein computer program instructions which, when executed by a processor, implement:

• acquiring first modal information and second modal information;
• determining a first semantic feature of the first modal information and a first attention feature of the first modal information according to a modal feature of the first modal information;
• determining a second semantic feature of the second modal information and a second attention feature of the second modal information according to a modal feature of the second modal information;
• and
• determining a similarity between the first modal information and the second modal information based on the first attention feature, the second attention feature, the first semantic feature, and the second semantic feature.