Method, device, computer equipment and storage medium for identifying illegal commodity

A method for identifying an illegal commodity for monitoring e-commerce platforms, comprising:

• step (1) constructing a multi-modal knowledge graph based on a multi-modal knowledge graph data set, and extracting visual features of all visual modality entities and text features of a text modality entities in the multi-modal knowledge graph;
• step (2) acquiring commodity information based on a database, wherein the commodity information comprises a commodity image and a commodity text, and the commodity text comprises at least one of a commodity title and a commodity description;
• step (3) generating a commodity visual feature based on the commodity image;
• step (4) generating a commodity text feature based on the commodity text;
• step (5) linking the commodity image and the commodity text to the multi-modal knowledge graph constructed in the step (1) using an entity linking method, based on the visual features and the text features extracted in the step (1) as well as the commodity visual feature generated in the step (3) and the commodity text feature generated in the step (4);
• and
• step (6) acquiring a correlation between the commodity image and the commodity text based on the linked multi-modal knowledge graph obtained in the step (5) to determine illegality of a commodity by a discriminator.