Systems and methods for modeling item similarity using converted image information

A system for correlating item data, the system comprising:

• at least one processor;
• and
• a non-transitory computer-readable medium containing a set of instructions that, when executed by the at least one processor, cause the processor to perform steps comprising:
• receiving text data associated with a reference item;
• receiving image data comprising at least one image associated with the reference item;
• converting, using a computer-modeled embedding layer, the at least one image to an image embedding;
• comparing the image embedding to reference embeddings, the stored reference embeddings being associated with candidate item images and candidate item text of candidate items;
• selecting, based on the comparison, candidate text data, wherein the candidate text data is a subset of the candidate item text and includes a price;
• selecting, based on the comparison, candidate image data, the candidate image data being a subset of the candidate item images;
• selecting a text correlation model;
• determining a first similarity score by applying the selected text correlation model to the received text data and the subset of the candidate item text;
• selecting an image correlation model;
• determining a second similarity score by applying the selected image correlation model to the received image data and the subset of the candidate item images;
• calculating a confidence score based on the determined first and second similarity scores;
• and
• performing a responsive action based on the calculated confidence score, wherein the responsive action comprises at least one of:
• creating an association between the reference item and one of the candidate items;
• monitoring a webpage associated with the reference item;
• updating at least one of the reference embeddings;
• modifying the selected text correlation model;
• or
• modifying the selected image correlation model.