Systems and methods for image object identification based on similarity analysis

A system for product identification and classification in an image, the system comprising:

• a data storage device storing instructions;
• and
• a processor configured to execute the instructions to perform a method including:
• receiving an image containing a plurality of objects, the image having been captured with an image sensor, at least one of the plurality of objects in the image being a product;
• inputting the received image to at least one model, the at least one model being configured to:
• identify a location of the product within the image,
• output the location of the product within the image as a crop image,
• generate a product classification for the product in the crop image, and
• generate a product embedding according to the product classification,
• outputting the product embedding to a search service configured to return product data associated with at least one similar product;
• receiving the product data returned by the search service;
• and
• generating one or more image tags based on the at least one similar product.

A non-transitory machine-readable medium storing instructions that, when executed by a computing system, causes the computing system to perform a method including:

• receiving an image containing a plurality of objects, the image having been captured with an image sensor, at least one of the plurality of objects in the image being a product;
• inputting the received image to at least one model, the at least one model being configured to:
• identify a location of the product within the image,
• output the location of the product within the image as a crop image,
• generate a product classification for the product in the crop image, and
• generate a product embedding according to the product classification,
• outputting the product embedding to a search service configured to return product data associated with at least one similar product;
• receiving the product data returned by the search service;
• and
• generating one or more image tags based on the at least one similar product.