Method, medium, and system for intelligent online personal assistant with image text localization

A non-transitory computer-readable storage medium having embedded therein a set of instructions which, when executed by one or more processors of a computer, causes the computer to execute operations comprising:

• localizing and isolating a candidate portion of a candidate product image with candidate visual text content;
• retraining a neural network using the candidate portion of the candidate product image;
• localizing and isolating, via the retrained neural network, an input query portion of an input query image with input query visual text content;
• calculating a visual similarity measure between the respective portions of the candidate product image and the input query image based on a distance value between image signatures associated with the candidate product image and the input query image;
• ranking a candidate product in a product list based on the visual similarity measure;
• and
• causing presentation of the product list on a graphical user interface of a client device.

A system comprising:

• at least one processor;
• and
• memory encoding computer-executable instructions that, when executed by the at least one processor, cause the system to perform operations comprising:
• localizing and isolating a candidate portion of a candidate product image with candidate visual text content;
• retraining a neural network using the candidate portion of the candidate product image;
• localizing and isolating, via the retrained neural network, an input query portion of an input query image with input query visual text content;
• calculating a visual similarity measure between the candidate portion and the input query portion based on a distance value between image signatures associated with the candidate product image and the input query image;
• ranking a candidate product in a product list based on the visual similarity measure;
• and
• causing presentation of the product list on a graphical user interface of a client device.