System and method for enabling image recognition and searching of remote content on display

A computer system comprising:

• a memory that stores a set of instructions;
• one or more processors that are coupled to the memory and use the set of instructions to:
• analyze content, the content including image content and text content, wherein the image content includes an image, and wherein analyzing the content includes analyzing the text content to determine one or more assumptions about a location or shape of an object of interest in the image;
• determine a classification of the object of interest, wherein determining the classification of the object of interest is based at least in part on the text content;
• perform image analysis on the image based at least in part on the classification and the one or more assumptions to detect the object of interest in the image;
• determine information about the object of interest, based on the image analysis, using one or more sources other than the analyzed content;
• provide instructions with the image in order to make the object of interest selectable apart from a remainder of the image;
• and
• associate the information with the image so that at least some of the information is displayed when the object of interest is selected.

A non-transitory computer-readable medium that stores a set of instructions, the set of instructions being executable by one or more processors to cause the one or more processors to perform operations that include:

• analyze content, the content including image content and text content, wherein the image content includes an image, and wherein analyzing the content includes analyzing the text content to determine one or more assumptions about a location or shape of an object of interest in the image;
• determine a classification of the object of interest, wherein determining the classification of the object of interest is based at least in part on the text content;
• perform image analysis on the image based at least in part on the classification and the one or more assumptions to detect the object of interest in the image;
• determine information about the object of interest, based on the image analysis,
• using one or more sources other than the analyzed content;
• provide instructions with the image in order to make the object of interest selectable apart from a remainder of the image;
• and
• associate the information with the image so that at least some of the information is displayed when the object of interest is selected.