Image Recognition Based Content Item Selection

A computing system, the system comprising:

• one or more processors;
• and
• one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
• receiving, using a network, an image via an upload from a user device to a web album;
• processing the image with an image analysis module to determine one or more keywords associated with the image, wherein processing the image comprises:
• accessing an image database comprising a plurality of images;
• determining a matching image from the image database, wherein the matching image is determined based on determining an existing object within the image database matches a discernable object within the image captured by the camera, wherein the matching image comprises the existing object;
• determining, based on a setting established for the computing device that prevents keyword identification for images that comprise an excluded object, that keyword identification is authorized for the discernable object of the image;
• obtaining, from a search system, search history logs for image searches;
• identifying search queries that led to the matching image being served as a search result and resulted in the matching image being selected;
• and
• determining the one or more keywords based on the search queries, wherein determining the one or more keywords comprises:
• determining confidence weights for search terms of the search queries based on frequency of occurrence and whether an occurrence led to a selection of the matching image;
• determining one or more content items responsive to the image based at least in part on the one or more keywords, wherein the one or more content items comprise embedded information;
• determining, with a search system, search results responsive to the image;
• obtaining a plurality of thumbnail images corresponding to the search results;
• and
• providing the one or more content items and the thumbnail images to the computing device for display, wherein thumbnails associated with the search results are rendered separately from the one or more content items.

One or more non-transitory computer-readable media that collectively store instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform operations, the operations comprising:

• receiving, using a network, an image via an upload from a user device to a web album;
• processing the image with an image analysis module to determine one or more keywords associated with the image, wherein processing the image comprises:
• accessing an image database comprising a plurality of images;
• determining a matching image from the image database, wherein the matching image is determined based on determining an existing object within the image database matches a discernable object within the image captured by the camera, wherein the matching image comprises the existing object;
• determining, based on a setting established for the computing device that prevents keyword identification for images that comprise an excluded object, that keyword identification is authorized for the discernable object of the image;
• obtaining, from a search system, search history logs for image searches;
• identifying search queries that led to the matching image being served as a search result and resulted in the matching image being selected;
• and
• determining the one or more keywords based on the search queries, wherein determining the one or more keywords comprises:
• determining confidence weights for search terms of the search queries based on frequency of occurrence and whether an occurrence led to a selection of the matching image;
• determining one or more content items responsive to the image based at least in part on the one or more keywords, wherein the one or more content items comprise embedded information;
• determining, with a search system, search results responsive to the image;
• obtaining a plurality of thumbnail images corresponding to the search results;
• and
• providing the one or more content items and the thumbnail images to the computing device for display, wherein thumbnails associated with the search results are rendered separately from the one or more content items.