US 7,660,468 B2Granted

System and method for enabling image searching using manual enrichment, classification, and/or segmentation

AssigneeLike.com

InventorsSalih Burak Gokturk, Baris Sumengen, Diem Vu, Navneet Dalal, Danny Yang, Xiaofan Lin, Azhar Khan, Munjal Shah, Dragomir Anguelov, Lorenzo Torresani, Vincent Vanhoucke

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

Embodiments described herein provide for a system for creating a data collection of recognized images. The system includes an image analysis module that is configured to programmatically analyze individual images in a collection of images in order to determine information about each image in the collection. The system may also include a manual interface that is configured to (i) interface with one or more human editors, and (ii) displays a plurality of panels concurrently. Individual panels may be provided for one or more analyzed images, and individual panels may be configured to display information that is at least indicative of the one or more images of that panel and/or of the information determined from the one or more images. Additionally, the manual interface enables the one or more human editors to view the plurality of panels concurrently and to interact with each of the plurality of panels in order to correct or remove any information that is incorrectly determined from the image of that panel.

Claims18

Dependent claims

A method for processing images, the method comprising:

using one or more processors to perform steps comprising:
analyzing an image provided at a third-party website in connection with displaying concurrently one or more other images at the third-party website that satisfy a search criterion generated from analyzing the image, wherein analyzing the image includes:
programmatically analyzing the image to determine one or more visual characteristics of at least one object in the image;
generate a search criterion based at least in part on the one or more visual characteristics of the at least one object;
performing a search of a data store using the search criterion in order to obtain a search result that includes one or more images of merchandise objects that satisfy the search criterion;
and
presenting the one or more images of merchandise objects with the analyzed image at the third-party website;
wherein programmatically analyzing the image further comprises determining one or more categories of the at least one object of the analyzed image based at least in part on (i) text and/or metadata associated with the image;
and (ii) a reference record assigned to each of the one or more categories that identifies words or phrases and their respective weights for use in determining that the one or more categories are relevant to the analyzed image;
wherein performing the search further comprises identifying at least one image of a merchandise object that (i) is deemed similar to the at least one object of the analyzed image, but (ii) is in a different category than the at least one object of the analyzed image.

7 more elements

A system for processing images for analysis and search, the system comprising:

a component to procure one or more images from a third-party website;
an image analysis subsystem that is configured to:
programmatically analyze at least one of the procured images to determine one or more visual characteristics of at least one object in the image;
determine one or more categories of the at least one object of the analyzed image based at least in part on (i) text and/or metadata associated with the image;
and (ii) a reference record assigned to each of the one or more categories that identifies words or phrases and their respective weights for use in determining that the one or more categories are relevant to the analyzed image;
generate one or more search criteria from the one or more visual characteristics of the at least one object;
search the data store using the one or more search criteria to identify one or more images of merchandise objects that satisfy the one or more search criteria, including identifying at least one image of a merchandise object that (i) is deemed similar to the at least one object of the analyzed image, but (ii) is in a different category than the at least one object;
a presentation module configured to present the identified one or more images of merchandise objects with the analyzed image of the at least one object, including to present the image of the merchandise object that is of the different category than the at least one object of the analyzed image.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 11/936,713Filed 7 Nov 2007 · continuation in part
Priority: 9 May 2005
Published: US 2008/0082426 A119 Jun 2008
Granted: 9 Feb 2010
Term ends: Not estimatedThe source records don’t support an estimate.

Classification12 codes

G06V 10/945
Hardware or software architectures specially adapted for image or video understanding: user interactive design; Environments; Toolboxes
G06F 16/51
Of still image data: indexing; Data structures therefor; Storage structures
G06F 16/58
Of still image data: retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
G06F 16/5838
Using metadata automatically derived from the content: using colour

Family

Application60/679,591Us provisional application · filed 9 May 2005
Application11/246,742Parent of this continuation-in-part · filed 7 Oct 2005
Application60/864,781Us provisional application · filed 7 Nov 2006
Application60/909,414Us provisional application · filed 30 Mar 2007
Application11/777,894Parent of this continuation-in-part · filed 13 Jul 2007
US 2008/0144943 A1Pre-grant publication · published 19 Jun 2008
US 2006/0251339 A1Published application
US 2008/0082426 A1Published application
US 7,519,200 B2Related patent
US 8,732,025 B2Related patent
US 7,660,468 B2This patent

From the US filing history. Foreign family members aren’t listed.