# US 2010/0166339 A1 · System and method for enabling image recognition and searching of images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0166339 A1
- Document ID: US20100166339A1
- Status: Published application
- Kind: A1
- Application number: 12/648,245
- Filed: 2009-12-28
- Published: 2010-07-01
- Earliest claimed: 2005-05-09
- Inventors: Salih Burak Gokturk; Baris Sumengen; Diem Vu; Navneet Dalal; Danny Yang; Xiaofan Lin; Azhar Khan; Munjal Shah; Dragomir Anguelov; Lorenzo Torresani; Vincent Vanhoucke
- Web page: https://patentgrep.com/patent/US20100166339A1

## CPC

- G06F 16/5838: {using colour}
- G06F 16/5854: {using shape and object relationship}
- G06F 16/5862: {using texture}
- G06Q 30/08: Auctions
- G06V 10/40: Extraction of image or video features
- Y10S 707/915: Image
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

Embodiments programmatically analyze each of a plurality of images in order to determine one or more visual characteristics about an item shown in each of the plurality of images. Data is stored corresponding to the one or more visual characteristics. An interface in is provided for which a user is able to specify one or more search criteria. In response to receiving the one or more search criteria, a search operation is performed to identify one or more items that have a visual characteristic that satisfies at least some of the one or more search criteria.

## Claims

### Claim 1

A method for enabling searching of visual characteristics in images, the method comprising:
programmatically analyzing each of a plurality of images in order to determine one or more visual characteristics about an item shown in each of the plurality of images;
storing data corresponding to the one or more visual characteristics;
providing an interface in which a user is able to specify one or more search criteria; and
in response to receiving the one or more search criteria, performing a search operation to identify one or more items that have a visual characteristic that satisfies at least some of the one or more search criteria.

### Claim 2 (depends on 1)

The method of claim 1, further comprising displaying a search result to the user that includes the identified one or more items.

### Claim 3 (depends on 1)

The method of claim 1, wherein providing an interface in which a user is able to specify one or more search criteria includes enabling the user to provide a quantitative input as a search criterion.

### Claim 4 (depends on 3)

The method of claim 3, wherein enabling the user to provide a quantitative input includes enabling the user to provide the quantitative input that specifies a color of a desired item.

### Claim 5 (depends on 2)

The method of claim 2, wherein enabling the user to provide a quantitative input includes enabling the user to provide the quantitative input that specifies a color of a portion of an item.

### Claim 6 (depends on 5)

The method of claim 5, wherein providing an interface in which a user is able to specify one or more search criteria includes enabling the user to specify search criteria that includes a combination of the specified image and one or more features that are selected from a group of features consisting of a color, a shape and a pattern.

### Claim 7 (depends on 6)

The method of claim 6, wherein enabling the user to specify search criteria that includes a combination of the specified image and one or more features includes enabling the user to quantitatively specify one or more features from the group to be compared against a presence of the specified one or more features in the specified image.

### Claim 8 (depends on 2)

The method of claim 2, wherein providing an interface in which a user is able to specify one or more search criteria includes enabling the user to specify an image from a previous search result as a search criterion.

### Claim 9 (depends on 1)

The method of claim 1, wherein enabling the interface in which a user is able to specify one or more search criteria includes enabling the user to specify a search criterion for any one of a plurality of visual characteristics.

### Claim 10 (depends on 1)

The method of claim 1, wherein enabling the interface in which a user is able to specify one or more search criteria includes enabling a user to specify a color of the item.

### Claim 11 (depends on 1)

The method of claim 1, wherein enabling the interface in which a user is able to specify one or more search criteria includes enabling a user to specify a shape, a pattern, or a feature of the item.

### Claim 12 (depends on 1)

The method of claim 1, further comprising storing the information that is determined from programmatically analyzing each of the plurality of images as a quantitative value.

### Claim 13 (depends on 12)

The method of claim 12, wherein the quantitative value corresponds to one or more signatures that are descriptive or identifying of an individual item.

### Claim 14 (depends on 13)

The method of claim 13, further comprising indexing the one or more signatures for each of the plurality of images.

### Claim 15 (depends on 1)

The method of claim 1, wherein storing data corresponding to the one or more visual characteristics includes storing text terms that are descriptive of the one or more visual characteristics, the text terms being determined from programmatically analyzing the individual images.

### Claim 16 (depends on 1)

The method of claim 1, wherein programmatically analyzing each of the plurality of images in order to determine information about that item includes identifying a quantitative value from analyzing individual images in the plurality of images, and converting the quantitative value into one or more text terms that are descriptive of a global or local feature of the individual images.

### Claim 17 (depends on 1)

The method of claim 1, further comprising procuring at least some of the plurality of images by crawling one or more network sites.

### Claim 18 (depends on 1)

The method of claim 1, wherein performing a search operation to identify one or more items includes identifying a plurality of items that have the visual characteristic that satisfies a threshold defined by the one or more search criteria, and wherein the method further comprises presenting at least some of the plurality of items that satisfy the threshold to the user, wherein presenting the at least some of the plurality of items includes presenting one or more of the plurality of items in prominence based at least in part on a determination that the one or more of the plurality of items better satisfy the threshold than other items of the plurality of items.

### Claim 19 (depends on 18)

The method of claim 18, wherein providing an interface includes enabling the user to specify an image of an item as the search criteria, and wherein presenting the one or more of the plurality of items in prominence is based on the determination that the one or more of the plurality of items more resemble an appearance of the specific image of the search criteria.

### Claim 20 (depends on 19)

The method of claim 19, wherein the one or more search criteria corresponds to a signature that represents one or more features of the image of the item specified by the user as the search criteria, and wherein determining that the one or more of the plurality of items most resemble an appearance of the image includes comparing the one or more signatures of the item specified by the search criteria with the stored data corresponding to the one or more visual characteristics.
