# US 2016/0239898 A1 · System and method to retrieve relevant inventory using sketch-based query

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0239898 A1
- Document ID: US20160239898A1
- Status: Published application
- Kind: A1
- Application number: 15/136,826
- Filed: 2016-04-22
- Published: 2016-08-18
- Earliest claimed: 2013-03-14
- Assignees: eBay Inc.
- Applicants: eBay Inc.
- Inventors: ANURAG BHARDWAJ; WEI DI; ROBINSON PIRAMUTHU; NEELAKANTAN SUNDARESAN
- Web page: https://patentgrep.com/patent/US20160239898A1

## CPC

- G06Q 30/0625: {by formulating product or service queries, e.g. using keywords or predefined options}
- G06F 16/532: Query formulation, e.g. graphical querying
- G06F 16/583: using metadata automatically derived from the content
- G06F 18/24: Classification techniques
- G06Q 30/0627: {by specifying product or service characteristics, e.g. product dimensions}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In various example embodiments, a system and method for sketch based queries are presented. A sketch of a search item is received from a user device. An item attribute corresponding to a physical attribute of the search item is extracted from the sketch. Inventory items are identified based on the extracted item attribute. The identified inventory items are presented to the user. A modification to the sketch of the search item is received and the inventory items are updated based on the received modification.

## Claims

### Claim 1

A method comprising:
receiving a sketch of a search item, the sketch being received from a user device;
extracting an item attribute from the sketch, the item attribute corresponding to a physical attribute of the search item;
identifying inventory items based on the extracted item attribute;
causing display of the identified inventory items in a user interface of the user device;
receiving a modification to the sketch of the search item;
updating, using one or more processors, the inventory items based on the received the modification to the sketch; and
causing display of the updated inventory items in the user interface of the user device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the receiving the sketch includes receiving an annotation of an existing image on the user device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the receiving the sketch includes receiving an annotation of an image that is captured using a camera on the user device.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining similarity levels between the sketch and each of the identified inventory items;
sorting the inventory items based on the determined similarity levels; and
causing display of the sorted inventory items in the user interface.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
retrieving, from a database, images of the inventory items; and
extracting one or more image attributes from the retrieved images; and wherein the identifying includes comparing the extracted item attribute with the one or more extracted image attributes.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining suggested attributes based on item attributes of the search item; and
providing the suggested attributes to the user device including causing display of the suggested attributes on the user device.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
determining a user preference based on a purchase history stored in a user profile; and
wherein the determining the suggested attributes is further based on the determined user preference.

### Claim 8 (depends on 6)

The method of claim 6, further comprising:
receiving a user selected attribute from the user device, the user selected attribute being from the suggested attributes provided to the user device; and
updating the inventory items based on the received user selected attribute.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
determining an item category based on the received sketch; and
presenting the determined item category; and wherein the identifying is further based on the determined item category.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
the extracted item attribute is mapped to a description of the item attribute; and
the identifying the inventory items is based on the description of the item attribute.

### Claim 11 (depends on 1)

The method of claim 1, further comprising mapping the extracted item attribute to inventory features of the inventory items; and wherein the identifying the inventory items is based on the mapping.

### Claim 12

A system comprising:
one or more processors and executable instructions accessible on a computer-readable medium that, when executed, configure the one or more processors to at least:
receive a sketch of a search item, the sketch being received from a user device;
extract an item attribute from the sketch, the item attribute corresponding to a physical attribute of the search item;
identify inventory items based on the extracted item attribute;
cause display of the identified inventory items in a user interface of the user device;
receive a modification to the sketch of the search item;
update the inventory items based on the received the modification to the sketch; and
cause display of the updated inventory items in the user interface of the user device.

### Claim 13 (depends on 12)

The system of claim 12, wherein the one or more processors are further configured to receive an annotation of an existing image on the user device.

### Claim 14 (depends on 12)

The system of claim 12, wherein the one or more processors are further configured to receive an annotation of an image that is captured using a camera on the user device.

### Claim 15 (depends on 12)

The system of claim 12, wherein the one or more processors are further configured to:
determine similarity levels between the sketch and each of the identified inventory items;
sort the inventory items based on the determined similarity levels; and
cause display of the sorted inventory items in the user interface.

### Claim 16 (depends on 12)

The system of claim 12, wherein the one or more processors are further configured to:
retrieve, from a database, images of the inventory items;
extract one or more image attributes from the retrieved images; and
compare the extracted item attribute with the one or more extracted image attributes.

### Claim 17 (depends on 12)

The system of claim 12, wherein the one or more processors are further configured to:
determine suggested attributes based on item attributes of the search item; and
cause display of the suggested attributes on the user device.

### Claim 18 (depends on 12)

The system of claim 12, wherein the one or more processors are further configured to:
determine a user preference based on a purchase history stored in a user profile; and
determine the suggested attributes further based on the determined user preference.

### Claim 19 (depends on 12)

The system of claim 12, wherein the one or more processors are further configured to:
receive a user selected attribute from the user device, the user selected attribute being from the suggested attributes provided to the user device; and
update the inventory items based on the received user selected attribute.

### Claim 20

A non-transitory computer readable medium storing instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
receiving a sketch of a search item, the sketch being received from a user device;
extracting an item attribute from the sketch, the item attribute corresponding to a physical attribute of the search item;
identifying inventory items based on the extracted item attribute;
causing display of the identified inventory items in a user interface of the user device;
receiving a modification to the sketch of the search item;
updating the inventory items based on the received the modification to the sketch; and
causing display of the updated inventory items in the user interface of the user device.
