# US 2018/0322208 A1 · System and method for searching for products in catalogs

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322208 A1
- Document ID: US20180322208A1
- Status: Published application
- Kind: A1
- Application number: 15/750,125
- Filed: 2015-08-03
- Published: 2018-11-08
- Earliest claimed: 2015-08-03
- Assignees: Orand S.A.
- Applicants: Orand S.A.
- Inventors: Juan Manuel BARRIOS NÚÑEZ; Mauricio Eduardo PALMA LIZANA; José Manuel SAAVEDRA RONDO
- Web page: https://patentgrep.com/patent/US20180322208A1

## CPC

- G06F 16/5854: {using shape and object relationship}
- G06F 16/248: Presentation of query results
- G06F 16/583: using metadata automatically derived from the content
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The present invention relates to a system for searching for products in catalogs and the associated method, which includes a device with a network connection that has an application allowing a user to generate a query, to send a query to a processing unit and show results, wherein a query is a visual example of a product for which a search is desired; a processing unit that receives queries from the user and resolves searches in the catalogue, that includes, (i) a visual features extraction component; (ii) a self-labeling component; (iii) a search component based on similarity; and (iv) a results-grouping component; and a data storage unit, that continually maintains information from catalog products from one or more stores.

## Claims

### Claim 1

A system for searching for products in catalogs, characterized in that it includes:
a. a device with a network connection that has an application allowing a user to generate a query, send a query to a processing unit, and display results, with a query being a visual example of a product for which a search is desired;
b. a processing unit that receives queries from the user and resolves searches in the catalog which includes:
i. a visual features extraction components;
ii. a self-labeling component;
iii. a search component based on similarity; and
iv. a results-grouping component
c. a data storage unit, that continually maintains information on products from catalogs from one or more stores.

### Claim 2 (depends on 1)

The system for searching for products in catalogs according to claim 1, characterized in that the visual example corresponds to one or more photographs, one or more hand-made drawings or a video.

### Claim 3 (depends on 1)

The system for searching for products in catalogs according to claim 1, characterized in that the query includes a visual example and also one or more words entered by the user.

### Claim 4 (depends on 1)

The system for searching for products in catalogs according to claim 1, characterized in that the self-labeling component is based on the training and use of a Neuronal Network.

### Claim 5 (depends on 1)

The system for searching for products in catalogs according to claim 1, characterized in that the self-labeling component uses a classifier.

### Claim 6 (depends on 5)

The system for searching for products in catalogs according to claim 5, characterized in that the classifier is included in: a Support Vector Machine (SVM), neuronal networks, K-nearest neighbors (KNN) and Random Forest.

### Claim 7

A method for searching for products in catalogs, characterized in that it includes the following steps:
a. user entry of a query into a device with a network connection via an installed application and delivery of the query to a processing unit;
b. receipt of the query by a processing unit to:
i. extract visual features of the query;
ii. perform a visual similarity search between a query and all the products stored in a data storage unit using visual features;
iii. automatically generate a set of labels for the query;
iv. perform a search based on similarity restricted to the subgroup of products that match the query by at least one label;
v. mix the results of searches ii and iv to generate the response to the query;
c. receipt of the query response by the device with a network connection and generation of the user display.

### Claim 8 (depends on 7)

The method for searching for products in catalogs according to claim 7, characterized in that the visual example corresponds to one or more photographs, one or more hand-made drawings, or a video.

### Claim 9 (depends on 7)

The method for searching for products in catalogs according to claim 7, characterized in that the query includes a visual example and also one or more words entered by the user.

### Claim 10 (depends on 9)

The method for searching for products in catalogs according to claim 9, characterized in that the search method based on similarity is restricted to the subset of products that match the query by at least one word.

### Claim 11 (depends on 7)

The method for searching for products in catalogs according to claim 7, characterized in that the method of extracting visual features of the query is based on local descriptor aggregation methods.

### Claim 12 (depends on 7)

The method for searching for products in catalogs according to claim 7, characterized in that the labeling generation phase is based on the training and use of a Neuronal Network.

### Claim 13 (depends on 7)

The method for searching for products in catalogs according to claim 7, characterized in that the label generation step uses a classifier.

### Claim 14 (depends on 13)

The method for searching for products in catalogs according to claim 13, characterized in that the classifier is included among: a Support Vector Machine (SVM), neuronal networks, K-nearest neighbors (KNN) and Random Forest.
