# US 2014/0152847 A1 · Product comparisons from in-store image and video captures

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0152847 A1
- Document ID: US20140152847A1
- Status: Published application
- Kind: A1
- Application number: 13/692,994
- Filed: 2012-12-03
- Published: 2014-06-05
- Earliest claimed: 2012-12-03
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Asaf Zomet; Michael Shynar; Dvir Keysar; Gal Chechik
- Web page: https://patentgrep.com/patent/US20140152847A1

## CPC

- G06Q 30/0629: {by pre-processing results, e.g. ranking or ordering results}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Systems and methods are described herein for comparing products in a marketplace. An image or video of the products may be captured using a camera associated with a mobile device. User input may be received to select two or more products within the image. Machine vision techniques may be applied to specifically identify the selected products. Product features associated with each of the identified products may be retrieved and formatted into a comparison of product features. The comparison may be presented to the user.

## Claims

### Claim 1

A computer-implemented method for comparing products in a marketplace, comprising:
capturing, using one or more computing devices, an image or video;
identifying, using the one or more computing devices, two or more products within the image or video;
retrieving, using the one or more computing devices, at least one product feature associated with each of the two or more products;
forming, using the one or more computing devices, a comparison of the retrieved at least one product feature associated with each of the two or more products; and
presenting, using the one or more computing devices, the comparison.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein identifying the two or more products within the image or video comprises receiving, using the one or more computing devices, a selection input into the user computing device specifying one or more regions within the image or video with which the two or more products are associated.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein identifying the two or more products within the image or video comprises extracting visual features from the image or video.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein identifying the two or more products within the image or video comprises identifying text or barcode information within the image or video.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein identifying the two or more products within the image or video comprises classifying visual features within the image or video into a category and identifying products of the classified category.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein retrieving product features associated with each of the two or more products comprises identifying a category associated with the two or more products and retrieving product features relevant to the category.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein forming a comparison of product features comprises formatting product features into a comparison table.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein forming a comparison of product features comprises identifying and ranking product features most relevant to users.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein forming a comparison of product features comprises removing non-differentiating features.

### Claim 10

A mobile system for comparing products in a market place, the system comprising:
one or more computing processors;
an electronic camera;
an electronic display; and
one or more modules operable in combination with the one or more processors to:
capture an image using the camera;
apply machine vision techniques to identify a plurality of products within the image;
retrieve features of the identified products; and
present a comparison of the features on the display.

### Claim 11 (depends on 10)

The mobile system of claim 10, wherein the one or more modules are further operable, in combination with the one or more processors, to receive input from a user indicating a selection of products within the image to be compared.

### Claim 12 (depends on 10)

The mobile system of claim 10, wherein applying machine vision techniques and retrieving features of the identified products are performed using one or more computing devices in data communication with the mobile system.

### Claim 13 (depends on 10)

The mobile system of claim 10, wherein the machine vision techniques comprise scale-invariant feature transformations.

### Claim 14 (depends on 10)

The mobile system of claim 10, wherein the camera is a video camera, and wherein the captured image is a video.

### Claim 15

A computer program product, comprising:
a non-transitory computer-readable medium having computer-readable program code embodied therein for comparing products in a market place that when executed by one or more computing devices cause the one or more computing devices to perform operations comprising:
receiving an electronic image taken by a camera;
receiving input from a user selecting two or more products within the image;
applying machine vision techniques to specifically identify the selected two or more products;
retrieving product features associated with each of the identified products;
forming a comparison of the retrieved product features; and
presenting the comparison to the user.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein applying machine vision techniques comprises extracting visual features from the image;

### Claim 17 (depends on 15)

The computer program product of claim 15, wherein applying machine vision techniques comprises extracting text or coded information from the image.

### Claim 18 (depends on 15)

The computer program product of claim 15, wherein retrieving product features comprises identifying a category associated with the identified products.

### Claim 19 (depends on 15)

The computer program product of claim 15, wherein forming a comparison of the retrieved product features comprises formatting the retrieved product features into a comparison table.

### Claim 20 (depends on 15)

The computer program product of claim 15, wherein forming a comparison of the retrieved product features comprises identifying product features most relevant to users.

### Claim 21 (depends on 15)

The computer program product of claim 15, wherein forming a comparison of the retrieved product features comprises removing non-differentiating features.

### Claim 22 (depends on 15)

The computer program product of claim 15, wherein the image is a video.
