US 10,379,721 B1Granted

Interactive interfaces for generating annotation information

AssigneeA9.com, Inc.

InventorsAishwarya Natesh, Daniya Zamalieva

Life of this patent

Estimating the term…

Loading patent…

Abstract

Approaches provide for an interactive interface for determining annotation information that can be used to recommend content, improve user interaction and satisfaction, as well as improve various image recognition approaches. For example, a user can be presented an interactive interface, such as a game. The interactive interface can include colored graphical elements, where each graphical element can be associated with and display a visual feature of an item. A user can be provided a task or goal, such as to select, move, or otherwise arrange graphical elements based on a visual feature of the elements. The user interaction can generate annotation information that can be utilized to determine related content as well as improve various image recognition approaches.

Claims20

Dependent claims

A computing device comprising:

at least one processor;
a camera;
and
memory storing instructions that, when executed by the at least one processor, cause the computing device to perform operations, comprising:
obtain image data that includes a representation of an object using the camera;
analyze the image data to attempt to recognize the object;
determine an image recognition confidence score below a threshold confidence score, the image recognition confidence score indicating a likelihood of recognizing the object;
segment the image data into a plurality of regions;
analyze the plurality of regions to determine a color descriptor for each of the plurality of regions, the color descriptor for each of the plurality of regions describing a color represented in image data for a respective region;
compare respective color descriptors against a stored set of color descriptors to determine a plurality of visual similarity scores, each of the stored set of color descriptors associated with a patch of a product that is associated with color information;
determine a set of patches based at least in part on the plurality of visual similarity scores;
generate an interface that includes a plurality of graphical elements, each graphical element associated with a patch of the set of patches and displaying a color of its associated patch;
receive a user selection of adjacent graphical elements;
and
generate color annotation information based at least in part on the adjacent graphical elements.

12 more elements

A computing system, comprising:

at least one processor;
and
memory including instructions that, when executed by the at least one processor, cause the computing system to:
obtain image data that includes a representation of an object;
determine a visual descriptor for an image region of the image data;
associate the visual descriptor with a patch of color of a plurality of patches of color based at least in part on a similarity between the visual descriptor and the patch of color, each of the patches of color associated with an area of a product of an electronic catalog of products;
generate an interface that includes a plurality of graphical elements, each element of the plurality of graphical elements associated with one of the plurality of patches of color and displaying a color of its associated patch of color;
and
in response to receiving a selection of adjacent graphical elements, generate annotation information.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/362,600Filed 28 Nov 2016
Granted: 13 Aug 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification9 codes

G06F 3/04845
For the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a…:…
G06F 3/0482
Based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like…:…
G06Q 30/0641
Electronic shopping [e-shopping]: utilising user interfaces specially adapted for shopping
G06T 7/11
Segmentation; Edge detection: region-based segmentation