# US 2012/0254790 A1 · Direct, feature-based and multi-touch dynamic search and manipulation of image sets

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254790 A1
- Document ID: US20120254790A1
- Status: Published application
- Kind: A1
- Application number: 13/076,548
- Filed: 2011-03-31
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: Xerox Corporation
- Inventors: Tommaso Colombino; Gabriela Csurka; Luca Marchesotti; Yves Hoppenot
- Web page: https://patentgrep.com/patent/US20120254790A1

## CPC

- G06F 16/532: Query formulation, e.g. graphical querying
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 16/54: Browsing; Visualisation therefor
- G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/5838: {using colour}
- G06F 16/587: using geographical or spatial information, e.g. location
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system and method for manipulating graphic objects on a tactile user interface are provided. The graphic objects can be photographic images which are retrieved in response to a query and are clustered, based on values of first and second user-selected features assigned to the graphic objects. A navigation map is displayed on the user interface. The navigation map represents the clusters of graphic objects in first and second dimensions, corresponding to the first and second features. A user can manipulate a target window displayed on the navigation map using the tactile user interface. The target window encompasses a subset of the clustered graphic objects. A synchronized display of graphic objects in the subset of graphic objects on the user interface corresponds to the subset of clustered graphic objects within the displayed target window.

## Claims

### Claim 1

A method for manipulation of a set of graphic objects, comprising:
with a computer processor, displaying a navigation map on a user interface, the navigation map representing a set of graphic objects;
providing for a user to manipulate a target window which is displayed on the navigation map, the window encompassing only a subset of the graphic objects; and
displaying graphic objects in the subset of graphic objects on the user interface in synchronization with the displayed target window.

### Claim 2 (depends on 1)

The method of claim 1, wherein the navigation map and graphic objects in the subset are displayed contemporaneously in respective areas of the user interface.

### Claim 3 (depends on 1)

The method of claim 1, wherein the graphic objects are arranged in an array.

### Claim 4 (depends on 1)

The method of claim 1, wherein the graphic objects comprise photographic images.

### Claim 5 (depends on 1)

The method of claim 1, wherein the navigation map comprises a two-dimensional array of clusters, each graphic object in the set being assigned to a respective one of the clusters.

### Claim 6 (depends on 1)

The method of claim 1, wherein the navigation map includes first and second feature dimensions, each of the graphic objects in the set being associated with a respective value for the first and second features.

### Claim 7 (depends on 6)

The method of claim 6, further comprising clustering graphic objects in the set of graphic objects based on respective values of the first and second features, the navigation map comprising an array of cluster objects, each cluster object in the array graphically representing a respective cluster.

### Claim 8 (depends on 7)

The method of claim 7, wherein the cluster objects have a property which represents a number of graphic objects in the respective cluster.

### Claim 9 (depends on 6)

The method of claim 6, wherein the first and second features are user selectable.

### Claim 10 (depends on 9)

The method of claim 9, further comprising displaying a feature selector on the user interface.

### Claim 11 (depends on 1)

The method of claim 1, wherein the providing for the user to manipulate a target window comprises displaying at least one controller and providing instructions in memory for recognizing a touch gesture on the controller as representing a movement of the window.

### Claim 12 (depends on 11)

The method of claim 11, wherein the displaying of at least one controller comprises displaying first and second controllers, a touch gesture on the first controller being recognized as a movement of the window in a first direction and a touch gesture on the second controller being recognized as a movement of the window in a second direction, orthogonal to the first direction.

### Claim 13 (depends on 1)

The method of claim 1, wherein the set of graphic objects are retrieved from a database in response to a query or by random selection.

### Claim 14 (depends on 13)

The method of claim 13, wherein the set of graphic objects are retrieved in response to a query, the method further comprising providing for generating a weighted query with the interface, the weighted query being generated by first and second query objects at relative distances from a query center, the distances representing respective weights of query elements in the query, the query elements being based on the query objects, at least one of the query objects being one of the displayed graphic objects.

### Claim 15 (depends on 1)

The method of claim 1, further comprising displaying metadata associated with one of the displayed graphic objects in response to a touch gesture on the graphic object.

### Claim 16 (depends on 1)

A computer program product comprising a tangible recording medium encoding instructions, which when executed by a computer, perform the method of claim 1.

### Claim 17 (depends on 1)

A system comprising memory which stores instructions for performing the method of claim 1 and a computer processor in communication with the memory for executing the instructions.

### Claim 18

A system for manipulation of graphic objects, comprising:
a user interface comprising a display device;
memory which stores instructions for:
displaying a navigation map on the display device, the navigation map representing a set of graphic objects;
interpreting signals representative of user touches on the display device as manipulation of a target window which is displayed on the navigation map, and moving the target window in response thereto, the window encompassing only a subset of the graphic objects; and
displaying graphic objects in the subset of graphic objects on the display device, the display of graphic objects changing in synchronization with the movement of the target window; and
a computer processor in communication with the memory for implementing the instructions.

### Claim 19 (depends on 18)

The system of claim 18, wherein the display device comprises a touch screen device and wherein the user manipulates the target window with touch gestures.

### Claim 20 (depends on 18)

The system of claim 18, wherein the navigation map visualizes clusters of graphic objects, the graphic objects being assigned to a respective cluster based on values of first and second features.

### Claim 21 (depends on 20)

The system of claim 20 wherein the memory includes instructions for computing values of at least one of the user selectable features for the set of graphic objects based on information extracted from the graphic objects.

### Claim 22

A method comprising:
retrieving a set of graphic objects;
clustering the graphic objects into clusters, based on values of first and second user-selected features assigned to the graphic objects;
displaying a navigation map on a user interface, the navigation map representing the clusters of graphic objects as an array of cluster objects arranged in first and second dimensions corresponding to the first and second features;
receiving signals representative of user manipulation of a target window which is displayed on the navigation map, the displayed target window encompassing only a subset of the cluster objects; and
displaying graphic objects in the subset of graphic objects on the user interface corresponding to the subset of cluster objects within the displayed target window.

### Claim 23 (depends on 22)

The method of claim 22, wherein at least one of the clustering, displaying of the navigation map, receiving of signals, and displaying of graphic objects is performed with a computer processor.
