# US 2013/0093792 A1 · Organizational Tools on a Multi-touch Display Device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0093792 A1
- Document ID: US20130093792A1
- Status: Published application
- Kind: A1
- Application number: 13/404,718
- Filed: 2012-02-24
- Published: 2013-04-18
- Earliest claimed: 2009-05-21
- Assignees: Perceptive Pixel Inc.
- Inventors: Philip L. Davidson
- Web page: https://patentgrep.com/patent/US20130093792A1

## CPC

- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A process for enabling objects displayed on a multi-input display device to be grouped together is disclosed that includes defining a target element that enables objects displayed on a multi-input display device to be grouped together through interaction with the target element. Operations are invoked that establish a relationship between a particular displayed object and a position on the target element and that causes transformations applied to the target element also to be applied to the particular displayed object while maintaining the relationship between the particular displayed object and the position on the target element.

## Claims

### Claim 1

A computer-implemented method for adjusting orientations of grouped objects displayed on a multi-input display device, the method comprising:
defining a target element that enables objects displayed on a multi-input display device to be grouped together through interaction with the target element;
defining a target element reference axis for the target element;
visually displaying, on the multi-input display device, at least a portion of the target element;
visually displaying, on the multi-input display device, at least one object as at least partially overlapping the target element, the displayed object having a displayed object reference axis and being displayed such that the displayed object reference axis is oriented arbitrarily relative to the target element reference axis;
invoking a process that establishes a relationship between the displayed object and a corresponding position on the target element that is overlapped by the displayed object that causes the relationship between the displayed object and the corresponding position on the target element to be maintained when transformations are applied to the target element such that transformations applied to the target element also are applied to the displayed object;
detecting that an input mechanism has engaged the target element;
in response to detecting that the target element has been engaged by the input mechanism, monitoring movement of the input mechanism while the input mechanism remains engaged with the target element;
applying a transformation to the target element as a function of the monitored movement of the input mechanism;
applying a corresponding transformation to the displayed object as a consequence of applying the transformation to the target element and the established relationship between the displayed object and the corresponding position on the target element;
after applying the transformations to the target element and the displayed object, detecting a new interaction with the multi-input display device by an input mechanism; and
in response to detecting the new interaction with the multi-input display device by the input mechanism, determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element;
in response to determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element:
identifying a current orientation of the target element reference axis,
identifying a current orientation of the displayed object element reference axis,
comparing the current orientation of the target element reference axis to the current orientation of the displayed object element reference axis,
based on results of comparing the current orientation of the target element reference axis to the current orientation of the displayed object element reference axis, adjusting the orientation of the displayed object element reference axis to be aligned with the target element reference axis, and
as a consequence of adjusting the orientation of the displayed object element reference axis:
terminating the relationship between the displayed object and the corresponding position on the target element, and
invoking a new process that establishes a new relationship between the displayed object and a new position on the target element that is overlapped by the displayed object that causes the new relationship between the displayed object and the new position on the target element to be maintained when transformations are applied to the target element such that transformations applied to the target element also are applied to the displayed object.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
defining a target element that enables objects displayed on a multi-input display device to be grouped together through interaction with the target element includes defining a circular target element that enables objects displayed on a multi-input display device to be grouped together through interaction with the circular target element;
defining the target element reference axis for the target element includes defining a radius of the circular target element as the target element reference axis for the target element; and
adjusting the orientation of the displayed object element reference axis to be aligned with the target element reference axis includes adjusting the orientation of the displayed object element reference axis to be aligned with the radius of the circular target element.

### Claim 3 (depends on 1)

The method of claim 1, wherein defining the target element reference axis for the target element includes:
receiving a user-supplied input to the multi-input display device defining a target element reference axis for the target element; and
defining the target element reference axis for the target element to be the target element reference axis defined by the user-supplied input.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
the defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element includes engaging a particular button displayed on the multi-input display device with an input mechanism;
detecting the new interaction with the multi-input display device by the input mechanism includes detecting that the input mechanism has engaged the particular button displayed on the multi-input display device; and
determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element includes determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element as a consequence of having detected that the input mechanism engaged the particular button displayed on the multi-input display device.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
the defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element includes a plurality of consecutive engagements with the target element by an input mechanism within a predefined period of time;
detecting the new interaction with the multi-input display device by the input mechanism includes detecting that the input mechanism has engaged the target element with a plurality of consecutive engagements within the predefined period of time; and
determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element includes determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element as a consequence of having detected that the input mechanism engaged the target element with the plurality of consecutive engagements within the predefined period of time.

### Claim 6 (depends on 1)

The method of claim 1, further comprising defining a grid having multiple cells within the target element, the grid having a grid reference axis that is aligned with the target element reference axis, wherein:
visually displaying the displayed object includes visually displaying the displayed object such that the displayed object is located within a cell within the grid and the displayed object reference axis is oriented arbitrarily relative to the grid reference axis; and
adjusting the orientation of the displayed object element reference axis to be aligned with the target element reference axis includes adjusting the orientation of the displayed object within the cell within the grid to be aligned with the target element reference axis and the grid reference axis.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
establishing a grid having multiple cells within the target element;
in response to determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element:
comparing the location of the displayed object to locations of one or more cells of the grid; and
based on results of comparing the location of the displayed object to locations of one or more cells of the grid, determining that a portion of the displayed object is in a cell and another portion of the displayed object is not in the cell, wherein adjusting the orientation of the displayed object element axis includes transforming the displayed object to be located entirely within a particular cell within the grid.

### Claim 8 (depends on 7)

The method of claim 7, wherein transforming the displayed object to be located entirely within a particular cell within the grid includes resizing the displayed object to be located entirely within the particular cell.

### Claim 9 (depends on 7)

The method of claim 7, wherein transforming the displayed object to be located entirely within a particular cell within the grid includes adjusting the orientation of the displayed object reference axis to be aligned with the grid reference axis.

### Claim 10 (depends on 7)

The method of claim 7, wherein:
defining the target element includes defining a circular target element; and
establishing a grid within the target element includes dividing the circular target element into a plurality of sectors.

### Claim 11 (depends on 7)

The method of claim 7, wherein:
defining the target element includes defining a polygonal target element, and
establishing a grid within the target element includes dividing the polygonal target element into a plurality of polygons.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
after adjusting the orientation of the displayed object element reference axis to be aligned with the target element reference axis and invoking a new process that establishes a new relationship between the displayed object and a new position on the target element that is overlapped by the displayed object that causes the new relationship between the displayed object and the new position on the target element to be maintained when transformations are applied to the target element, detecting that an input mechanism has engaged the target element;
in response to detecting that the target element has been engaged by the input mechanism, monitoring movement of the input mechanism while the input mechanism remains engaged with the target element;
applying a rotational transformation to the target element as a function of the monitored movement of the input mechanism such that the target element reference axis has a new orientation; and
applying a corresponding rotational transformation to the displayed object as a consequence of applying the rotational transformation to the target element and the established relationship between the displayed object and the corresponding position on the target element such that the displayed object reference axis has a new orientation and the new orientation of the displayed object reference axis remains aligned with the target element reference axis.

### Claim 13 (depends on 1)

The method of claim 1, wherein:
defining the target element includes establishing a grid having multiple cells within the target element, and visually displaying, on the multi-input display device, the displayed object as at least partially overlapping the target element includes visually displaying, on the multi-input display device, the displayed object as at least partially occupying a particular cell within the grid, the method further comprising:
visually displaying, on the multi-input display device, another object as at least partially overlapping the target element and at least partially occupying the particular cell within the grid;
invoking a process that establishes a relationship between the other displayed object and a corresponding position on the target element that is overlapped by the other displayed object that causes the relationship between the other displayed object and the corresponding position on the target element to be maintained when transformations are applied to the target element such that transformations applied to the target element also are applied to the other displayed object; and
in response to determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element:
comparing the location of the displayed object to the location of the other displayed object,
based on results of comparing the location of the displayed object to the location of the other displayed object, determining that both the displayed object and the other displayed object at least partially occupy the particular cell within the grid, and
as a consequence of determining that both the displayed object and the other displayed object at least partially occupy the particular cell within the gird, translating the displayed object such that the displayed object at least partially occupies a different cell within the grid and no longer occupies the particular cell within the grid.

### Claim 14 (depends on 1)

The method of claim 1, further comprising, in response to determining that the new interaction with the multi-input display device corresponds to a defined interaction for instructing the multi-input display device to adjust orientations of displayed objects for which relationships have been established with corresponding positions on the target element:
determining that a portion of the displayed object overlaps another displayed object; and
as a consequence of determining that the portion of the displayed object overlaps another displayed object, transforming the displayed object such that it no longer overlaps the other displayed object.
