# US 2012/0084735 A1 · Gesture controls for multi-screen user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0084735 A1
- Document ID: US20120084735A1
- Status: Published application
- Kind: A1
- Application number: 12/948,667
- Filed: 2010-11-17
- Published: 2012-04-05
- Earliest claimed: 2010-10-01
- Assignees: Flextronics Id, LLC
- Inventors: Sanjiv Sirpal
- Web page: https://patentgrep.com/patent/US20120084735A1

## CPC

- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 1/1647: {including at least an additional display (G06F1/1692 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0412: {Digitisers structurally integrated in a display}
- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0486: Drag-and-drop
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06F 1/1616: {with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position}
- G06F 1/1641: {the display being formed by a plurality of foldable display components (G06F1/1647 takes precedence)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Method and apparatus for controlling a computing device using gesture inputs. The computing device may be a handheld computing device with multiple displays. The displays may be capable of displaying a graphical user interface (GUI). The GUI may be a multi screen GUI or a single screen GUI such that receipt of gesture inputs may result in the movement of a GUI from one display to another display or may result in maximization of a multi screen GUI across multiple displays.

## Claims

### Claim 1

A method for controlling a plurality of displays of a handheld computing device, comprising:
executing an application on said handheld computing device such that a screen of said application is displayed in a first display of the plurality of displays;
receiving a first gesture input at a gesture sensor of said handheld computing device;
modifying the plurality of displays in response to the first gesture input such that the screen is displayed in at least a second display of the plurality of displays.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the first gesture input is directional.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the second display is located in a direction with respect to the first display corresponding to the direction of the first gesture.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the screen occupies a single display and said modifying includes moving the screen from the first display to the second display.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the modifying includes revealing an underlying screen in the first display and obscuring another screen in the second display.

### Claim 6 (depends on 3)

The method according to claim 3, wherein the application is expandable to occupy multiple displays and the modifying includes expanding the application such that one or more screens corresponding to the application occupy both the first display and the second display.

### Claim 7 (depends on 6)

The method according to claim 6, wherein the expanding includes moving a node screen of the application to the second display while maintaining a parent screen of the application in the first display.

### Claim 8 (depends on 6)

The method according to claim 6, wherein the expanding includes scaling the application to occupy the first and second display.

### Claim 9 (depends on 6)

The method according to claim 6, wherein the expanding includes enlarging the viewable area of the application into the second display.

### Claim 10 (depends on 6)

The method according to claim 6, wherein the method further includes receiving a second gesture input different than the first gesture input at the gesture sensor and moving the screen from the first display to the second display in response to the second gesture input.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the modifying includes constrained movement of the screen linearly between the first display and the second display.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the handheld computing device is in operative communication with an external display, and the method further comprises relocating the screen from the first display to the external display.

### Claim 13 (depends on 11)

The method according to claim 11, wherein once the screen has been relocated to the external display, the screen is unconstrainably moveable about the external display.

### Claim 14 (depends on 1)

The method according to claim 1, wherein the gesture sensor is a touch sensitive device.

### Claim 15 (depends on 14)

The method according to claim 14, wherein the touch sensitive device is separate from and non overlapping with respect to the first display or the second display.

### Claim 16 (depends on 14)

The method according to claim 14, wherein the touch sensitive device is a touch screen display including at least one of the first or second displays.

### Claim 17

A method for controlling a plurality of displays of a handheld computing device, comprising:
executing an application on said handheld computing device such that one or more screens of said application is displayed in a first display and a second display of said handheld computing device;
receiving a gesture input at a gesture sensor of said handheld computing device;
modifying the plurality of displays in response to the gesture input such that the application is displayed in the first display of the handheld computing device and not in the second display.

### Claim 18 (depends on 17)

The method of claim 17, wherein the gesture display is directional and the first display corresponds to the direction of the gesture.

### Claim 19 (depends on 18)

The method according to claim 18, wherein said modifying includes hiding a node screen displayed in the second display prior to the modifying.

### Claim 20 (depends on 18)

The method according to claim 18, wherein said modifying includes scaling the one or more screens to the first display.

### Claim 21 (depends on 18)

The method according to claim 18, wherein said modifying includes reducing the visible area of the application.
