# US 10,768,804 B2 · Gesture language for a device with multiple touch surfaces > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,768,804 B2 - Document ID: US10768804B2 - Status: Granted - Kind: B2 - Application number: 15/257,179 - Filed: 2016-09-06 - Published: 2018-03-08 - Granted: 2020-09-08 - Earliest claimed: 2016-09-06 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Christian Klein; Gregg Robert Wygonik; Ricardo A. Espinoza Reyes; Raymond Quan; Sophors Khut - Web page: https://patentgrep.com/patent/US10768804B2 ## CPC - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 1/1652: {the display being flexible, e.g. mimicking a sheet of paper, or rollable} - G06F 1/1692: {the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/0416: {Control or interface arrangements specially adapted for digitisers} - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A gesture language for a device with multiple touch surfaces is described. Generally, a series of new touch input models is described that includes touch input interactions on two disjoint touch-sensitive surfaces. For example, a mobile device can include a primary display on a “front” side of the device, and a secondary display or touch-sensitive surface on the “back” side of the device, such as a surface that is opposite the primary display. Accordingly, the gesture language can include a series of “back touch” interactions with the touch-sensitive surface on the backside of the device. Example interactions include direct and indirect touch input on the back side, as well as simultaneous touch input on both sides of the device. ## Claims ### Claim 1 A computer-readable storage device storing computer-executable instructions that, when executed by at least one processor, causes the at least one processor to execute a method comprising: executing a first mode of touch-input interpretation that interprets touch input received on the first touch-sensitive display associated with a computing device; receiving a first touch input via the first touch-sensitive display and a second touch-sensitive display associated with the computing device, wherein the first touch input comprises a gesture having a first touch point on the first touch-sensitive display and a second touch point on the second touch-sensitive display, and wherein the gesture is selected from a group that comprises: a pinch gesture, a swipe gesture, and a multi-finger tap gesture; determining that the gesture is a gesture modifier configured to change the first touch-sensitive display from the first mode of touch input-interpretation to a second mode of touch input-interpretation that interprets a subsequent touch input, receivable via the first touch-sensitive display, differently than the first mode of touch-input interpretation; and toggling the first touch-sensitive display from the first mode of touch input-interpretation to the second mode of touch input-interpretation based on a determination that the gesture is the gesture modifier, wherein the toggling configures the first touch-sensitive display so that receipt of the subsequent touch input is interpreted differently from an interpretation provided through the first mode. ### Claim 2 (depends on 1) The computer-readable storage device as described in claim 1, wherein the executed method further comprising: receiving a second touch input, on the first touch-sensitive display, that modifies a displayed object while the first touch-sensitive display is operating in the second mode of touch input-interpretation; and modifying the displayed object based the received second touch input and application of the second mode of touch input interpretation, and wherein the second mode of touch input-interpretation is configured to modify the displayed object by at least one of resizing, rotating, flipping, copying, deleting, or sharing the displayed object, based on application of the second mode of touch input-interpretation. ### Claim 3 (depends on 1) The computer-readable storage device as described in claim 1, wherein the first touch input is one selected from a group that comprises: a tap gesture, a double-tap gesture, a pinch gesture, a directional swipe and a multi-finger swipe. ### Claim 4 (depends on 1) The computer-readable storage device as described in claim 1, wherein the executed method further comprising: changing the first touch-sensitive display from the second mode to the first mode in response to detecting an interruption action of the gesture modifier received via the second touch-sensitive display. ### Claim 5 (depends on 1) The computer-readable storage device as described in claim 1, wherein the first touch-sensitive display is associated with a first display device and the second touch-sensitive display is associated with a second display device. ### Claim 6 (depends on 1) The computer-readable storage device as described in claim 1, wherein the first touch-sensitive display is disposed on a first member of a computing device that is hingedly connected to a second member having the second touch-sensitive display. ### Claim 7 (depends on 1) The computer-readable storage device as described in claim 1, wherein the first touch-sensitive display and the second touch-sensitive display are both disposed on a bendable material that enables the first touch-sensitive display and the second touch-sensitive display to face different directions. ### Claim 8 (depends on 1) The computer-readable storage device as described in claim 1, wherein the gesture initiates at the first touch point on the first touch-sensitive display and drags content from the first touch-sensitive display to the second touch-sensitive display ending at the second touch point. ### Claim 9 (depends on 8) The method as described in claim 8, wherein the first touch-sensitive display and the second touch-sensitive display are both disposed on a bendable material that enables the first touch-sensitive display and the second touch-sensitive display to face different directions. ### Claim 10 (depends on 8) The method as described in claim 8, further comprising: receiving a second touch input, on the first touch-sensitive display, that modifies a displayed object while the first touch-sensitive display is operating in the second mode of touch input-interpretation; and modifying the displayed object based the received second touch input and application of the second mode of touch input interpretation, and wherein the second mode of touch input-interpretation is configured to modify the displayed object by at least one of resizing, rotating, flipping, copying, deleting, or sharing the displayed object, based on application of the second mode of touch input-interpretation. ### Claim 11 (depends on 8) The method as described in claim 8, wherein the gesture initiates at the first touch point on the first touch-sensitive display and drags content from the first touch-sensitive display to the second touch-sensitive display ending at the second touch point. ### Claim 12 (depends on 8) The method as described in claim 8, further comprising: changing the first touch-sensitive display from the second mode to the first mode in response to detecting an interruption action of the gesture modifier received via the second touch-sensitive display. ### Claim 13 (depends on 8) The method as described in claim 8, wherein the first touch-sensitive display is associated with a first display device and the second touch-sensitive display is associated with a second display device. ### Claim 14 (depends on 8) The method as described in claim 8, wherein the first touch-sensitive display is disposed on a first member of a computing device that is hingedly connected to a second member having the second touch-sensitive display. ### Claim 15 A method comprising: executing a first mode of touch-input interpretation that interprets touch input received on the first touch-sensitive display associated with a computing device; receiving a first touch input via the first touch-sensitive display and a second touch-sensitive display associated with the computing device, wherein the first touch input comprises a gesture having a first touch point on the first touch-sensitive display and a second touch point on the second touch-sensitive display, and wherein the gesture is selected from a group that comprises: a pinch gesture, a swipe gesture, and a multi-finger tap gesture; determining that the gesture is a gesture modifier configured to change the first touch-sensitive display from the first mode of touch input-interpretation to a second mode of touch input-interpretation that interprets a subsequent touch input, receivable via the first touch-sensitive display, differently than the first mode of touch-input interpretation; and toggling the first touch-sensitive display from the first mode of touch input-interpretation to the second mode of touch input-interpretation based on a determination that the gesture is the gesture modifier, wherein the toggling configures the first touch-sensitive display so that receipt of the subsequent touch input is interpreted differently from an interpretation provided through the first mode. ### Claim 16 A system comprising: a first touch-sensitive display; a second touch-sensitive display; at least one processor that is connected with the first touch-sensitive display and the second touch-sensitive display; at least one computer-readable storage media storing instructions that are executable by the at least one processor to implement an input module configured to: execute a first mode of touch-input interpretation that interprets touch input received on the first touch-sensitive display associated with a computing device; receive a first touch input via the first touch-sensitive display and a second touch-sensitive display associated with the computing device, wherein the first touch input comprises a gesture having a first touch point on the first touch-sensitive display and a second touch point on the second touch-sensitive display, and wherein the gesture is selected from a group that comprises: a pinch gesture, a swipe gesture, and a multi-finger tap gesture; determine that the gesture is a gesture modifier configured to change the first touch-sensitive display from the first mode of touch input-interpretation to a second mode of touch input-interpretation that interprets a subsequent touch input, receivable via the first touch-sensitive display, differently than the first mode of touch-input interpretation; and toggle the first touch-sensitive display from the first mode of touch input-interpretation to the second mode of touch input-interpretation based on a determination that the gesture is the gesture modifier and the subsequent touch input is interpreted differently from an interpretation provided through the first mode. ### Claim 17 (depends on 16) The system as described in claim 16, wherein the input module is further configured to: receive a second touch input, on the first touch-sensitive display, that modifies a displayed object while the first touch-sensitive display is operating in the second mode of touch input-interpretation; and modifies the displayed object based the received second touch input and application of the second mode of touch input interpretation, and wherein the second mode of touch input-interpretation is configured to modify the displayed object by at least one of resizing, rotating, flipping, copying, deleting, or sharing the displayed object, based on application of the second mode of touch input-interpretation. ### Claim 18 (depends on 16) The system as described in claim 16, wherein the gesture initiates at the first touch point on the first touch-sensitive display and drags content from the first touch-sensitive display to the second touch-sensitive display ending at the second touch point. ### Claim 19 (depends on 16) The system as described in claim 16, wherein the input module is further configured to: change the first touch-sensitive display from the second mode to the first mode in response to detecting an interruption action of the gesture modifier received via the second touch-sensitive display. ### Claim 20 (depends on 16) The system as described in claim 16, wherein the first touch-sensitive display is disposed on a first member of a computing device that is hingedly connected to a second member having the second touch-sensitive display.