# US 10,120,566 B2 · Devices, methods, and graphical user interfaces for providing control of a touch-based user interface absent physical touch capabilities > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,120,566 B2 - Document ID: US10120566B2 - Status: Granted - Kind: B2 - Application number: 15/061,651 - Filed: 2016-03-04 - Published: 2016-06-30 - Granted: 2018-11-06 - Earliest claimed: 2011-06-05 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Christopher B. Fleizach; Eric T. Seymour; James P. Craig - Web page: https://patentgrep.com/patent/US10120566B2 ## CPC - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/033: Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041) - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/0485: Scrolling or panning - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An electronic device with a display and a touch-sensitive surface displays, on the display, a first visual indicator that corresponds to a virtual touch. The device receives a first input from an adaptive input device. In response to receiving the first input from the adaptive input device, the device displays a first menu on the display. The first menu includes a virtual touches selection icon. In response to detecting selection of the virtual touches selection icon, a menu of virtual multitouch contacts is displayed. ## Claims ### Claim 1 A method, comprising: at an electronic device with a touch-sensitive display: displaying; on the touch-sensitive display, a user interface that includes content; while displaying the user interface, receiving a request to perform a virtual multitouch gesture on the content in the user interface; after receiving the request to perform the virtual multitouch gesture on the content in the user interface: receiving an adaptive input, wherein the adaptive input does not include multiple contacts detected on the touch-sensitive display; and in response to receiving the adaptive input: in accordance with a determination that the device is in a first operating mode, performing a first operation on the content in the user interface; and in accordance with a determination that the device is in a second operating mode, performing a second operation on the content in the user interface. ### Claim 2 (depends on 1) The method of claim 1, wherein the first operation is a scrolling operation and the second operation is a zooming operation. ### Claim 3 (depends on 1) The method of claim 1, wherein in response to receiving a request to perform a virtual multitouch gesture on the content in the user interface, displaying, on the touch-sensitive display, visual indicators that correspond to virtual touches of the virtual multitouch gesture over the content in the user interface. ### Claim 4 (depends on 3) The method of claim 3, wherein the appearance of the visual indicators differ in the first operating mode from the second operating mode. ### Claim 5 (depends on 3) The method of claim 3, wherein the visual indicators comprise a connector linking two or more virtual touches. ### Claim 6 (depends on 1) The method of claim 1, wherein the virtual multitouch gesture is a virtual two-finger pinch/depinch gesture. ### Claim 7 (depends on 1) The method of claim 1, wherein the operation includes zooming the content in the user interface. ### Claim 8 (depends on 1) The method of claim 1, wherein the adaptive input does not include detecting any contact on the touch-sensitive display. ### Claim 9 (depends on 1) The method of claim 1, further comprising: determining that the device is in a first operating mode or a second operating mode prior to receiving the adaptive input. ### Claim 10 An electronic device, comprising a touch-sensitive display; one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, on the touch-sensitive display, a user interface that includes content; while displaying the user interface, receiving a request to perform a virtual multitouch gesture on the content in the user interface; after receiving the request to perform the virtual multitouch gesture on the content in the user interface: receiving an adaptive input, wherein the adaptive input does not include multiple contacts detected on the touch-sensitive display; and in response to receiving the adaptive input: in accordance with a determination that the device is in a first operating mode, performing a first operation on the content in the user interface; and in accordance with a determination that the device is in a second operating mode, performing a second operation on the content in the user interface. ### Claim 11 (depends on 10) The electronic device of claim 10, wherein the first operation is a scrolling operation and the second operation is a zooming operation. ### Claim 12 (depends on 10) The electronic device of claim 10, wherein in response to receiving a request to perform a virtual multitouch gesture on the content in the user interface, displaying, on the touch-sensitive display, visual indicators that correspond to virtual touches of the virtual multitouch gesture over the content in the user interface. ### Claim 13 (depends on 12) The electronic device of claim 12, wherein the appearance of the visual indicators differ in the first operating mode from the second operating mode. ### Claim 14 (depends on 12) The electronic device of claim 12, wherein the visual indicators comprise a connector linking two or more virtual touches. ### Claim 15 (depends on 10) The electronic device of claim 10, wherein the virtual multitouch gesture is a virtual two-finger pinch/depinch gesture. ### Claim 16 (depends on 10) The electronic device of claim 10, wherein the operation includes zooming the content in the user interface. ### Claim 17 (depends on 10) The electronic device of claim 10, wherein the adaptive input does not include detecting any contact on the touch-sensitive display. ### Claim 18 (depends on 10) The electronic device of claim 10, the one or more programs further including instructions for: determining that the device is in the first operating mode or the second operating mode prior to receiving the adaptive input. ### Claim 19 A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a touch-sensitive display, cause the electronic device to: display, on the touch-sensitive display, a user interface that includes content; while displaying the user interface, receive a request to perform a virtual multitouch gesture on the content in the user interface; after receiving the request to perform the virtual multitouch gesture on the content in the user interface: receive an adaptive input, wherein the adaptive input does not include multiple contacts detected on the touch-sensitive display; and in response to receiving the adaptive input: in accordance with a determination that the device is in a first operating mode, perform a first operation on the content in the user interface; and in accordance with a determination that the device is in a second operating mode, performing a second operation on the content in the user interface. ### Claim 20 (depends on 19) The computer readable storage medium of claim 19, wherein the first operation is a scrolling operation and the second operation is a zooming operation. ### Claim 21 (depends on 19) The computer readable storage medium of claim 19, wherein in response to receiving a request to perform a virtual multitouch gesture on the content in the user interface, displaying, on the touch-sensitive display, visual indicators that correspond to virtual touches of the virtual multitouch gesture over the content in the user interface. ### Claim 22 (depends on 21) The computer readable storage medium of claim 21, wherein the appearance of the visual indicators differ in the first operating mode from the second operating mode. ### Claim 23 (depends on 21) The computer readable storage medium of claim 21, wherein the visual indicators comprise a connector linking two or more virtual touches. ### Claim 24 (depends on 19) The computer readable storage medium of claim 19, wherein the virtual multitouch gesture is a virtual two-finger pinch/depinch gesture. ### Claim 25 (depends on 19) The computer readable storage medium of claim 19, wherein the operation includes zooming the content in the user interface. ### Claim 26 (depends on 19) The computer readable storage medium of claim 19, wherein the adaptive input does not include detecting any contact on the touch-sensitive display. ### Claim 27 (depends on 19) The computer readable storage medium of claim 19, the one or more programs further including instructions for: determining that the device is in the first operating mode or the second operating mode prior to receiving the adaptive input.