# US 2019/0317620 A1 · Dynamic User Interface Adaptable to Multiple Input Tools

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317620 A1
- Document ID: US20190317620A1
- Status: Published application
- Kind: A1
- Application number: 16/445,108
- Filed: 2019-06-18
- Published: 2019-10-17
- Earliest claimed: 2013-09-18
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Julian Missig; May-Li Khoe; Bianca Cheng Costanzo; Jeffrey Traer Bernstein
- Web page: https://patentgrep.com/patent/US20190317620A1

## CPC

- G06F 3/0442: {using active external devices, e.g. active pens, for transmitting changes in electrical potential to be received by the digitiser}
- G06F 3/03545: {Pens or stylus}
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/04162: {for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware}
- G06F 3/0441: {using active external devices, e.g. active pens, for receiving changes in electrical potential transmitted by the digitiser, e.g. tablet driving signals}
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 2203/04106: Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computing device having a touch-sensitive surface and a display, detects a stylus input on the touch-sensitive surface while displaying a user interface. A first operation is performed in the user interface in accordance with a determination that the stylus input includes movement of the stylus across the touch-sensitive surface while the stylus is detected on the touch-sensitive surface. A second operation different from the first operation is performed in the user interface in accordance with a determination that the stylus input includes rotation of the stylus around an axis of the stylus while the stylus is detected on the touch-sensitive surface. A third operation is performed in the user interface in accordance with a determination that the stylus input includes movement of the stylus across the touch-sensitive surface and rotation of the stylus around an axis of the stylus while the stylus is detected on the touch-sensitive surface.

## Claims

### Claim 1

(canceled)

### Claim 2

A method, comprising:
at an electronic device that is in communication with a stylus that includes a touch-sensitive surface;
while a contact pattern that indicates that the stylus is being held in a user's hand is being detected with the touch-sensitive surface of the stylus,
displaying a user interface with a first appearance;
while displaying the user interface and continuing to detect that the stylus is being held in the user's hand, detecting a change in the contact pattern that is being detected by the touch-sensitive surface of the stylus; and
in response to detecting the change in the contact pattern detected by the touch-sensitive surface of the stylus, updating the user interface with a second appearance different from the first appearance.

### Claim 3 (depends on 2)

The method of claim 2, wherein updating the user interface includes changing one or more user operable controls in the user interface.

### Claim 4 (depends on 2)

The method of claim 2, wherein updating the user interface includes increasing a size of one or more user operable controls in the user interface.

### Claim 5 (depends on 4)

The method of claim 4, wherein the second appearance provides one or more tools associated with the stylus.

### Claim 6 (depends on 2)

The method of claim 2, wherein updating the user interface includes decreasing a size of one or more user operable controls in the user interface.

### Claim 7 (depends on 2)

The method of claim 2, wherein the user interface with the first appearance and the user interface with the second appearance are for a same application of the electronic device.

### Claim 8 (depends on 2)

The method of claim 2, wherein updating of the user interface is application independent.

### Claim 9 (depends on 2)

The method of claim 2, wherein detecting the change in the contact pattern that is being detected by the touch-sensitive surface of the stylus includes determining whether the stylus is in an active or idle state.

### Claim 10

An electronic device, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
at the electronic device that is in communication with a stylus that includes a touch-sensitive surface;
while a contact pattern that indicates that the stylus is being held in a user's hand is being detected with the touch-sensitive surface of the stylus,
displaying a user interface with a first appearance;
while displaying the user interface and continuing to detect that the stylus is being held in the user's hand, detecting a change in the contact pattern that is being detected by the touch-sensitive surface of the stylus; and
in response to detecting the change in the contact pattern detected by the touch-sensitive surface of the stylus, updating the user interface with a second appearance different from the first appearance.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein updating the user interface includes changing one or more user operable controls in the user interface.

### Claim 12 (depends on 10)

The electronic device of claim 10, wherein updating the user interface includes increasing a size of one or more user operable controls in the user interface.

### Claim 13 (depends on 12)

The electronic device of claim 12, wherein the second appearance provides one or more tools associated with the stylus.

### Claim 14 (depends on 10)

The electronic device of claim 10, wherein updating the user interface includes decreasing a size of one or more user operable controls in the user interface.

### Claim 15 (depends on 10)

The electronic device of claim 10, wherein the user interface with the first appearance and the user interface with the second appearance are for a same application of the electronic device.

### Claim 16 (depends on 10)

The electronic device of claim 10, wherein updating of the user interface is application independent.

### Claim 17 (depends on 10)

The electronic device of claim 10, wherein detecting the change in the contact pattern that is being detected by the touch-sensitive surface of the stylus includes determining whether the stylus is in an active or idle state.

### Claim 18

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device that is in communication with a stylus that includes a touch-sensitive surface, cause the device to:
while a contact pattern that indicates that the stylus is being held in a user's hand is being detected with the touch-sensitive surface of the stylus,
display a user interface with a first appearance;
while displaying the user interface and continuing to detect that the stylus is being held in the user's hand, detect a change in the contact pattern that is being detected by the touch-sensitive surface of the stylus; and
in response to detecting the change in the contact pattern detected by the touch-sensitive surface of the stylus, update the user interface with a second appearance different from the first appearance.

### Claim 19 (depends on 18)

non-transitory computer readable storage medium of claim 18, wherein updating the user interface includes changing one or more user operable controls in the user interface.

### Claim 20 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein updating the user interface includes increasing a size of one or more user operable controls in the user interface.

### Claim 21 (depends on 20)

The non-transitory computer readable storage medium of claim 20, wherein the second appearance provides one or more tools associated with the stylus.

### Claim 22 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein updating the user interface includes decreasing a size of one or more user operable controls in the user interface.

### Claim 23 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein the user interface with the first appearance and the user interface with the second appearance are for a same application of the electronic device.

### Claim 24 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein updating of the user interface is application independent.

### Claim 25 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein detecting the change in the contact pattern that is being detected by the touch-sensitive surface of the stylus includes determining whether the stylus is in an active or idle state.
