# US 2016/0259518 A1 · Devices, Methods, and Graphical User Interfaces for Manipulating User Interface Objects with Visual and/or Haptic Feedback

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0259518 A1
- Document ID: US20160259518A1
- Status: Published application
- Kind: A1
- Application number: 14/871,227
- Filed: 2015-09-30
- Published: 2016-09-08
- Earliest claimed: 2015-03-08
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Nicholas V. King; Sebastian J. Bauer; Imran A. Chaudhri; Alan C. Dye; Christopher P. Foss; Jonathan Ive; Behkish J. Manzari; Henrique D. Penha; Daniel T. Preston; Christopher I. Wilson
- Web page: https://patentgrep.com/patent/US20160259518A1

## CPC

- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0485: Scrolling or panning
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- H04L 67/60: Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources (admission control or resource allocation H04L47/70)
- G06F 2203/04104: Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

In accordance with some embodiments, a method is performed at an electronic device. The device displays a first user interface including a background with a first appearance and foreground objects. While displaying the first user interface, the device detects a first input while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface. In response, if the contact has a characteristic intensity above a first intensity threshold, the device dynamically changes the background without changing the foreground objects, wherein the dynamic change in the background is based on the characteristic intensity of the contact. While dynamically changing the background, detecting termination of the first input; and, in response, the device reverts the background back to the first appearance of the background.

## Claims

### Claim 1

A method, comprising:
at an electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts with the touch-sensitive surface:
displaying a first user interface on the display, wherein the first user interface includes
a background with a first appearance and
one or more foreground objects;
while displaying the first user interface on the display, detecting a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface;
in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact;
while dynamically changing the appearance of the background of the first user interface, detecting termination of the first input by the first contact; and,
in response to detecting termination of the first input by the first contact, reverting the background of the first user interface back to the first appearance of the background.

### Claim 2 (depends on 1)

The method of claim 1, wherein the dynamic change of the appearance of the background of the first user interface is based at least in part on a position of the first focus selector on the display.

### Claim 3 (depends on 1)

The method of claim 1, wherein, when the first input is detected, the electronic device is in a locked mode in which access to a plurality of different operations that are accessible when the device is in an unlocked state is prevented.

### Claim 4 (depends on 3)

The method of claim 3, wherein:
the background is used for both the locked state of the device and the unlocked state of the device;
while in the locked state, the appearance of the background is changed from a first appearance to a second appearance in accordance with the characteristic intensity of the first contact; and
the method includes:
while the background has the second appearance, receiving a request to enter an unlocked state, and,
in response to receiving the request to enter the unlocked state, entering the unlocked state; and
after entering the unlocked state, displaying a transition of the appearance of the background from the second state to the first state.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first intensity threshold is associated with an operating system of the electronic device, and respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy the first intensity threshold.

### Claim 6 (depends on 5)

The method of claim 5, wherein:
respective operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy a second intensity threshold;
the appearance of the background changes in a first manner when the characteristic intensity of the contact is between the first intensity threshold and the second intensity threshold; and
the appearance of the background changes in a second manner, different from the first manner, when the characteristic intensity of the contact is above the second intensity threshold.

### Claim 7 (depends on 3)

The method of claim 3, wherein a respective foreground object of the one or more foreground objects responds to an input by a contact having a characteristic intensity below the first intensity threshold.

### Claim 8 (depends on 3)

The method of claim 3, including:
detecting a second input by a second contact, the second input meeting criteria to exit the locked mode of the electronic device; and,
in response to detecting the second input by the second contact, replacing display of the first user interface with display of a second user interface that is distinct from the first user interface on the display, wherein the second user interface includes a background of the second user interface with a first appearance and one or more foreground objects.

### Claim 9 (depends on 8)

The method of claim 8, including:
while displaying the second user interface on the display, detecting a third input by a third contact on the touch-sensitive surface while a focus selector is at a location in the second user interface that corresponds to the background of the second user interface, wherein the third contact has a characteristic intensity above the first intensity threshold; and,
in response to detecting the third input by the third contact, maintaining the first appearance of the background of the second user interface.

### Claim 10 (depends on 8)

The method of claim 8, including:
while displaying the second user interface on the display, detecting a fourth input by a fourth contact on the touch-sensitive surface while a focus selector is at a location in the second user interface that corresponds to the background of the second user interface; and,
in response to detecting the fourth input by the fourth contact, in accordance with a determination that the fourth contact has a characteristic intensity above the first intensity threshold, dynamically changing the appearance of the background of the second user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the second user interface is based at least in part on the characteristic intensity of the fourth contact.

### Claim 11 (depends on 10)

The method of claim 10, including:
while dynamically changing the appearance of the background of the second user interface, detecting termination of the fourth input by the fourth contact; and,
in response to detecting termination of the fourth input by the fourth contact, reverting the background of the second user interface back to the first appearance of the background of the second user interface.

### Claim 12 (depends on 1)

The method of claim 1, wherein the change in the appearance of the background of the first user interface includes:
a change in the space between background objects;
a change in the radial position of a background object with respect to a position of the first contact;
a change in the opacity of a background object;
a change in the color of a background object;
a change in a simulated depth or focus of a background object;
a change in the contrast of a background object; and/or
a change in the brightness of a background object.

### Claim 13 (depends on 1)

The method of claim 1, wherein the background of the first user interface includes a geometric or abstract pattern.

### Claim 14 (depends on 1)

The method of claim 1, wherein the background of the first user interface includes a representative image in a sequence of images and dynamically changing the appearance of the background of the first user interface includes displaying in sequence at least some of the sequence of images based at least in part on the characteristic intensity of the first contact.

### Claim 15 (depends on 1)

The method of claim 1, wherein the change in the appearance of the background of the first user interface includes a rippling effect applied to a background object that emanates from the focus selector.

### Claim 16 (depends on 1)

The method of claim 1, wherein reverting the background of the first user interface back to the first appearance of the background includes:
moving display of an object of the background of the first user interface back to its first appearance in the background of the first user interface with a simulated inertia that is based on a rate of decrease in the characteristic intensity of the first contact detected immediately prior to detecting termination of the input by the first contact.

### Claim 17 (depends on 1)

The method of claim 1, including:
while detecting the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold:
detecting a decrease in the characteristic intensity of the first contact; and,
in response to detecting the decrease in the characteristic intensity of the first contact:
in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact does not exceeds a first rate of change threshold, dynamically reversing the change of the appearance of the background of the first user interface based on the rate of change of the characteristic intensity of the first contact; and,
in accordance with a determination that a rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact exceeds a first rate of change threshold, animating reversal of the change of the appearance of the background of the first user interface independent of the rate of change of the characteristic intensity of the first contact.

### Claim 18 (depends on 1)

The method of claim 1, wherein the dynamic change in the appearance of the background of the first user interface is based in part on a positive rate of change in the characteristic intensity of the first contact.

### Claim 19 (depends on 1)

The method of claim 1, wherein a magnitude of the dynamic change in the appearance of the background of the first user interface decays following detection of an impulse force by the first contact.

### Claim 20 (depends on 1)

The method of claim 1, including:
while detecting the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold:
detecting a decrease in the characteristic intensity of the first contact below the first intensity threshold; and,
in response to detecting the decrease in the characteristic intensity of the first contact below the first intensity threshold, continuing to dynamically change the appearance of the background of the first user interface based at least in part on the characteristic intensity of the first contact.

### Claim 21 (depends on 1)

The method of claim 1, wherein reverting the background of the first user interface back to the first appearance of the background is based on a rate of change of the decrease in the characteristic intensity of the first contact prior to termination of the first input.

### Claim 22 (depends on 1)

The method of claim 1, including:
while continuing to detect the first input by the first contact, after determining that the first contact has a characteristic intensity above the first intensity threshold:
detecting movement of the first contact on the touch-sensitive surface; and,
in response to detecting the movement of the first contact, dynamically updating the change in the appearance of the background of the first user interface based on the movement of the first contact on the touch-sensitive surface.

### Claim 23 (depends on 22)

The method of claim 22, including:
after determining that the first contact has a characteristic intensity above the first intensity threshold, and prior to detecting movement of the first contact on the touch-sensitive surface:
detecting a decrease in the characteristic intensity of the contact below the first intensity threshold.

### Claim 24 (depends on 1)

The method of claim 1, including:
in response to detecting the input by the first contact, in accordance with the determination that the first contact has a characteristic intensity above the first intensity threshold, changing an aspect of the appearance of the background of the first user interface without changing the appearance of a respective foreground object of the one or more foreground objects in the first user interface, wherein the change of the aspect of the appearance of the background of the first user interface is independent of the position of the focus selector in the background.

### Claim 25 (depends on 1)

The method of claim 1, including:
while detecting the first input by the first contact on the touch-sensitive surface, detecting a second input by a second contact on the touch-sensitive surface while a second focus selector is at a location in the first user interface that corresponds to the background of the user interface;
in response to detecting the second input by the second contact:
in accordance with a determination that the second contact does not have a characteristic intensity above the first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of a respective foreground object of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact; and,
in accordance with a determination that the second contact has a characteristic intensity above the first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of a respective foreground object of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on
the characteristic intensity of the first contact,
the characteristic intensity of the second contact, and
positions of the first and second focus selectors on the display;
while dynamically changing the appearance of the background of the first user interface, detecting termination of the first input by the first contact and termination of the second input by the second contact; and,
in response to detecting termination of the first input by the first contact and termination of the second input by the second contact, reverting the background of the first user interface back to the first appearance of the background.

### Claim 26 (depends on 1)

The method of claim 1, wherein:
in response to detecting the first input by the first contact on the touch-sensitive surface, in accordance with a determination that the first input does not have a characteristic intensity above the first intensity threshold, maintaining the first appearance of the background of the first user interface.

### Claim 27

An electronic device, comprising:
a display;
a touch-sensitive surface;
one or more sensors to detect intensity of contacts with the touch-sensitive surface;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying a first user interface on the display, wherein the first user interface includes
a background with a first appearance and
one or more foreground objects;
while displaying the first user interface on the display, detecting a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface;
in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically changing the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact;
while dynamically changing the appearance of the background of the first user interface, detecting termination of the first input by the first contact; and,
in response to detecting termination of the first input by the first contact, reverting the background of the first user interface back to the first appearance of the background.

### Claim 28

A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface cause the device to:
display a first user interface on the display, wherein the first user interface includes
a background with a first appearance and
one or more foreground objects;
while displaying the first user interface on the display, detect a first input by a first contact on the touch-sensitive surface while a first focus selector is at a location in the first user interface that corresponds to the background of the first user interface;
in response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity above a first intensity threshold, dynamically change the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the characteristic intensity of the first contact;
while dynamically changing the appearance of the background of the first user interface, detect termination of the first input by the first contact; and,
in response to detecting termination of the first input by the first contact, revert the background of the first user interface back to the first appearance of the background.