# US 12,001,670 B2 · Devices, methods, and graphical user interfaces for moving user interface objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,001,670 B2
- Document ID: US12001670B2
- Status: Granted
- Kind: B2
- Application number: 17/947,032
- Filed: 2022-09-16
- Published: 2023-01-19
- Granted: 2024-06-04
- Earliest claimed: 2017-05-16
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Mark K. Hauenstein; Raymond S. Sepulveda; Marcos Alonso Ruiz; Julian K. Missig; Jeffrey T. Bernstein; Patrick L. Coffman; Stephen O. Lemay
- Web page: https://patentgrep.com/patent/US12001670B2

## CPC

- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0485: Scrolling or panning
- G06F 3/0486: Drag-and-drop
- G06F 2203/014: Force feedback applied to GUI
- G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A device with a display and a touch-sensitive surface displays a user interface including an object. While displaying the user interface, the device detects a first and a second portion of an input, where the first portion includes contact(s) at a location corresponding to the object and the second portion includes movement of the contact(s). In response: upon determining that the second portion was detected shortly after detecting the contact(s): when the first input has a first predefined number of contacts, the device drags the user interface object or a representation; and when the first input has a second predefined number of contacts, the device forgoes the dragging. Further in response, upon determining that the second portion was detected after the contact(s) had been detected at the location for at least the first threshold amount of time, the device drags the user interface object or the representation thereof.

## Claims

### Claim 1

A method, comprising:
at a device having a display, and a touch-sensitive surface:
displaying a first user interface on the display, wherein the first user interface includes a first user interface object at a first location in the first user interface;
while displaying the first user interface that includes the first user interface object, detecting a first input that includes a first portion of the first input and a second portion of the first input, wherein detecting the first portion of the first input includes detecting one or more first contacts at a location on the touch-sensitive surface that corresponds to the first user interface object in the first user interface and detecting the second portion of the first input that includes detecting first movement of the one or more first contacts across the touch-sensitive surface, wherein the first user interface object is displayed at the first location in the first user interface while the first portion of the first input is detected;
in response to detecting the first input:
in accordance with a determination that the second portion of the first input was detected before the one or more first contacts had been detected at the location on the touch-sensitive surface for a first threshold amount of time without more than a threshold amount of movement:
in accordance with a determination that the first input has a first predefined number of contacts, dragging the first user interface object or a representation thereof relative to the first user interface in accordance with the second portion of the first input; and
in accordance with a determination that the first input has a second predefined number of contacts, forgoing dragging the first user interface object or the representation thereof relative to the first user interface in accordance with the second portion of the first input; and
in accordance with a determination that the second portion of the first input was detected after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement, dragging the first user interface object or the representation thereof relative to the first user interface in accordance with the second portion of the first input.

### Claim 2 (depends on 1)

The method of claim 1, including:
after the first user interface object or the representation thereof has been dragged to a second location on the display in accordance with the second portion of the first input and before termination of the first input is detected, detecting a second input, including detecting one or more second contacts at a location on the touch-sensitive surface that corresponds to a second user interface object, distinct from the first user interface object, on the display; and
in response to detecting the second input:
in accordance with a determination that the second input meets object-selection criteria, selecting the second user interface object, wherein the object-selection criteria require that
the second input has the first predefined number of contacts; and
the one or more second contacts are maintained on the touch-sensitive surface for less than the first threshold amount of time with less than the threshold amount of movement before lift-off of the one or more second contacts is detected.

### Claim 3 (depends on 2)

The method of claim 2, wherein selecting the second user interface object includes changing an appearance of the second user interface object to indicate that the second user interface object is in a selected state.

### Claim 4 (depends on 2)

The method of claim 2, including:
while the second user interface object is selected, detecting a third portion of the first input, including detecting second movement of the one or more first contacts; and
in response to detecting the third portion of the first input:
moving the second user interface object or a representation thereof to a respective location on the display that corresponds to a current location of the one or more first contacts on the touch-sensitive surface; and
moving the first user interface object and the second user interface object as a collection in accordance with the third portion of the first input.

### Claim 5 (depends on 4)

The method of claim 4, wherein:
the first input has the first predefined number of contacts
detecting the first input further includes detecting a fourth portion of the first input, including detecting first relative movement between at least two of the first predefined number of contacts of the first input; and
the method includes:
in response to detecting the fourth portion of the first input, spreading out the first user interface object from the second user interface object in accordance with the fourth portion of the first input.

### Claim 6 (depends on 2)

The method of claim 2, wherein selecting the second user interface object includes moving the second user interface object or a representation thereof to a respective location on the display that corresponds to a current location of the one or more first contacts on the touch-sensitive surface.

### Claim 7 (depends on 2)

The method of claim 2, including:
in response to detecting the second input:
in accordance with a determination that the second input meets object-activation criteria, wherein the object-activation criteria require that
the second input has the second predefined number of contacts,
the one or more second contacts are maintained on the touch-sensitive surface for less than the first threshold amount of time with less than the threshold amount of movement before the lift-off of the one or more second contacts is detected,
in order for the object-activation criteria to be met, displaying user interface or content corresponding to the second user interface object.

### Claim 8 (depends on 1)

The method of claim 1, including:
in response to detecting the first input:
in accordance with a determination that the second portion of the first input was detected after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement:
in accordance with a determination that the first input includes the second predefined number of contacts, displaying a plurality of selectable options that correspond to the first user interface object after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement; and
in accordance with a determination that the first input includes the first predefined number of contacts, forgoing displaying the plurality of selectable options that correspond to the first user interface object.

### Claim 9 (depends on 1)

The method of claim 1, including:
in response to detecting the first input:
in accordance with a determination that the first input includes the second predefined number of contacts, changing an appearance of the first user interface object after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement; and
in accordance with a determination that the first input includes the first predefined number of contacts, changing the appearance of the first user interface object without waiting until the one or more first contacts are maintained for at least the first threshold amount of time.

### Claim 10 (depends on 1)

The method of claim 1, including:
in response to detecting the first input:
in accordance with a determination that the second portion of the first input is detected before the one or more first contacts have been detected at the location on the touch-sensitive surface for the first threshold amount of time without more than the threshold amount of movement, scrolling the first user interface in accordance with the second portion of the first input.

### Claim 11 (depends on 1)

The method of claim 1, wherein dragging the first user interface object or the representation thereof in accordance with the second portion of the first input includes:
dragging the first user interface object or the representation thereof in accordance with the first movement of the first predefined number of contacts in the first input, wherein the first movement includes less than a threshold amount of relative movement between respective ones of the second predefined number of contacts.

### Claim 12 (depends on 11)

The method of claim 11, wherein:
the first input has the first predefined number of contacts,
detecting the first input further includes detecting a fifth portion of the first input, including detecting first relative movement between at least two of the second predefined number of contacts of the first input; and
the method includes:
in response to detecting the fifth portion of the first input, changing a size of the first user interface object in accordance with the fifth portion of the first input.

### Claim 13 (depends on 1)

The method of claim 1, including:
in response to detecting the first input:
in accordance with a determination that deletion-mode-activation criteria are met, displaying the first user interface in an object-deletion mode, wherein:
while the first user interface is displayed in the object-deletion mode, deletion of a respective object displayed in the first user interface is performed when a predefined deletion input is detected at a location on the touch-sensitive surface that corresponds to the respective object;
the deletion-mode-activation criteria are met in accordance with any one of:
the first input has the first predefined number of contacts, and the second portion of the first input includes more than the threshold amount of movement;
the first input has the second predefined number of contacts, and the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement before the second portion of the first input was detected; and
the first input has the second predefined number of contacts, and the one or more first contacts had been detected at the location on the touch-sensitive surface for at least a second threshold amount of time, greater than the first threshold amount of time without more than the threshold amount of movement.

### Claim 14

An electronic device, comprising:
a display;
a touch-sensitive surface;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying a first user interface on the display, wherein the first user interface includes a first user interface object at a first location in the first user interface;
while displaying the first user interface that includes the first user interface object, detecting a first input that includes a first portion of the first input and a second portion of the first input, wherein detecting the first portion of the first input includes detecting one or more first contacts at a location on the touch-sensitive surface that corresponds to the first user interface object in the first user interface and detecting the second portion of the first input that includes detecting first movement of the one or more first contacts across the touch-sensitive surface, wherein the first user interface object is displayed at the first location in the first user interface while the first portion of the first input is detected;
in response to detecting the first input:
in accordance with a determination that the second portion of the first input was detected before the one or more first contacts had been detected at the location on the touch-sensitive surface for a first threshold amount of time without more than a threshold amount of movement:
in accordance with a determination that the first input has a first predefined number of contacts, dragging the first user interface object or a representation thereof relative to the first user interface in accordance with the second portion of the first input; and
in accordance with a determination that the first input has a second predefined number of contacts, forgoing dragging the first user interface object or the representation thereof relative to the first user interface in accordance with the second portion of the first input; and
in accordance with a determination that the second portion of the first input was detected after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement, dragging the first user interface object or the representation thereof relative to the first user interface in accordance with the second portion of the first input.

### Claim 15 (depends on 14)

The electronic device of claim 14, wherein the one or more programs include instructions for:
after the first user interface object or the representation thereof has been dragged to a second location on the display in accordance with the second portion of the first input and before termination of the first input is detected, detecting a second input, including detecting one or more second contacts at a location on the touch-sensitive surface that corresponds to a second user interface object, distinct from the first user interface object, on the display; and
in response to detecting the second input:
in accordance with a determination that the second input meets object-selection criteria, selecting the second user interface object, wherein the object-selection criteria require that
the second input has the first predefined number of contacts; and
the one or more second contacts are maintained on the touch-sensitive surface for less than the first threshold amount of time with less than the threshold amount of movement before lift-off of the one or more second contacts is detected.

### Claim 16 (depends on 15)

The electronic device of claim 15, wherein selecting the second user interface object includes changing an appearance of the second user interface object to indicate that the second user interface object is in a selected state.

### Claim 17 (depends on 15)

The electronic device of claim 15, wherein the one or more programs include instructions for:
while the second user interface object is selected, detecting a third portion of the first input, including detecting second movement of the one or more first contacts; and
in response to detecting the third portion of the first input:
moving the second user interface object or a representation thereof to a respective location on the display that corresponds to a current location of the one or more first contacts on the touch-sensitive surface; and
moving the first user interface object and the second user interface object as a collection in accordance with the third portion of the first input.

### Claim 18 (depends on 17)

The electronic device of claim 17, wherein:
the first input has the first predefined number of contacts,
detecting the first input further includes detecting a fourth portion of the first input, including detecting first relative movement between at least two of the first predefined number of contacts of the first input; and
the one or more programs include instructions for:
in response to detecting the fourth portion of the first input, spreading out the first user interface object from the second user interface object in accordance with the fourth portion of the first input.

### Claim 19 (depends on 15)

The electronic device of claim 15, wherein selecting the second user interface object includes moving the second user interface object or a representation thereof to a respective location on the display that corresponds to a current location of the one or more first contacts on the touch-sensitive surface.

### Claim 20 (depends on 15)

The electronic device of claim 15, wherein the one or more programs include instructions for:
in response to detecting the second input:
in accordance with a determination that the second input meets object-activation criteria, wherein the object-activation criteria require that
the second input has the second predefined number of contacts,
the one or more second contacts are maintained on the touch-sensitive surface for less than the first threshold amount of time with less than the threshold amount of movement before the lift-off of the one or more second contacts is detected,
in order for the object-activation criteria to be met, displaying user interface or content corresponding to the second user interface object.

### Claim 21 (depends on 14)

The electronic device of claim 14, wherein the one or more programs include instructions for:
in response to detecting the first input:
in accordance with a determination that the second portion of the first input was detected after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement:
in accordance with a determination that the first input includes the second predefined number of contacts, displaying a plurality of selectable options that correspond to the first user interface object after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement; and
in accordance with a determination that the first input includes the first predefined number of contacts, forgoing displaying the plurality of selectable options that correspond to the first user interface object.

### Claim 22 (depends on 14)

The electronic device of claim 14, wherein the one or more programs include instructions for:
in response to detecting the first input:
in accordance with a determination that the first input includes the second predefined number of contacts, changing an appearance of the first user interface object after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement; and
in accordance with a determination that the first input includes the first predefined number of contacts, changing the appearance of the first user interface object without waiting until the one or more first contacts are maintained for at least the first threshold amount of time.

### Claim 23 (depends on 14)

The electronic device of claim 14, wherein the one or more programs include instructions for:
in response to detecting the first input:
in accordance with a determination that the second portion of the first input is detected before the one or more first contacts have been detected at the location on the touch-sensitive surface for the first threshold amount of time without more than the threshold amount of movement, scrolling the first user interface in accordance with the second portion of the first input.

### Claim 24 (depends on 14)

The electronic device of claim 14, wherein dragging the first user interface object or the representation thereof in accordance with the second portion of the first input includes:
dragging the first user interface object or the representation thereof in accordance with the first movement of the first predefined number of contacts in the first input, wherein the first movement includes less than a threshold amount of relative movement between respective ones of the second predefined number of contacts.

### Claim 25 (depends on 24)

The electronic device of claim 24, wherein:
the first input has the first predefined number of contacts,
detecting the first input further includes detecting a fifth portion of the first input, including detecting first relative movement between at least two of the second predefined number of contacts of the first input; and
the one or more programs include instructions for:
in response to detecting the fifth portion of the first input, changing a size of the first user interface object in accordance with the fifth portion of the first input.

### Claim 26 (depends on 14)

The electronic device of claim 14, wherein the one or more programs include instructions for:
in response to detecting the first input:
in accordance with a determination that deletion-mode-activation criteria are met, displaying the first user interface in an object-deletion mode, wherein:
while the first user interface is displayed in the object-deletion mode, deletion of a respective object displayed in the first user interface is performed when a predefined deletion input is detected at a location on the touch-sensitive surface that corresponds to the respective object;
the deletion-mode-activation criteria are met in accordance with any one of:
the first input has the first predefined number of contacts, and the second portion of the first input includes more than the threshold amount of movement;
the first input has the second predefined number of contacts, and the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement before the second portion of the first input was detected; and
the first input has the second predefined number of contacts, and the one or more first contacts had been detected at the location on the touch-sensitive surface for at least a second threshold amount of time, greater than the first threshold amount of time without more than the threshold amount of movement.

### Claim 27

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the electronic device to:
display a first user interface on the display, wherein the first user interface includes a first user interface object at a first location in the first user interface;
while displaying the first user interface that includes the first user interface object, detect a first input that includes a first portion of the first input and a second portion of the first input, wherein detecting the first portion of the first input includes detecting one or more first contacts at a location on the touch-sensitive surface that corresponds to the first user interface object in the first user interface and detecting the second portion of the first input that includes detecting first movement of the one or more first contacts across the touch-sensitive surface, wherein the first user interface object is displayed at the first location in the first user interface while the first portion of the first input is detected;
in response to detecting the first input:
in accordance with a determination that the second portion of the first input was detected before the one or more first contacts had been detected at the location on the touch-sensitive surface for a first threshold amount of time without more than a threshold amount of movement:
in accordance with a determination that the first input has a first predefined number of contacts, drag the first user interface object or a representation thereof relative to the first user interface in accordance with the second portion of the first input; and
in accordance with a determination that the first input has a second predefined number of contacts, forgo dragging the first user interface object or the representation thereof relative to the first user interface in accordance with the second portion of the first input; and
in accordance with a determination that the second portion of the first input was detected after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement, drag the first user interface object or the representation thereof relative to the first user interface in accordance with the second portion of the first input.

### Claim 28 (depends on 27)

The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
after the first user interface object or the representation thereof has been dragged to a second location on the display in accordance with the second portion of the first input and before termination of the first input is detected, detecting a second input, including detecting one or more second contacts at a location on the touch-sensitive surface that corresponds to a second user interface object, distinct from the first user interface object, on the display; and
in response to detecting the second input:
in accordance with a determination that the second input meets object-selection criteria, selecting the second user interface object, wherein the object-selection criteria require that
the second input has the first predefined number of contacts; and
the one or more second contacts are maintained on the touch-sensitive surface for less than the first threshold amount of time with less than the threshold amount of movement before lift-off of the one or more second contacts is detected.

### Claim 29 (depends on 28)

The non-transitory computer readable storage medium of claim 28, wherein selecting the second user interface object includes changing an appearance of the second user interface object to indicate that the second user interface object is in a selected state.

### Claim 30 (depends on 28)

The non-transitory computer readable storage medium of claim 28, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
while the second user interface object is selected, detecting a third portion of the first input, including detecting second movement of the one or more first contacts; and
in response to detecting the third portion of the first input:
moving the second user interface object or a representation thereof to a respective location on the display that corresponds to a current location of the one or more first contacts on the touch-sensitive surface; and
moving the first user interface object and the second user interface object as a collection in accordance with the third portion of the first input.

### Claim 31 (depends on 30)

The non-transitory computer readable storage medium of claim 30, wherein:
the first input has the first predefined number of contacts,
detecting the first input further includes detecting a fourth portion of the first input, including detecting first relative movement between at least two of the first predefined number of contacts of the first input; and
the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
in response to detecting the fourth portion of the first input, spreading out the first user interface object from the second user interface object in accordance with the fourth portion of the first input.

### Claim 32 (depends on 28)

The non-transitory computer readable storage medium of claim 28, wherein selecting the second user interface object includes moving the second user interface object or a representation thereof to a respective location on the display that corresponds to a current location of the one or more first contacts on the touch-sensitive surface.

### Claim 33 (depends on 28)

The non-transitory computer readable storage medium of claim 28, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
in response to detecting the second input:
in accordance with a determination that the second input meets object-activation criteria, wherein the object-activation criteria require that
the second input has the second predefined number of contacts,
the one or more second contacts are maintained on the touch-sensitive surface for less than the first threshold amount of time with less than the threshold amount of movement before the lift-off of the one or more second contacts is detected,
in order for the object-activation criteria to be met, displaying user interface or content corresponding to the second user interface object.

### Claim 34 (depends on 27)

The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
in response to detecting the first input:
in accordance with a determination that the second portion of the first input was detected after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement:
in accordance with a determination that the first input includes the second predefined number of contacts, displaying a plurality of selectable options that correspond to the first user interface object after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement; and
in accordance with a determination that the first input includes the first predefined number of contacts, forgoing displaying the plurality of selectable options that correspond to the first user interface object.

### Claim 35 (depends on 27)

The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
in response to detecting the first input:
in accordance with a determination that the first input includes the second predefined number of contacts, changing an appearance of the first user interface object after the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement; and
in accordance with a determination that the first input includes the first predefined number of contacts, changing the appearance of the first user interface object without waiting until the one or more first contacts are maintained for at least the first threshold amount of time.

### Claim 36 (depends on 27)

The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
in response to detecting the first input:
in accordance with a determination that the second portion of the first input is detected before the one or more first contacts have been detected at the location on the touch-sensitive surface for the first threshold amount of time without more than the threshold amount of movement, scrolling the first user interface in accordance with the second portion of the first input.

### Claim 37 (depends on 27)

The non-transitory computer readable storage medium of claim 27, wherein dragging the first user interface object or the representation thereof in accordance with the second portion of the first input includes:
dragging the first user interface object or the representation thereof in accordance with the first movement of the first predefined number of contacts in the first input, wherein the first movement includes less than a threshold amount of relative movement between respective ones of the second predefined number of contacts.

### Claim 38 (depends on 37)

The non-transitory computer readable storage medium of claim 37, wherein:
the first input has the first predefined number of contacts,
detecting the first input further includes detecting a fifth portion of the first input, including detecting first relative movement between at least two of the second predefined number of contacts of the first input; and
the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
in response to detecting the fifth portion of the first input, changing a size of the first user interface object in accordance with the fifth portion of the first input.

### Claim 39 (depends on 27)

The non-transitory computer readable storage medium of claim 27, wherein the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform operations, including:
in response to detecting the first input:
in accordance with a determination that deletion-mode-activation criteria are met, displaying the first user interface in an object-deletion mode, wherein:
while the first user interface is displayed in the object-deletion mode, deletion of a respective object displayed in the first user interface is performed when a predefined deletion input is detected at a location on the touch-sensitive surface that corresponds to the respective object;
the deletion-mode-activation criteria are met in accordance with any one of:
the first input has the first predefined number of contacts, and the second portion of the first input includes more than the threshold amount of movement;
the first input has the second predefined number of contacts, and the one or more first contacts had been detected at the location on the touch-sensitive surface for at least the first threshold amount of time without more than the threshold amount of movement before the second portion of the first input was detected; and
the first input has the second predefined number of contacts, and the one or more first contacts had been detected at the location on the touch-sensitive surface for at least a second threshold amount of time, greater than the first threshold amount of time without more than the threshold amount of movement.