# US 12,112,037 B2 · Methods and interfaces for media control with dynamic feedback

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,112,037 B2
- Document ID: US12112037B2
- Status: Granted
- Kind: B2
- Application number: 18/229,989
- Filed: 2023-08-03
- Published: 2023-12-21
- Granted: 2024-10-08
- Earliest claimed: 2020-09-25
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Taylor G. Carrigan; Patrick L. Coffman; Pedro Mari; Camille Moussette; Gemma Alexandria Roper; Peter C. Tsoi
- Web page: https://patentgrep.com/patent/US12112037B2

## CPC

- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]}
- G06F 1/1643: {the display being associated to a digitizer, e.g. laptops that can be used as penpads (details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615)}
- G06F 1/1688: {the I/O peripheral being integrated loudspeakers}
- G06F 1/1698: {the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone (details of antennas disposed inside a computer H01Q1/2266)}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04M 1/72412: using two-way short-range wireless interfaces
- H04M 1/72442: for playing music files
- H04M 1/72454: according to context-related or environment-related conditions
- G06F 2203/014: Force feedback applied to GUI
- G06F 2203/0383: Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

The present disclosure generally relates to techniques and interfaces for managing media playback devices. In some embodiments, the techniques include varying a feedback based on movement of a computer system toward or away from an external device. In some embodiments, the techniques include displaying an interface that includes controls for controlling media playback on an external device when the computer system and the external device are playing media. In some embodiments, the techniques include performing operations at a computer system in response to an input having a size that is less than or greater than a size threshold. In some embodiments, the techniques include performing different operations at a computer system when status lights have states that indicate different states of the computer system.

## Claims

### Claim 1

A computer system configured to communicate with a display generation component and one or more input devices, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
in response to a determination that a distance between the computer system and a first external device is less than a first threshold distance:
in accordance with a determination that a first set of criteria is met, wherein the first set of criteria includes a criterion that is met when the computer system is currently playing first media and the first external device is playing second media, displaying, via the display generation comment, a media control user interface that includes:
a first selectable graphical user interface object for starting playback of the first media on the first external device; and
one or more selectable user interface objects for controlling the playback of the second media on the first external device, including a first media control selectable graphical user interface object; and
displaying second status information associated with the first external device, wherein displaying the second status information associated with the first external device includes displaying a representation of the media control user interface transitioning from a first state that does not include the second status information to a second state that includes the second status information;
while displaying the media control user interface, receiving, via the one or more input devices, an input; and
in response to receiving the input:
in accordance with a determination that the input corresponds to the first selectable graphical user interface object, initiating a process to cause the first external device to playback the first media; and
in accordance with a determination that the input corresponds to the first media control selectable graphical user interface object, initiating a process for controlling playback of the second media by the first external device.

### Claim 2 (depends on 1)

The computer system of claim 1, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a second set of criteria is met, wherein the second set of criteria includes a criterion that is met when the computer system is not playing the first media and the first external device is not playing the second media, displaying, via the display generation component, a set of one or more representations of predetermined media content items.

### Claim 3 (depends on 1)

The computer system of claim 1, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a third set of criteria is met, wherein the third set of criteria includes a criterion that is met when the computer system is not playing the first media and the first external device is currently playing the second media, displaying, via the display generation component, a second selectable graphical user interface object that, when selected, initiates playback of the second media at the computer system.

### Claim 4 (depends on 1)

The computer system of claim 1, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a fourth set of criteria is met, wherein the fourth set of criteria includes a criterion that is met when the computer system is currently playing the first media and the first external device is not playing the second media, initiating a process to cause the first external device to playback the first media.

### Claim 5 (depends on 1)

The computer system of claim 1, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a fifth set of criteria is met, wherein the fifth set of criteria includes a first criterion that is met when the computer system is currently playing the first media and the first external device is playing third media and a second criterion that is met when the first media is different from the third media, adding the third media to a queue for playback at the computer system.

### Claim 6 (depends on 1)

The computer system of claim 1, wherein the media control user interface further includes a set of one or more selectable user interface objects that includes a first selectable user interface object that, when selected, controls an operation at the first external device.

### Claim 7 (depends on 6)

The computer system of claim 6, wherein the set of one or more selectable user interface objects includes a set of controls selected from a group consisting of timer controls, alarm controls, and message controls.

### Claim 8 (depends on 1)

The computer system of claim 1, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than a second threshold distance:
displaying, via the display generation component, a second representation of the media control user interface, wherein the second representation of the media control user interface includes an indication of the first external device.

### Claim 9 (depends on 8)

The computer system of claim 8, wherein the indication of the first external device includes first status information associated with the first external device.

### Claim 10 (depends on 8)

The computer system of claim 8, the one or more programs further including instructions for:
detecting a first change in distance between the computer system and the first external device; and
in response to detecting the first change in distance:
in accordance with a determination that the first change in distance includes movement of the computer system toward the first external device, adjusting a displayed size of the second representation of the media control user interface.

### Claim 11 (depends on 8)

The computer system of claim 8, the one or more programs further including instructions for:
detecting a second change in distance between the computer system and the first external device; and
in response to detecting the second change in distance:
in accordance with a determination that the second change in distance includes movement of the computer system away from the first external device, adjusting a displayed size of the second representation of the media control user interface.

### Claim 12 (depends on 8)

The computer system of claim 8, wherein the second representation of the media control user interface includes a first subset of status information associated with the first external device, the one or more programs further including instructions for:
while displaying the second representation of the media control user interface, receiving a second input; and
in response to receiving the second input, displaying the second representation of the media control user interface having an expanded state that includes a second subset of status information associated with the first external device that is different than the first subset of status information associated with the first external device.

### Claim 13 (depends on 12)

The computer system of claim 12, wherein displaying the second representation of the media control user interface having an expanded state includes:
in accordance with a determination that a sixth set of criteria is met, wherein the sixth set of criteria includes a criterion that is met when the computer system is currently playing the first media and the first external device is not playing the second media, displaying a third selectable graphical user interface object that, when selected, initiates playback of the first media on the first external device.

### Claim 14 (depends on 1)

The computer system of claim 1, the one or more programs further including instructions for:
in response to receiving the input:
in accordance with a determination that the input corresponds to a predefined gesture, ceasing display of the one or more selectable user interface objects for controlling the playback of the second media on the first external device.

### Claim 15

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and one or more input devices, the one or more programs including instructions for:
in response to a determination that a distance between the computer system and a first external device is less than a first threshold distance:
in accordance with a determination that a first set of criteria is met, wherein the first set of criteria includes a criterion that is met when the computer system is currently playing first media and the first external device is playing second media, displaying, via the display generation component, a media control user interface that includes:
a first selectable graphical user interface object for starting playback of the first media on the first external device; and
one or more selectable user interface objects for controlling the playback of the second media on the first external device, including a first media control selectable graphical user interface object; and
displaying second status information associated with the first external device, wherein displaying the second status information associated with the first external device includes displaying a representation of the media control user interface transitioning from a first state that does not include the second status information to a second state that includes the second status information;
while displaying the media control user interface, receiving, via the one or more input devices, an input; and
in response to receiving the input:
in accordance with a determination that the input corresponds to the first selectable graphical user interface object, initiating a process to cause the first external device to playback the first media; and
in accordance with a determination that the input corresponds to the first media control selectable graphical user interface object, initiating a process for controlling playback of the second media by the first external device.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a second set of criteria is met, wherein the second set of criteria includes a criterion that is met when the computer system is not playing the first media and the first external device is not playing the second media, displaying, via the display generation component, a set of one or more representations of predetermined media content items.

### Claim 17 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a third set of criteria is met, wherein the third set of criteria includes a criterion that is met when the computer system is not playing the first media and the first external device is currently playing the second media, displaying, via the display generation component, a second selectable graphical user interface object that, when selected, initiates playback of the second media at the computer system.

### Claim 18 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a fourth set of criteria is met, wherein the fourth set of criteria includes a criterion that is met when the computer system is currently playing the first media and the first external device is not playing the second media, initiating a process to cause the first external device to playback the first media.

### Claim 19 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a fifth set of criteria is met, wherein the fifth set of criteria includes a first criterion that is met when the computer system is currently playing the first media and the first external device is playing third media and a second criterion that is met when the first media is different from the third media, adding the third media to a queue for playback at the computer system.

### Claim 20 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the media control user interface further includes a set of one or more selectable user interface objects that includes a first selectable user interface object that, when selected, controls an operation at the first external device.

### Claim 21 (depends on 20)

The non-transitory computer-readable storage medium of claim 20, wherein the set of one or more selectable user interface objects includes a set of controls selected from a group consisting of timer controls, alarm controls, and message controls.

### Claim 22 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
in response to a determination that a distance between the computer system and the first external device is less than a second threshold distance:
displaying, via the display generation component, a second representation of the media control user interface, wherein the second representation of the media control user interface includes an indication of the first external device.

### Claim 23 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, wherein the indication of the first external device includes first status information associated with the first external device.

### Claim 24 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, the one or more programs further including instructions for:
detecting a first change in distance between the computer system and the first external device; and
in response to detecting the first change in distance:
in accordance with a determination that the first change in distance includes movement of the computer system toward the first external device, adjusting a displayed size of the second representation of the media control user interface.

### Claim 25 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, the one or more programs further including instructions for:
detecting a second change in distance between the computer system and the first external device; and
in response to detecting the second change in distance:
in accordance with a determination that the second change in distance includes movement of the computer system away from the first external device, adjusting a displayed size of the second representation of the media control user interface.

### Claim 26 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, wherein the second representation of the media control user interface includes a first subset of status information associated with the first external device, the one or more programs further including instructions for:
while displaying the second representation of the media control user interface, receiving a second input; and
in response to receiving the second input, displaying the second representation of the media control user interface having an expanded state that includes a second subset of status information associated with the first external device that is different than the first subset of status information associated with the first external device.

### Claim 27 (depends on 26)

The non-transitory computer-readable storage medium of claim 26, wherein displaying the second representation of the media control user interface having an expanded state includes:
in accordance with a determination that a sixth set of criteria is met, wherein the sixth set of criteria includes a criterion that is met when the computer system is currently playing the first media and the first external device is not playing the second media, displaying a third selectable graphical user interface object that, when selected, initiates playback of the first media on the first external device.

### Claim 28 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
in response to receiving the input:
in accordance with a determination that the input corresponds to a predefined gesture, ceasing display of the one or more selectable user interface objects for controlling the playback of the second media on the first external device.

### Claim 29

A method, comprising:
at a computer system that is in communication with a display generation component and one or more input devices:
in response to a determination that a distance between the computer system and a first external device is less than a first threshold distance:
in accordance with a determination that a first set of criteria is met, wherein the first set of criteria includes a criterion that is met when the computer system is currently playing first media and the first external device is playing second media, displaying, via the display generation component, a media control user interface that includes:
a first selectable graphical user interface object for starting playback of the first media on the first external device; and
one or more selectable user interface objects for controlling the playback of the second media on the first external device, including a first media control selectable graphical user interface object; and
displaying second status information associated with the first external device, wherein displaying the second status information associated with the first external device includes displaying a representation of the media control user interface transitioning from a first state that does not include the second status information to a second state that includes the second status information;
while displaying the media control user interface, receiving, via the one or more input devices, an input; and
in response to receiving the input:
in accordance with a determination that the input corresponds to the first selectable graphical user interface object, initiating a process to cause the first external device to playback the first media; and
in accordance with a determination that the input corresponds to the first media control selectable graphical user interface object, initiating a process for controlling playback of the second media by the first external device.

### Claim 30 (depends on 29)

The method of claim 29, further comprising:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a second set of criteria is met, wherein the second set of criteria includes a criterion that is met when the computer system is not playing the first media and the first external device is not playing the second media, displaying, via the display generation component, a set of one or more representations of predetermined media content items.

### Claim 31 (depends on 29)

The method of claim 29, further comprising:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a third set of criteria is met, wherein the third set of criteria includes a criterion that is met when the computer system is not playing the first media and the first external device is currently playing the second media, displaying, via the display generation component, a second selectable graphical user interface object that, when selected, initiates playback of the second media at the computer system.

### Claim 32 (depends on 29)

The method of claim 29, further comprising:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a fourth set of criteria is met, wherein the fourth set of criteria includes a criterion that is met when the computer system is currently playing the first media and the first external device is not playing the second media, initiating a process to cause the first external device to playback the first media.

### Claim 33 (depends on 29)

The method of claim 29, further comprising:
in response to a determination that a distance between the computer system and the first external device is less than the first threshold distance:
in accordance with a determination that a fifth set of criteria is met, wherein the fifth set of criteria includes a first criterion that is met when the computer system is currently playing the first media and the first external device is playing third media and a second criterion that is met when the first media is different from the third media, adding the third media to a queue for playback at the computer system.

### Claim 34 (depends on 29)

The method of claim 29, wherein the media control user interface further includes a set of one or more selectable user interface objects that includes a first selectable user interface object that, when selected, controls an operation at the first external device.

### Claim 35 (depends on 34)

The method of claim 34, wherein the set of one or more selectable user interface objects includes a set of controls selected from a group consisting of timer controls, alarm controls, and message controls.

### Claim 36 (depends on 29)

The method of claim 29, further comprising:
in response to a determination that a distance between the computer system and the first external device is less than a second threshold distance:
displaying, via the display generation component, a second representation of the media control user interface, wherein the second representation of the media control user interface includes an indication of the first external device.

### Claim 37 (depends on 36)

The method of claim 36, wherein the indication of the first external device includes first status information associated with the first external device.

### Claim 38 (depends on 36)

The method of claim 36, further comprising:
detecting a first change in distance between the computer system and the first external device; and
in response to detecting the first change in distance:
in accordance with a determination that the first change in distance includes movement of the computer system toward the first external device, adjusting a displayed size of the second representation of the media control user interface.

### Claim 39 (depends on 36)

The method of claim 36, further comprising:
detecting a second change in distance between the computer system and the first external device; and
in response to detecting the second change in distance:
in accordance with a determination that the second change in distance includes movement of the computer system away from the first external device, adjusting a displayed size of the second representation of the media control user interface.

### Claim 40 (depends on 36)

The method of claim 36, wherein the second representation of the media control user interface includes a first subset of status information associated with the first external device, and the method further comprises:
while displaying the second representation of the media control user interface, receiving a second input; and
in response to receiving the second input, displaying the second representation of the media control user interface having an expanded state that includes a second subset of status information associated with the first external device that is different than the first subset of status information associated with the first external device.

### Claim 41 (depends on 40)

The method of claim 40, wherein displaying the second representation of the media control user interface having an expanded state includes:
in accordance with a determination that a sixth set of criteria is met, wherein the sixth set of criteria includes a criterion that is met when the computer system is currently playing the first media and the first external device is not playing the second media, displaying a third selectable graphical user interface object that, when selected, initiates playback of the first media on the first external device.

### Claim 42 (depends on 29)

The method of claim 29, further comprising:
in response to receiving the input:
in accordance with a determination that the input corresponds to a predefined gesture, ceasing display of the one or more selectable user interface objects for controlling the playback of the second media on the first external device.