# US 2025/0168270 A1 · User interfaces for content streaming

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168270 A1
- Document ID: US20250168270A1
- Status: Published application
- Kind: A1
- Application number: 19/029,614
- Filed: 2025-01-17
- Published: 2025-05-22
- Earliest claimed: 2019-01-04
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Taylor G. CARRIGAN; Patrick L. COFFMAN; Christopher Patrick FOSS
- Web page: https://patentgrep.com/patent/US20250168270A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04M 1/72415: for remote control of appliances
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- H04L 65/1093: by adding participants; by removing participants
- H04L 65/1094: Inter-user-equipment sessions transfer or sharing
- H04L 65/612: for unicast
- H04L 65/613: for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637)
- H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)}
- H04L 67/025: for remote control or remote monitoring of applications
- H04M 1/72412: using two-way short-range wireless interfaces
- H04M 1/72442: for playing music files
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/4222: {Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy (remote control device for a television receiver integrated into a mobile phone H04M1/72415)}
- H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)}
- H04N 21/43637: {involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11] (arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114)}
- H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)}
- H04M 2250/02: including a Bluetooth® interface
- H04M 2250/06: including a wireless LAN interface
- H04M 2250/22: including a touch pad, a touch sensor or a touch detector
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In some embodiments, an electronic device operates in a streaming mode to automatically stream content from the electronic device to a playback destination. In some embodiments, an electronic device presents selectable options to control playback of content on a streaming destination while the electronic device streams content to the streaming destination. In some embodiments, an electronic device presents visual indications that the electronic device is operating in a streaming mode to stream content to a playback destination. In some embodiments, an electronic device presents a user interface for controlling electronic devices that automatically reconfigures to support different user inputs and issues different commands based on the type of electronic device being controlled. In some embodiments, an electronic device presents a user interface for controlling electronic devices that automatically provides context-specific selectable options based on the content being displayed on the electronic device being controlled.

## Claims

### Claim 1

A method comprising:
at a first electronic device in communication with a touch screen:
displaying, on the touch screen, a remote control user interface for controlling a second electronic device, wherein the remote control user interface includes a virtual touchpad region;
while displaying the remote control user interface, receiving, via the touch screen, a touch input in the virtual touchpad region; and
in response to receiving the touch input in the virtual touchpad region:
in accordance with a determination that the second electronic device is a first type of device, performing a first respective action of a first set of actions corresponding to the first type of device; and
in accordance with a determination that the second electronic device is a second type of device, different from the first type of device, performing a second respective action of a second set of actions, different than the first set of actions, corresponding to the second type of device.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the first set of actions corresponding to the first type of device includes gesture input actions; and
the second set of actions corresponding to the second type of device do not include gesture input actions.

### Claim 3 (depends on 2)

The method of claim 2, wherein displaying the remote control user interface comprises displaying usage hints in the virtual touchpad region that indicate a respective set of actions that are performable from the virtual touchpad region.

### Claim 4 (depends on 2)

The method of claim 2, wherein:
in accordance with the determination that the second electronic device is the first type of device, the usage hints correspond to the first set of actions, and
in accordance with the determination that the second electronic device is the second type of device, the usage hints correspond to the second set of actions.

### Claim 5 (depends on 2)

The method of claim 2, wherein displaying the usage hints in the virtual touchpad region comprises displaying the usage hints for a threshold amount of time when the remote control user interface is first displayed.

### Claim 6 (depends on 2)

The method of claim 2, wherein displaying the usage hints in the virtual touchpad region comprises displaying the usage hints until the first electronic device receives an initial touch input in the virtual touchpad region.

### Claim 7 (depends on 2)

The method of claim 2, wherein displaying the usage hints in the virtual touchpad region comprises displaying the usage hints once every remote control usage session of the first electronic device.

### Claim 8 (depends on 2)

The method of claim 2, wherein displaying the usage hints in the virtual touchpad region comprises displaying the usage hints only a first time the first electronic device displays the remote control user interface.

### Claim 9 (depends on 5)

The method of claim 5, wherein the remote control user interface further includes a device selection element for selecting an electronic device to control using the remote control user interface, the method further comprising:
in response to receiving a user input selecting the device selection element, displaying, in the remote control user interface, a list of one or more devices, including the second electronic device, that are controllable using the remote control user interface.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
prior to receiving the touch input in the virtual touchpad region and while displaying the list of the one or more devices to control, receiving user input selecting the second electronic device in the list; and
in response to receiving the user input selecting the second electronic device in the list, configuring the remote control user interface to control the second electronic device.

### Claim 11 (depends on 9)

The method of claim 9, wherein:
displaying the list of one or more devices includes reducing a size of the virtual touchpad region in the remote control user interface to create a display region in the remote control user interface in which the list of one or more devices is displayed; and
while the list of one or more devices is displayed in the remote control user interface, the virtual touchpad region continues to be responsive to touch inputs to perform the first set of actions or the second set of actions.

### Claim 12 (depends on 11)

The method of claim 11, wherein reducing the size of the virtual touchpad region comprises reducing the size of the virtual touchpad region to no smaller than a predetermined size.

### Claim 13 (depends on 1)

The method of claim 1, wherein the remote control user interface further includes one or more affordances for controlling the second electronic device.

### Claim 14 (depends on 13)

The method of claim 13, wherein:
in accordance with the determination that the second electronic device is the first type of device, the one or more affordances is a first set of affordances for performing a first set of functions; and
in accordance with the determination that the second electronic device is the second type of device, the one or more affordances is a second set of affordances for performing a second set of functions, different than the first set of functions.

### Claim 15 (depends on 14)

The method of claim 14, wherein:
the first set of affordances includes a search affordance to initiate a search on the second electronic device; and
the second set of affordances does not include the search affordance.

### Claim 16 (depends on 14)

The method of claim 14, further comprising:
in response to receiving a touch input selecting one of the one or more affordances for controlling the second electronic device, providing haptic feedback.

### Claim 17 (depends on 1)

The method of claim 1, wherein the remote control user interface is displayed in response to a request to display the remote control user interface for controlling the second electronic device.

### Claim 18 (depends on 17)

The method of claim 17, wherein the request to display the remote control user interface comprises a user input selecting a remote control affordance on a controls user interface for controlling a plurality of functionalities of the first electronic device.

### Claim 19 (depends on 17)

The method of claim 17, wherein the request to display the remote control user interface comprises a user input selecting a remote control affordance on a playback control user interface for controlling content playback of the second electronic device.

### Claim 20 (depends on 17)

The method of claim 17, wherein the request to display the remote control user interface comprises a user input selecting a remote control affordance on a wake screen user interface.

### Claim 21 (depends on 17)

The method of claim 17, wherein the request to display the remote control user interface comprises a user input selecting a remote control application.

### Claim 22 (depends on 1)

The method of claim 1, wherein:
in accordance with a determination that the first electronic device is a third type of device, the remote control user interface is displayed on the touch screen without being displayed with other user interfaces; and
in accordance with a determination that the first electronic device is a fourth type of device, different than the third type of device, the remote control user interface is displayed on the touch screen concurrently with at least one other user interface.

### Claim 23

An electronic device, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, on the touch screen, a remote control user interface for controlling a second electronic device, wherein the remote control user interface includes a virtual touchpad region;
while displaying the remote control user interface, receiving, via the touch screen, a touch input in the virtual touchpad region; and
in response to receiving the touch input in the virtual touchpad region:
in accordance with a determination that the second electronic device is a first type of device, performing a first respective action of a first set of actions corresponding to the first type of device; and
in accordance with a determination that the second electronic device is a second type of device, different from the first type of device, performing a second respective action of a second set of actions, different than the first set of actions, corresponding to the second type of device.

### Claim 24

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
display, on the touch screen, a remote control user interface for controlling a second electronic device, wherein the remote control user interface includes a virtual touchpad region;
while displaying the remote control user interface, receive, via the touch screen, a touch input in the virtual touchpad region; and
in response to receiving the touch input in the virtual touchpad region:
in accordance with a determination that the second electronic device is a first type of device, perform a first respective action of a first set of actions corresponding to the first type of device; and
in accordance with a determination that the second electronic device is a second type of device, different from the first type of device, perform a second respective action of a second set of actions, different than the first set of actions, corresponding to the second type of device.
