# US 12,114,142 B2 · User interfaces for managing controllable external devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,114,142 B2 - Document ID: US12114142B2 - Status: Granted - Kind: B2 - Application number: 18/235,291 - Filed: 2023-08-17 - Published: 2023-12-14 - Granted: 2024-10-08 - Earliest claimed: 2019-05-31 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Taylor G. Carrigan; Patrick L Coffman; Christopher Patrick Foss; Tiffany S. Jon; Andrew S. Kim; Lauren K. Trottier - Web page: https://patentgrep.com/patent/US12114142B2 ## CPC - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/0485: Scrolling or panning - G06F 3/0486: Drag-and-drop - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 9/4411: {Configuring for operating with peripheral devices; Loading of device drivers} - G06F 9/453: {Help systems} - H04L 12/2809: {indicating that an appliance service is present in a home automation network (monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51)} - H04L 12/2812: {describing content present in a home automation network, e.g. audio video content (retrieval from the Internet G06F16/95)} - H04L 12/2814: {Exchanging control software or macros for controlling appliance services in a home automation network (arrangements for maintenance or administration involving configuration of the network and network elements H04L41/08)} - H04L 12/2816: {Controlling appliance services of a home automation network by calling their functionalities (arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00)} - H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)} - H04M 1/72415: for remote control of appliances - G06F 2203/04105: Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract The present disclosure relates to a process for configuring an electronic device to control a first controllable external device. The process includes receiving information corresponding to the first controllable external device, and determining, based on the received information, whether the first controllable external device is associated with a plurality of controllable functions associated with a plurality of subcomponents of the first controllable external device. ## Claims ### Claim 1 An electronic device, comprising: a display device; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while the electronic device is not configured to control a first controllable external device, detecting a first set of one or more inputs corresponding to a request to configure the electronic device to control the first controllable external device; in response to detecting the first set of one or more inputs, initiating a process to configure the electronic device to control the first controllable external device, wherein the process includes: receiving information corresponding to the first controllable external device; in accordance with a determination, based on the received information, that the first controllable external device is associated with a plurality of controllable functions associated with a plurality of subcomponents of the first controllable external device, displaying, on the display device, a first accessory affordance corresponding to a group including the first controllable external device and the plurality of subcomponents; and in accordance with a determination, based on the received information, that the first controllable external device is not associated with the plurality of subcomponents, displaying, on the display device, a second accessory affordance corresponding to the first controllable external device; while displaying, on the display device, the first accessory affordance or the second accessory affordance, detecting a second input; and in response to detecting the second input: in accordance with a determination that the second input corresponds to a selection of the first accessory affordance, displaying, on the display device, a first accessory interface including a plurality of control affordances corresponding to the first controllable external device and the plurality of subcomponents and a control reconfiguration affordance that, when selected, initiates a process to remove at least a first control affordance of the plurality of control affordances from the first accessory interface; and in accordance with a determination that the second input corresponds to a selection of the second accessory affordance, displaying, on the display device, a second accessory interface including controls for the first controllable external device without displaying the control reconfiguration affordance. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the first accessory interface includes a group control affordance that, when selected, transmits a command to the first controllable external device that affects a corresponding state of each subcomponent of the plurality of subcomponents. ### Claim 3 (depends on 2) The electronic device of claim 2, wherein the one or more programs further include instructions for: detecting a third input corresponding to a selection of the first control affordance; and in response to detecting the third input, transmitting a command to the first controllable external device that affects a corresponding state of each subcomponent of the plurality of subcomponents. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the plurality of control affordances of the first accessory interface includes the first control affordance and a second control affordance, wherein the first control affordance is associated with a first subcomponent of the plurality of subcomponents and the second control affordance is associated with a second subcomponent of the plurality of subcomponents, and wherein the one or more programs further include instructions for: while displaying the first accessory interface, detecting a fourth input corresponding to the first control affordance; and in response to detecting the fourth input, transmitting a command to the first controllable external device that affects a state of the first subcomponent without transmitting a command to the first controllable external device that affects a state of the second subcomponent. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the first accessory interface includes a remove accessory affordance, and wherein the one or more programs further include instructions for: detecting a fifth input corresponding to the remove accessory affordance; in response to detecting the fifth input corresponding to the remove accessory affordance, initiating a process to configure the electronic device to no longer control the first controllable external device, including: in accordance with a determination that a set of alert criteria are met, the alert criteria including a criterion that is met when the first controllable external device is a subcomponent device of a composite external device that includes at least one other subcomponent device that the electronic device is currently configured to control, displaying an indication that completing the process to configure the electronic device to no longer control the first controllable external device will also configure the electronic device to no longer control the at least one other subcomponent device; and in accordance with a determination that the set of alert criteria are not met, forgoing displaying the indication that completing the process to configure the electronic device to no longer control the first controllable external device will also configure the electronic device to no longer control the at least one other subcomponent device. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the plurality of control affordances include one or more control affordances that correspond to subcomponents of a first type and one or more control affordances that correspond to subcomponents of a second type, and wherein the one or more programs further include instructions for: while displaying the first accessory interface, detecting a second set of one or more inputs including an input correspond to the control reconfiguration affordance; and in response to detecting the second set of one or more inputs: ceasing to display the first accessory interface and ceasing to display the first accessory affordance; displaying a third accessory affordance that, when selected, displays a third accessory interface including the one or more control affordances that correspond to subcomponents of first type; and displaying a fourth accessory affordance that, when selected, displays a fourth accessory interface including the one or more control affordances that correspond to subcomponents of a second type. ### Claim 7 (depends on 6) The electronic device of claim 6, wherein the third accessory interface includes a regroup affordance, and wherein the one or more programs further include instructions for: while displaying the third accessory interface, detecting a third set of one or more inputs including an input corresponding to the regroup affordance; and in response to detecting the third set of one or more inputs: ceasing to display the third accessory affordance and the fourth accessory affordance; and re-displaying the first accessory affordance that, when selected, displays the first accessory interface that includes the plurality of control affordances. ### Claim 8 A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display device, the one or more programs including instructions for: while the electronic device is not configured to control a first controllable external device, detecting a first set of one or more inputs corresponding to a request to configure the electronic device to control the first controllable external device; in response to detecting the first set of one or more inputs, initiating a process to configure the electronic device to control the first controllable external device, wherein the process includes: receiving information corresponding to the first controllable external device; in accordance with a determination, based on the received information, that the first controllable external device is associated with a plurality of controllable functions associated with a plurality of subcomponents of the first controllable external device, displaying, on the display device, a first accessory affordance corresponding to a group including the first controllable external device and the plurality of subcomponents; and in accordance with a determination, based on the received information, that the first controllable external device is not associated with the plurality of subcomponents, displaying, on the display device, a second accessory affordance corresponding to the first controllable external device; while displaying, on the display device, the first accessory affordance or the second accessory affordance, detecting a second input; and in response to detecting the second input: in accordance with a determination that the second input corresponds to a selection of the first accessory affordance, displaying, on the display device, a first accessory interface including a plurality of control affordances corresponding to the first controllable external device and the plurality of subcomponents and a control reconfiguration affordance that, when selected, initiates a process to remove at least a first control affordance of the plurality of control affordances from the first accessory interface; and in accordance with a determination that the second input corresponds to a selection of the second accessory affordance, displaying, on the display device, a second accessory interface including controls for the first controllable external device without displaying the control reconfiguration affordance. ### Claim 9 (depends on 8) The non-transitory computer-readable storage medium of claim 8, wherein the first accessory interface includes a group control affordance that, when selected, transmits a command to the first controllable external device that affects a corresponding state of each subcomponent of the plurality of subcomponents. ### Claim 10 (depends on 9) The non-transitory computer-readable storage medium of claim 9, wherein the one or more programs further include instructions for: detecting a third input corresponding to a selection of the first control affordance; and in response to detecting the third input, transmitting a command to the first controllable external device that affects a corresponding state of each subcomponent of the plurality of subcomponents. ### Claim 11 (depends on 8) The non-transitory computer-readable storage medium of claim 8, wherein the plurality of control affordances of the first accessory interface includes the first control affordance and a second control affordance, wherein the first control affordance is associated with a first subcomponent of the plurality of subcomponents and the second control affordance is associated with a second subcomponent of the plurality of subcomponents, and wherein the one or more programs further include instructions for: while displaying the first accessory interface, detecting a fourth input corresponding to the first control affordance; and in response to detecting the fourth input, transmitting a command to the first controllable external device that affects a state of the first subcomponent without transmitting a command to the first controllable external device that affects a state of the second subcomponent. ### Claim 12 (depends on 8) The non-transitory computer-readable storage medium of claim 8, wherein the first accessory interface includes a remove accessory affordance, and wherein the one or more programs further include instructions for: detecting a fifth input corresponding to the remove accessory affordance; in response to detecting the fifth input corresponding to the remove accessory affordance, initiating a process to configure the electronic device to no longer control the first controllable external device, including: in accordance with a determination that a set of alert criteria are met, the alert criteria including a criterion that is met when the first controllable external device is a subcomponent device of a composite external device that includes at least one other subcomponent device that the electronic device is currently configured to control, displaying an indication that completing the process to configure the electronic device to no longer control the first controllable external device will also configure the electronic device to no longer control the at least one other subcomponent device; and in accordance with a determination that the set of alert criteria are not met, forgoing displaying the indication that completing the process to configure the electronic device to no longer control the first controllable external device will also configure the electronic device to no longer control the at least one other subcomponent device. ### Claim 13 (depends on 8) The non-transitory computer-readable storage medium of claim 8, wherein the plurality of control affordances include one or more control affordances that correspond to subcomponents of a first type and one or more control affordances that correspond to subcomponents of a second type, and wherein the one or more programs further include instructions for: while displaying the first accessory interface, detecting a second set of one or more inputs including an input correspond to the control reconfiguration affordance; and in response to detecting the second set of one or more inputs: ceasing to display the first accessory interface and ceasing to display the first accessory affordance; displaying a third accessory affordance that, when selected, displays a third accessory interface including the one or more control affordances that correspond to subcomponents of first type; and displaying a fourth accessory affordance that, when selected, displays a fourth accessory interface including the one or more control affordances that correspond to subcomponents of a second type. ### Claim 14 (depends on 13) The non-transitory computer-readable storage medium of claim 13, wherein the third accessory interface includes a regroup affordance, and wherein the one or more programs further include instructions for: while displaying the third accessory interface, detecting a third set of one or more inputs including an input corresponding to the regroup affordance; and in response to detecting the third set of one or more inputs: ceasing to display the third accessory affordance and the fourth accessory affordance; and re-displaying the first accessory affordance that, when selected, displays the first accessory interface that includes the plurality of control affordances. ### Claim 15 A method, comprising: at an electronic device with a display device: while the electronic device is not configured to control a first controllable external device, detecting a first set of one or more inputs corresponding to a request to configure the electronic device to control the first controllable external device; in response to detecting the first set of one or more inputs, initiating a process to configure the electronic device to control the first controllable external device, wherein the process includes: receiving information corresponding to the first controllable external device; in accordance with a determination, based on the received information, that the first controllable external device is associated with a plurality of controllable functions associated with a plurality of subcomponents of the first controllable external device, displaying, on the display device, a first accessory affordance corresponding to a group including the first controllable external device and the plurality of subcomponents; and in accordance with a determination, based on the received information, that the first controllable external device is not associated with the plurality of subcomponents, displaying, on the display device, a second accessory affordance corresponding to the first controllable external device; while displaying, on the display device, the first accessory affordance or the second accessory affordance, detecting a second input; and in response to detecting the second input: in accordance with a determination that the second input corresponds to a selection of the first accessory affordance, displaying, on the display device, a first accessory interface including a plurality of control affordances corresponding to the first controllable external device and the plurality of subcomponents and a control reconfiguration affordance that, when selected, initiates a process to remove at least a first control affordance of the plurality of control affordances from the first accessory interface; and in accordance with a determination that the second input corresponds to a selection of the second accessory affordance, displaying, on the display device, a second accessory interface including controls for the first controllable external device without displaying the control reconfiguration affordance. ### Claim 16 (depends on 15) The method of claim 15, wherein the first accessory interface includes a group control affordance that, when selected, transmits a command to the first controllable external device that affects a corresponding state of each subcomponent of the plurality of subcomponents. ### Claim 17 (depends on 16) The method of claim 16, further comprising: detecting a third input corresponding to a selection of the first control affordance; and in response to detecting the third input, transmitting a command to the first controllable external device that affects a corresponding state of each subcomponent of the plurality of subcomponents. ### Claim 18 (depends on 15) The method of claim 15, wherein the plurality of control affordances of the first accessory interface includes the first control affordance and a second control affordance, wherein the first control affordance is associated with a first subcomponent of the plurality of subcomponents and the second control affordance is associated with a second subcomponent of the plurality of subcomponents, and wherein the method further comprises: while displaying the first accessory interface, detecting a fourth input corresponding to the first control affordance; and in response to detecting the fourth input, transmitting a command to the first controllable external device that affects a state of the first subcomponent without transmitting a command to the first controllable external device that affects a state of the second subcomponent. ### Claim 19 (depends on 15) The method of claim 15, wherein the first accessory interface includes a remove accessory affordance, and wherein the method further comprises: detecting a fifth input corresponding to the remove accessory affordance; in response to detecting the fifth input corresponding to the remove accessory affordance, initiating a process to configure the electronic device to no longer control the first controllable external device, including: in accordance with a determination that a set of alert criteria are met, the alert criteria including a criterion that is met when the first controllable external device is a subcomponent device of a composite external device that includes at least one other subcomponent device that the electronic device is currently configured to control, displaying an indication that completing the process to configure the electronic device to no longer control the first controllable external device will also configure the electronic device to no longer control the at least one other subcomponent device; and in accordance with a determination that the set of alert criteria are not met, forgoing displaying the indication that completing the process to configure the electronic device to no longer control the first controllable external device will also configure the electronic device to no longer control the at least one other subcomponent device. ### Claim 20 (depends on 15) The method of claim 15, wherein the plurality of control affordances include one or more control affordances that correspond to subcomponents of a first type and one or more control affordances that correspond to subcomponents of a second type, and wherein the method further comprises: while displaying the first accessory interface, detecting a second set of one or more inputs including an input correspond to the control reconfiguration affordance; and in response to detecting the second set of one or more inputs: ceasing to display the first accessory interface and ceasing to display the first accessory affordance; displaying a third accessory affordance that, when selected, displays a third accessory interface including the one or more control affordances that correspond to subcomponents of first type; and displaying a fourth accessory affordance that, when selected, displays a fourth accessory interface including the one or more control affordances that correspond to subcomponents of a second type. ### Claim 21 (depends on 20) The method of claim 20, wherein the third accessory interface includes a regroup affordance, and wherein the method further comprises: while displaying the third accessory interface, detecting a third set of one or more inputs including an input corresponding to the regroup affordance; and in response to detecting the third set of one or more inputs: ceasing to display the third accessory affordance and the fourth accessory affordance; and re-displaying the first accessory affordance that, when selected, displays the first accessory interface that includes the plurality of control affordances.