# US 12,001,753 B2 · Devices, methods, and graphical user interfaces for interactions with a headphone case > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,001,753 B2 - Document ID: US12001753B2 - Status: Granted - Kind: B2 - Application number: 17/948,083 - Filed: 2022-09-19 - Published: 2023-03-30 - Granted: 2024-06-04 - Earliest claimed: 2021-09-24 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Darius A. Satongar; William D. Lindmeier; Per Haakan Linus Persson - Web page: https://patentgrep.com/patent/US12001753B2 ## CPC - G06F 3/162: {Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs} - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - A45C 11/001: {for storing portable audio devices, e.g. headphones or digital music players} - G06F 3/03547: {Touch pads, in which fingers can move on a surface} - G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/0485: Scrolling or panning - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - H04R 1/1025: Accumulators specially adapted for earpieces; Arrangements specially adapted for charging thereof - H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - H04R 1/1016: {Earpieces of the intra-aural type} - H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A45C: PURSES; LUGGAGE; HAND CARRIED BAGS - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract An audio output device case that includes one or more input devices and is in communication with at least one or more audio output devices and an audio source, performs a method, while the audio source is in communication with the one or more audio output devices, that includes receiving an input via the one or more input devices of the audio output device case, and in response to receiving the input, causes the one or more audio output devices to perform an operation associated with the received input while maintaining communication of the audio source with the one or more audio output devices. ## Claims ### Claim 1 A method, comprising: at an audio output device case that includes one or more input devices and a display component, and is in communication with at least one or more audio output devices and an audio source: while the audio source is in communication with the one or more audio output devices: dynamically displaying, via the display component, one or more available operations based on contextual information associated with the audio output device case, the audio source, or the one or more audio output devices; receiving an input via the one or more input devices of the audio output device case; and in response to receiving the input, causing the one or more audio output devices to perform an operation associated with the received input while maintaining communication of the audio source with the one or more audio output devices, wherein the operation associated with the received input comprises a respective operation of the one or more available operations; the method including: while the audio source is a first audio source and the contextual information comprises first contextual information associated with the first audio source and a first application associated with the first audio source: displaying one or more user selectable controls associated with the first application; receiving a first input via the one or more input devices of the audio output device case that selects a respective control of one or more user selectable controls associated with the first application; and in response to receiving the first input, causing the one or more audio output devices to perform a first operation associated with the selected respective control of the one or more user selectable controls associated with the first application while maintaining communication of the audio source with the one or more audio output devices; and while the audio source is a second audio source, different from the first audio source, and the contextual information comprises second contextual information associated with the second audio source and a second application associated with the second audio source, wherein the second application is different from the first application: displaying one or more user selectable controls associated with the second application, wherein at least one of the one or more user selectable controls associated with the second application is distinct from the one or more user selectable controls associated with the first application; receiving a second input via the one or more input devices of the audio output device case that selects a respective control of the one or more user selectable controls associated with the second application; and in response to receiving the second input, causing the one or more audio output devices to perform a second operation associated with the selected respective control of the one or more user selectable controls associated with the second application while maintaining communication of the audio source with the one or more audio output devices. ### Claim 2 (depends on 1) The method of claim 1, wherein the audio source, the first audio source or the second audio source is a phone, a computer, a tablet device, a watch device, or a cloud-based audio source. ### Claim 3 (depends on 1) The method of claim 1, including: while the audio source is in communication with the one or more audio output devices: displaying a plurality of controls, each at a different predefined control region, of a plurality of control regions, on the audio output device case. ### Claim 4 (depends on 1) The method of claim 1, wherein: in accordance with a determination that the input, the first input, or the second input is received for a first duration of time, performing a first operation associated with the received input; and in accordance with a determination that the input, the first input, or the second input is received for a second duration of time, performing a second operation associated with the received input. ### Claim 5 (depends on 1) The method of claim 1, wherein the one or more input devices are configured to receive inputs at a plurality of locations on the audio output device case, and the method includes: in accordance with a determination that the input, the first input, or the second input is received at a first location of the plurality of locations on the audio output device case, performing a first operation associated with the received input; and in accordance with a determination that the input, the first input, or the second input is received at a second location of the plurality of locations on the audio output device case, performing a second operation associated with the received input, wherein the second operation is different from the first operation. ### Claim 6 (depends on 1) The method of claim 1, wherein the one or more input devices are configured to receive different types of inputs, and the method includes: in accordance with a determination that the input, the first input, or the second input is of a first type, performing a first operation associated with the received input of the first type; and in accordance with a determination that the input, the first input, or the second input is of a second type distinct from the first type, performing a second operation associated with the received input of the second type, wherein the second operation is different from the first operation. ### Claim 7 (depends on 1) The method of claim 1, wherein the one or more input devices are configured to detect directionality of inputs, and the method includes: in accordance with a determination that the input, the first input, or the second input includes movement in a first direction, performing a first operation associated with the received input in the first direction; and in accordance with a determination that the input, the first input, or the second input includes movement in a second direction distinct from the first direction, performing a second operation associated with the received input in the second direction, wherein the second operation is different from the first operation. ### Claim 8 (depends on 1) The method of claim 1, wherein the audio output device case includes a tactile output generator, and the method includes: in accordance with a determination that a state of the audio source changes, providing a tactile output via the tactile output generator that corresponds to the change in state of the audio source. ### Claim 9 (depends on 1) The method of claim 1, including: in accordance with a determination that a state of the audio source changes, providing corresponding visual feedback via the display component that corresponds to the change in the state of the audio source. ### Claim 10 (depends on 1) The method of claim 1, wherein the audio source, the first audio source, or the second audio source is a media source for playing media. ### Claim 11 (depends on 10) The method of claim 10, wherein the input, the first input, or the second input is a tap input and the operation associated with the tap input is an operation for playing or pausing the media. ### Claim 12 (depends on 10) The method of claim 10, wherein the input, the first input, or the second input is a swipe input and the operation associated with the swipe input is an operation for skipping to a track in a list of tracks of the media. ### Claim 13 (depends on 10) The method of claim 10, wherein the input, the first input, or the second input is a rotational input and the operation associated with the received input is changing audio volume of the media in accordance with the rotational input. ### Claim 14 (depends on 10) The method of claim 10, wherein the input, the first input, or the second input is a swipe input, and the method includes: in accordance with a determination that the swipe input is in a first direction, transmitting to the audio source, the first audio source, or the second audio source information indicating that the media currently playing is preferred; and in accordance with a determination that the swipe input is in a second direction distinct from the first direction, transmitting to the audio source, the first audio source, or the second audio source information indicating that the media currently playing is not preferred. ### Claim 15 (depends on 1) The method of claim 1, wherein the input, the first input, or the second input is a press and hold input, and the method includes: displaying an indication of a notification via the display component; and while receiving the press and hold input via the one or more input devices: causing the one or more audio output devices to play an audio notification corresponding to the indication via the display component. ### Claim 16 (depends on 1) The method of claim 1, wherein the input, the first input, or the second input is a swipe input and the operation associated with the swipe input is an operation for switching from a first audio experience to a second audio experience of a plurality of audio experiences, wherein the second audio experience is different from the first audio experience. ### Claim 17 (depends on 16) The method of claim 16, wherein the method includes crossfading from the first audio experience to the second audio experience, the crossfading including transitioning from outputting the first audio experience at a first simulated spatial location to outputting the first audio experience at a second simulated spatial location and transitioning from outputting the second audio experience at a third simulated spatial location to outputting the second audio experience at a fourth simulated spatial location. ### Claim 18 (depends on 16) The method of claim 16, wherein each audio experience of the plurality of audio experiences is associated with an indication that is displayed via the display component. ### Claim 19 (depends on 16) The method of claim 16, wherein the display component is configured to display a distinct graphic for each audio experience of the plurality of audio experiences, and the method includes: in response to the swipe input, comprising a first swipe input, transitioning from displaying a first graphic for the first audio experience of the plurality of audio experiences to displaying a second graphic for the second audio experience; and in response to a second swipe input via the one or more input devices, fading out a graphic for a current audio experience of the plurality of audio experiences, and then, in response to detecting an end of the second swipe input, fading in the graphic associated with the current audio experience of the plurality of audio experiences. ### Claim 20 (depends on 16) The method of claim 16, wherein the display component is configured to display a plurality of colors, including a first color associated with the first audio experience of the plurality of audio experiences and a second color associated with the second audio experience of the plurality of audio experiences, and the method includes, in response to the swipe input, transitioning from displaying the first color associated with the first audio experience to displaying the second color associated with the second audio experience. ### Claim 21 (depends on 16) The method of claim 16, including: while outputting first audio content of a first type, associated with the first audio experience, outputting the first audio content at one or more first simulated spatial locations; and while outputting second audio content of a second type, associated with the second audio experience, outputting the second audio content at one or more second simulated spatial locations, wherein the one or more second simulated spatial locations include at least one simulated spatial location not included in the one or more first simulated spatial locations. ### Claim 22 (depends on 16) The method of claim 16, including: in response to the swipe input, announcing, via the one or more audio output devices, an identifier of the second audio experience. ### Claim 23 (depends on 1) The method of claim 1, wherein the operation associated with the received input, the first input, or the second input is an operation for switching between modes of the one or more audio output devices. ### Claim 24 (depends on 1) The method of claim 1, wherein the operation associated with the received input, the first input, or the second input is an operation for playing audio, pausing audio, fast-forwarding audio, rewinding audio, or skipping to an audio track in a list of audio tracks. ### Claim 25 (depends on 1) The method of claim 1, wherein the operation associated with the received input, the first input, or the second input is an operation for changing an output volume of the one or more audio output devices. ### Claim 26 (depends on 1) The method of claim 1, wherein the operation associated with the received input, the first input, or the second input is an operation for invoking a digital assistant. ### Claim 27 (depends on 26) The method of claim 26, including: after causing the one or more audio output devices to perform the operation, receiving, via a microphone of the one or more audio output devices, a verbal request, and receiving at the one or more audio output devices a response from the digital assistant. ### Claim 28 An audio output device case, comprising: one or more input devices; a display component; a communication component that is in communication with at least one or more audio output devices and an audio source; one or more processors; and memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for: while the audio source is in communication with the one or more audio output devices: dynamically displaying, via the display component, one or more available operations based on contextual information associated with the audio output device case, the audio source, or the one or more audio output devices; receiving an input via the one or more input devices of the audio output device case; and in response to receiving the input, causing the one or more audio output devices to perform an operation associated with the received input while maintaining communication of the audio source with the one or more audio output devices, wherein the operation associated with the received input comprises a respective operation of the one or more available operations; the one or more programs include instructions for: while the audio source is a first audio source and the contextual information comprises first contextual information associated with the first audio source and a first application associated with the first audio source: displaying one or more user selectable controls associated with the first application; receiving a first input via the one or more input devices of the audio output device case that selects a respective control of one or more user selectable controls associated with the first application; and in response to receiving the first input, causing the one or more audio output devices to perform a first operation associated with the selected respective control of the one or more user selectable controls associated with the first application while maintaining communication of the audio source with the one or more audio output devices; and while the audio source is a second audio source, different from the first audio source, and the contextual information comprises second contextual information associated with the second audio source and a second application associated with the second audio source, wherein the second application is different from the first application: displaying one or more user selectable controls associated with the second application, wherein at least one of the one or more user selectable controls associated with the second application is distinct from the one or more user selectable controls associated with the first application; receiving a second input via the one or more input devices of the audio output device case that selects a respective control of the one or more user selectable controls associated with the second application; and in response to receiving the second input, causing the one or more audio output devices to perform a second operation associated with the selected respective control of the one or more user selectable controls associated with the second application while maintaining communication of the audio source with the one or more audio output devices. ### Claim 29 (depends on 28) The audio output device case of claim 28, wherein the one or more programs include instructions for: while the audio source is in communication with the one or more audio output devices: displaying a plurality of controls, each at a different predefined control region, of a plurality of control regions, on the audio output device case. ### Claim 30 (depends on 28) The audio output device case of claim 28, wherein the one or more input devices are configured to receive inputs at a plurality of locations on the audio output device case, and wherein the one or more programs include instructions for: in accordance with a determination that the input, the first input, or the second input is received at a first location of the plurality of locations on the audio output device case, performing a first operation associated with the received input; and in accordance with a determination that the input, the first input, or the second input is received at a second location of the plurality of locations on the audio output device case, performing a second operation associated with the received input, wherein the second operation is different from the first operation. ### Claim 31 (depends on 28) The audio output device case of claim 28, wherein the one or more input devices are configured to receive different types of inputs, and wherein the one or more programs include instructions for: in accordance with a determination that the input, the first input, or the second input is of a first type, performing a first operation associated with the received input of the first type; and in accordance with a determination that the input, the first input, or the second input is of a second type distinct from the first type, performing a second operation associated with the received input of the second type, wherein the second operation is different from the first operation. ### Claim 32 (depends on 28) The audio output device case of claim 28, wherein the one or more input devices are configured to detect directionality of inputs, and wherein the one or more programs include instructions for: in accordance with a determination that the input, the first input, or the second input includes movement in a first direction, performing a first operation associated with the received input in the first direction; and in accordance with a determination that the input, the first input, or the second input includes movement in a second direction distinct from the first direction, performing a second operation associated with the received input in the second direction, wherein the second operation is different from the first operation. ### Claim 33 (depends on 28) The audio output device case of claim 28, wherein the audio output device case includes a tactile output generator, and wherein the one or more programs include instructions for: in accordance with a determination that a state of the audio source changes, providing a tactile output via the tactile output generator that corresponds to the change in state of the audio source. ### Claim 34 (depends on 28) The audio output device case of claim 28, wherein the one or more programs include instructions for: in accordance with a determination that a state of the audio source changes, providing corresponding visual feedback via the display component that corresponds to the change in the state of the audio source. ### Claim 35 (depends on 28) The audio output device case of claim 28, wherein the input, the first input, or the second input is a press and hold input, and wherein the one or more programs include instructions for: displaying an indication of a notification via the display component; and while receiving the press and hold input via the one or more input devices: causing the one or more audio output devices to play an audio notification corresponding to the indication via the display component. ### Claim 36 (depends on 28) The audio output device case of claim 28, wherein the input, the first input, or the second input is a swipe input and the operation associated with the swipe input is an operation for switching from a first audio experience to a second audio experience of a plurality of audio experiences, wherein the second audio experience is different from the first audio experience. ### Claim 37 (depends on 28) The audio output device case of claim 28, wherein the operation associated with the received input, the first input, or the second input is an operation for switching between modes of the one or more audio output devices. ### Claim 38 (depends on 28) The audio output device case of claim 28, wherein the operation associated with the received input, the first input, or the second input is an operation for playing audio, pausing audio, fast-forwarding audio, rewinding audio, or skipping to an audio track in a list of audio tracks. ### Claim 39 (depends on 28) The audio output device case of claim 28, wherein the operation associated with the received input, the first input, or the second input is an operation for changing an output volume of the one or more audio output devices. ### Claim 40 (depends on 28) The audio output device case of claim 28, wherein the operation associated with the received input, the first input, or the second input is an operation for invoking a digital assistant. ### Claim 41 (depends on 40) The audio output device case of claim 40, wherein the one or more programs include instructions for: after causing the one or more audio output devices to perform the operation, receiving, via a microphone of the one or more audio output devices, a verbal request, and receiving at the one or more audio output devices a response from the digital assistant. ### Claim 42 A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, that, when executed by an audio output device case with one or more input devices, a display component, and a communication component that is in communication with at least one or more audio output devices and an audio source, cause the audio output device case to: while the audio source is in communication with the one or more audio output devices: dynamically display, via the display component, one or more available operations based on contextual information associated with the audio output device case, the audio source, or the one or more audio output devices; receive an input via the one or more input devices of the audio output device case; and in response to receiving the input, cause the one or more audio output devices to perform an operation associated with the received input while maintaining communication of the audio source with the one or more audio output devices; wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: while the audio source is a first audio source and the contextual information comprises first contextual information associated with the first audio source and a first application associated with the first audio source: display one or more user selectable controls associated with the first application; receive a first input via the one or more input devices of the audio output device case that selects a respective control of one or more user selectable controls associated with the first application; and in response to receiving the first input, cause the one or more audio output devices to perform a first operation associated with the selected respective control of the one or more user selectable controls associated with the first application while maintaining communication of the audio source with the one or more audio output devices; and while the audio source is a second audio source, different from the first audio source, and the contextual information comprises second contextual information associated with the second audio source and a second application associated with the second audio source, wherein the second application is different from the first application: display one or more user selectable controls associated with the second application, wherein at least one of the one or more user selectable controls associated with the second application is distinct from the one or more user selectable controls associated with the first application; receive a second input via the one or more input devices of the audio output device case that selects a respective control of the one or more user selectable controls associated with the second application; and in response to receiving the second input, cause the one or more audio output devices to perform a second operation associated with the selected respective control of the one or more user selectable controls associated with the second application while maintaining communication of the audio source with the one or more audio output devices. ### Claim 43 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: while the audio source is in communication with the one or more audio output devices: display a plurality of controls, each at a different predefined control region, of a plurality of control regions, on the audio output device case. ### Claim 44 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the one or more input devices are configured to receive inputs at a plurality of locations on the audio output device case, and wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: in accordance with a determination that the input, the first input, or the second input is received at a first location of the plurality of locations on the audio output device case, perform a first operation associated with the received input; and in accordance with a determination that the input, the first input, or the second input is received at a second location of the plurality of locations on the audio output device case, perform a second operation associated with the received input, wherein the second operation is different from the first operation. ### Claim 45 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the one or more input devices are configured to receive different types of inputs, and wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: in accordance with a determination that the input, the first input, or the second input is of a first type, perform a first operation associated with the received input of the first type; and in accordance with a determination that the input, the first input, or the second input is of a second type distinct from the first type, perform a second operation associated with the received input of the second type, wherein the second operation is different from the first operation. ### Claim 46 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the one or more input devices are configured to detect directionality of inputs, and wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: in accordance with a determination that the input, the first input, or the second input includes movement in a first direction, perform a first operation associated with the received input in the first direction; and in accordance with a determination that the input, the first input, or the second input includes movement in a second direction distinct from the first direction, perform a second operation associated with the received input in the second direction, wherein the second operation is different from the first operation. ### Claim 47 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the audio output device case includes a tactile output generator, and wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: in accordance with a determination that a state of the audio source changes, provide a tactile output via the tactile output generator that corresponds to the change in state of the audio source. ### Claim 48 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: in accordance with a determination that a state of the audio source changes, provide corresponding visual feedback via the display component that corresponds to the change in the state of the audio source. ### Claim 49 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the input, the first input, or the second input is a press and hold input, and wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: display an indication of a notification via the display component; and while receive the press and hold input via the one or more input devices: cause the one or more audio output devices to play an audio notification corresponding to the indication via the display component. ### Claim 50 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the input, the first input, or the second input is a swipe input and the operation associated with the swipe input is an operation for switching from a first audio experience to a second audio experience of a plurality of audio experiences, wherein the second audio experience is different from the first audio experience. ### Claim 51 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the operation associated with the received input, the first input, or the second input is an operation for switching between modes of the one or more audio output devices. ### Claim 52 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the operation associated with the received input, the first input, or the second input is an operation for playing audio, pausing audio, fast-forwarding audio, rewinding audio, or skipping to an audio track in a list of audio tracks. ### Claim 53 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the operation associated with the received input, the first input, or the second input is an operation for changing an output volume of the one or more audio output devices. ### Claim 54 (depends on 42) The non-transitory computer readable storage medium of claim 42, wherein the operation associated with the received input, the first input, or the second input is an operation for invoking a digital assistant. ### Claim 55 (depends on 54) The non-transitory computer readable storage medium of claim 54, wherein the one or more programs include instructions that, when executed by the audio output device case, cause the audio output device case to: after causing the one or more audio output devices to perform the operation, receive, via a microphone of the one or more audio output devices, a verbal request, and receive at the one or more audio output devices a response from the digital assistant.