# US 12,118,974 B2 · Devices, methods, and user interfaces for adaptively providing audio outputs > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,974 B2 - Document ID: US12118974B2 - Status: Granted - Kind: B2 - Application number: 18/099,845 - Filed: 2023-01-20 - Published: 2023-07-06 - Granted: 2024-10-15 - Earliest claimed: 2019-05-06 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Mitchell R. Lerner; Pedro Mari - Web page: https://patentgrep.com/patent/US12118974B2 ## CPC - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G10K 11/17827: {Desired external signals, e.g. pass-through audio such as music or speech} - G10K 11/17873: {using a reference signal without an error signal, e.g. pure feedforward} - G10K 11/17885: {additionally using a desired external signal, e.g. pass-through audio such as music or speech} - H04S 7/304: {For headphones} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10K 2210/1081: Earphones, e.g. for telephones, ear protectors or headsets - G10K 2210/3056: Variable gain - H04R 2460/01: Hearing devices using active noise cancellation - H04R 2460/03: Aspects of the reduction of energy consumption in hearing devices - H04R 2460/07: Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection - H04R 2499/15: Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops - H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) - H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10K: SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR - H04S: STEREOPHONIC SYSTEMS - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract An electronic device includes one or more pose sensors for detecting a pose of a user of the electronic device relative to a first physical environment and is in communication with one or more audio output devices. While a first pose of the user meets first presentation criteria, the electronic device provides audio content at a first simulated spatial location relative to the user. The electronic device detects a change in the pose of the user from the first pose to a second pose. In response to detecting the change in the pose of the user, and in accordance with a determination that the second pose of the user does not meet the first presentation criteria, the electronic device provides audio content at a second simulated spatial location relative to the user that is different from the first simulated spatial location. ## Claims ### Claim 1 A wearable audio output device, comprising: one or more processors; and memory storing one or more programs, the one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: providing first audio output, including: first audio corresponding to audio content from an electronic device in communication with the wearable audio output device, the first audio being provided at a first device-content audio level; and second audio corresponding to ambient sound from a physical environment of the wearable audio output device, the second audio being provided at a first ambient-sound audio level; while providing the first audio output, detecting speech in the physical environment, the speech meeting one or more criteria; and in response to detecting the speech, providing second audio output, the second audio output including the second audio being provided at a second ambient-sound audio level that is different than the first ambient-sound audio level. ### Claim 2 (depends on 1) The wearable audio output device of claim 1, wherein the second audio output includes the first audio being provided at a second device-content audio level that is less than the first device-content audio level. ### Claim 3 (depends on 2) The wearable audio output device of claim 2, wherein providing the second audio output comprises pausing the first audio. ### Claim 4 (depends on 1) The wearable audio output device of claim 1, wherein: the second audio comprises audio configured to cancel at least a portion of the ambient sound; and providing the second audio at the second ambient-sound audio level comprises configuring the second audio to cancel less of the ambient sound than is canceled by the second audio provided at the first ambient-sound audio level. ### Claim 5 (depends on 4) The wearable audio output device of claim 4, wherein the second ambient-sound audio level is zero. ### Claim 6 (depends on 1) The wearable audio output device of claim 1, wherein the second audio being provided at the second ambient-sound audio level comprises active passthrough of the ambient sound. ### Claim 7 (depends on 1) The wearable audio output device of claim 1, wherein the one or more programs further include instructions for, in response to ceasing to detect the speech, providing third audio output, the third audio output including the second audio being provided at the first ambient-sound audio level. ### Claim 8 (depends on 1) The wearable audio output device of claim 1, wherein the one or more criteria include a criterion regarding an audio level of the speech relative to an audio level of the ambient sound. ### Claim 9 (depends on 1) The wearable audio output device of claim 1, wherein the one or more programs further include instructions for: detecting a change in one or more audio properties of the physical environment; and in response to detecting the change in the one or more audio properties, providing third audio output, the third audio output including the second audio being provided at a third ambient-sound audio level that is different than the first ambient-sound audio level. ### Claim 10 (depends on 1) The wearable audio output device of claim 1, wherein the one or more programs further include instructions for: detecting a change in one or more audio properties of the physical environment; and in response to detecting the change in the one or more audio properties, providing third audio output, the third audio output including the first audio being provided at a second device-content audio level that is different than the first device-content audio level. ### Claim 11 A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by a wearable audio output device with one or more processors and memory, cause the wearable audio output device to: provide first audio output, including: first audio corresponding to audio content from an electronic device in communication with the wearable audio output device, the first audio being provided at a first device-content audio level; and second audio corresponding to ambient sound from a physical environment of the wearable audio output device, the second audio being provided at a first ambient-sound audio level; while providing the first audio output, detect speech in the physical environment, the speech meeting one or more criteria; and in response to detecting the speech, provide second audio output, the second audio output including the second audio being provided at a second ambient-sound audio level that is different than the first ambient-sound audio level. ### Claim 12 (depends on 11) The non-transitory computer-readable storage medium of claim 11, wherein the second audio output includes the first audio being provided at a second device-content audio level that is less than the first device-content audio level. ### Claim 13 (depends on 12) The non-transitory computer-readable storage medium of claim 12, wherein providing the second audio output comprises pausing the first audio. ### Claim 14 (depends on 11) The non-transitory computer-readable storage medium of claim 11, wherein: the second audio comprises audio configured to cancel at least a portion of the ambient sound; and providing the second audio at the second ambient-sound audio level comprises configuring the second audio to cancel less of the ambient sound than is canceled by the second audio provided at the first ambient-sound audio level. ### Claim 15 (depends on 14) The non-transitory computer-readable storage medium of claim 14, wherein the second ambient-sound audio level is zero. ### Claim 16 (depends on 11) The non-transitory computer-readable storage medium of claim 11, wherein the second audio being provided at the second ambient-sound audio level comprises active passthrough of the ambient sound. ### Claim 17 (depends on 11) The non-transitory computer-readable storage medium of claim 11, wherein the one or more programs further include instructions for, in response to ceasing to detect the speech, providing third audio output, the third audio output including the second audio being provided at the first ambient-sound audio level. ### Claim 18 (depends on 11) The non-transitory computer-readable storage medium of claim 11, wherein the one or more criteria include a criterion regarding an audio level of the speech relative to an audio level of the ambient sound. ### Claim 19 (depends on 11) The non-transitory computer-readable storage medium of claim 11, wherein the one or more programs further include instructions for: detecting a change in one or more audio properties of the physical environment; and in response to detecting the change in the one or more audio properties, providing third audio output, the third audio output including the second audio being provided at a third ambient-sound audio level that is different than the first ambient-sound audio level. ### Claim 20 (depends on 11) The non-transitory computer-readable storage medium of claim 11, wherein the one or more programs further include instructions for: detecting a change in one or more audio properties of the physical environment; and in response to detecting the change in the one or more audio properties, providing third audio output, the third audio output including the first audio being provided at a second device-content audio level that is different than the first device-content audio level. ### Claim 21 A method, comprising: providing first audio output, including: first audio corresponding to audio content from an electronic device in communication with a wearable audio output device, the first audio being provided at a first device-content audio level; and second audio corresponding to ambient sound from a physical environment of the wearable audio output device, the second audio being provided at a first ambient-sound audio level; while providing the first audio output, detecting speech in the physical environment, the speech meeting one or more criteria; and in response to detecting the speech, providing second audio output, the second audio output including the second audio being provided at a second ambient-sound audio level that is different than the first ambient-sound audio level. ### Claim 22 (depends on 21) The method of claim 21, wherein the second audio output includes the first audio being provided at a second device-content audio level that is less than the first device-content audio level. ### Claim 23 (depends on 22) The method of claim 22, wherein providing the second audio output comprises pausing the first audio. ### Claim 24 (depends on 21) The method of claim 21, wherein: the second audio comprises audio configured to cancel at least a portion of the ambient sound; and providing the second audio at the second ambient-sound audio level comprises configuring the second audio to cancel less of the ambient sound than is canceled by the second audio provided at the first ambient-sound audio level. ### Claim 25 (depends on 24) The method of claim 24, wherein the second ambient-sound audio level is zero. ### Claim 26 (depends on 21) The method of claim 21, wherein the second audio being provided at the second ambient-sound audio level comprises active passthrough of the ambient sound. ### Claim 27 (depends on 21) The method of claim 21, further comprising: in response to ceasing to detect the speech, providing third audio output, the third audio output including the second audio being provided at the first ambient-sound audio level. ### Claim 28 (depends on 21) The method of claim 21, wherein the one or more criteria include a criterion regarding an audio level of the speech relative to an audio level of the ambient sound. ### Claim 29 (depends on 21) The method of claim 21, further comprising: detecting a change in one or more audio properties of the physical environment; and in response to detecting the change in the one or more audio properties, providing third audio output, the third audio output including the second audio being provided at a third ambient-sound audio level that is different than the first ambient-sound audio level. ### Claim 30 (depends on 21) The method of claim 21, further comprising: detecting a change in one or more audio properties of the physical environment; and in response to detecting the change in the one or more audio properties, providing third audio output, the third audio output including the first audio being provided at a second device-content audio level that is different than the first device-content audio level.