# US 12,119,018 B2 · Methods and systems for manipulating audio properties of objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,119,018 B2
- Document ID: US12119018B2
- Status: Granted
- Kind: B2
- Application number: 17/961,143
- Filed: 2022-10-06
- Published: 2023-02-02
- Granted: 2024-10-15
- Earliest claimed: 2020-06-30
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Karen Natalie Wong; Adam James Bolton
- Web page: https://patentgrep.com/patent/US12119018B2

## CPC

- G10L 21/10: Transforming into visible information
- G10L 21/14: by displaying frequency domain information
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04R 5/02: Spatial or constructional arrangements of loudspeakers
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04R 29/008: {Visual indication of individual signal levels (visual indication of stereophonic sound image H04S7/40)}
- H04S 7/303: {Tracking of listener position or orientation}
- H04S 7/40: {Visual indication of stereophonic sound image}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- H04S: STEREOPHONIC SYSTEMS

## Abstract

In one implementation, a method of changing an audio property of an object is performed at a device including one or more processors coupled to non-transitory memory. The method includes displaying, using a display, a representation of a scene including a representation of an object associated with an audio property. The method includes displaying, using the display, in association with the representation of the object, a manipulator indicating a value of the audio property. The method includes receiving, using one or more input devices, a user input interacting with the manipulator. The method includes, in response to receiving the user input, changing the value of the audio property based on the user input and displaying, using the display, the manipulator indicating the changed value of the audio property.

## Claims

### Claim 1

A method comprising:
at a device including one or more processors coupled to non-transitory memory:
displaying, using a display, a representation of a three-dimensional scene including a representation of a virtual object associated with a three-dimensional audio emission pattern at an object location in the three-dimensional scene;
detecting an animation display trigger; and
in response to detecting the animation display trigger, displaying an animation in the representation of the three-dimensional scene at the object location, wherein the animation includes a visual representation of the three-dimensional audio emission pattern.

### Claim 2 (depends on 1)

The method of claim 1, further comprising displaying a representation of a displayed object, wherein the virtual object is a first audio emitter object associated with the displayed object.

### Claim 3 (depends on 1)

The method of claim 1, wherein detecting the animation display trigger includes detecting selection of the virtual object.

### Claim 4 (depends on 1)

The method of claim 1, wherein detecting the animation display trigger includes detecting a change in the audio emission pattern.

### Claim 5 (depends on 1)

The method of claim 1, wherein detecting the animation display trigger includes detecting a user request to display the animation.

### Claim 6 (depends on 1)

The method of claim 1, wherein displaying the animation based on the three-dimensional audio emission pattern includes displaying an indication of a volume of sound propagating from the object location at various locations in the representation of the three-dimensional scene.

### Claim 7 (depends on 1)

The method of claim 1, further comprising, after displaying the animation based on the audio emission pattern, displaying a static representation of the three-dimensional audio emission pattern.

### Claim 8 (depends on 7)

The method of claim 7, wherein the static representation of the three-dimensional audio emission pattern indicates a direction of the audio emission pattern.

### Claim 9 (depends on 7)

The method of claim 7, wherein the static representation of the three-dimensional audio emission pattern indicates a shape of the audio emission pattern.

### Claim 10 (depends on 1)

The method of claim 1, further comprising displaying, using the display, a preview affordance which, when selected, displays an environment including the scene and plays audio associated with the virtual object in accordance with the three-dimensional audio emission pattern.

### Claim 11 (depends on 10)

The method of claim 10, wherein playing the audio in accordance with the three-dimensional audio emission pattern includes playing the audio at a volume based on an object orientation in the environment with respect to a user location.

### Claim 12 (depends on 11)

The method of claim 11, further comprising, while displaying the environment:
detecting a change in the object orientation to a second object orientation; and
playing the audio at a second volume based on the second object orientation.

### Claim 13

A device comprising:
non-transitory memory; and
one or more processors to:
display, using a display, a representation of a three-dimensional scene including a representation of a virtual object associated with three-dimensional audio emission pattern at an object location in the three-dimensional scene;
detect an animation display trigger; and
in response to detecting the animation display trigger, display an animation in the representation of the three-dimensional scene at the object location, wherein the animation includes a visual representation of the three-dimensional audio emission pattern.

### Claim 14 (depends on 13)

The device of claim 13, wherein the one or more processors are to detect the animation display trigger by detecting selection of the virtual object.

### Claim 15 (depends on 13)

The device of claim 13, wherein the one or more processors are to detect the animation display trigger by detecting a change in the audio emission pattern.

### Claim 16 (depends on 13)

The device of claim 13, wherein the one or more processors are to display the animation based on the three-dimensional audio emission pattern by displaying an indication of a volume of sound propagating from the object location at various locations in the representational of the three-dimensional scene.

### Claim 17 (depends on 13)

The device of claim 13, wherein the one or more processors are further to, after displaying the animation based on the three-dimensional audio emission pattern, display a static representation of the three-dimensional audio emission pattern.

### Claim 18 (depends on 17)

The device of claim 17, wherein the static representation of the three-dimensional audio emission pattern indicates a direction of the three-dimensional audio emission pattern.

### Claim 19 (depends on 17)

The device of claim 17, wherein the static representation of the three-dimensional audio emission pattern indicates a shape of the three-dimensional audio emission pattern.

### Claim 20

A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device, cause the device to:
display, using a display, a representation of a three-dimensional scene including a representation of a virtual object associated with a three-dimensional audio emission pattern at an object location in the three-dimensional scene;
detect an animation display trigger; and
in response to detecting the animation display trigger, display an animation in the representation of the three-dimensional scene at the object location, wherein the animation includes a visual representation of the three-dimensional audio emission pattern.
