# US 10,770,045 B1 · Real-time audio signal topology visualization > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,770,045 B1 - Document ID: US10770045B1 - Status: Granted - Kind: B1 - Application number: 16/517,877 - Filed: 2019-07-22 - Granted: 2020-09-08 - Earliest claimed: 2019-07-22 - Assignees: Avid Technology, Inc. - Applicants: Avid Technology, Inc. - Inventors: Edward Barram; Peter M. Bouton - Web page: https://patentgrep.com/patent/US10770045B1 ## CPC - G10H 1/0008: {Associated control or indicating means} - G10H 1/46: Volume control - H04H 60/04: Studio equipment; Interconnection of studios - G10H 2210/281: Reverberation or echo - G10H 2220/116: for graphical editing of sound parameters or waveforms, e.g. by graphical interactive control of timbre, partials or envelope - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE - H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N) ## Abstract A user interface for a digital audio workstation provides an overview of the audio signal routing of an audio composition in the form of a node graph. The node graph updates in real time as an audio session is edited. The representation of the nodes on the graph indicates the node type, such as audio input or track, mixer, plug-in, and output, as well as the processing resources assigned to each node. The node graph includes one or more nodes representing submixes that may be adjusted using a mixer channel independently of other submixes or outputs of the audio session. The representation of audio signal flow between the nodes in the graph distinguishes between insert routing and auxiliary sends. The user interface may be used interactively to edit the audio composition by providing a toolbox for creating new nodes and commands for specifying audio signal connections between nodes. ## Claims ### Claim 1 A user interface for visualizing audio signal routing for an audio composition, the user interface comprising: within a graphical user interface of a digital audio workstation application displaying a node graph representing an audio signal routing of the audio composition, wherein: the node graph includes a first node representing a first independent submix; the first independent submix is mapped to a first channel of a mixer that enables the user to adjust the first independent submix; and the node graph is updated in real-time when the audio signal routing of the audio composition is changed. ### Claim 2 (depends on 1) The user interface of claim 1, wherein the mixer is implemented on digital signal processing hardware in data communication with a system hosting the digital audio workstation application. ### Claim 3 (depends on 1) The user interface of claim 1, wherein the mixer is implemented in software on a system hosting the digital audio workstation application. ### Claim 4 (depends on 3) The user interface of claim 3, wherein the mixer is displayed as a window within the user interface of the digital audio workstation. ### Claim 5 (depends on 1) The user interface of claim 1, wherein the first independent submix is mapped to the first channel by a user of the digital audio workstation application. ### Claim 6 (depends on 1) The user interface of claim 1, wherein: the node graph includes a second node representing a second independent submix; an output of the first independent submix is routed to the second independent submix; the second independent submix is mapped by the user to a second channel of the mixer; and the user is able to adjust the second channel of the mixer to adjust the second independent submix. ### Claim 7 (depends on 1) The user interface of claim 1, wherein adjusting the first independent submix includes adjusting a gain of the first independent submix. ### Claim 8 (depends on 1) The user interface of claim 1, wherein adjusting the first independent submix includes applying a software plug-in module to process the first independent submix. ### Claim 9 (depends on 1) The user interface of claim 1, wherein adjusting the first independent submix includes panning the first independent submix. ### Claim 10 (depends on 1) The user interface of claim 1, wherein adjusting the first independent submix includes at least one of adjusting an equalization and dynamics processing. ### Claim 11 (depends on 1) The user interface of claim 1, wherein the node graph further includes one or more nodes representing audio inputs and one or more nodes representing plug-in audio processing modules. ### Claim 12 (depends on 11) The user interface of claim 11, wherein: the first node representing the first independent submix is represented with a first representation type on the node graph; the one or more nodes representing the audio inputs are represented with a second representation type on the node graph; the one or more nodes representing plug-in audio processing modules are represented with a third representation type on the node graph; and each of the first, second, and third representations types are different from each other. ### Claim 13 (depends on 11) The user interface of claim 11 wherein a representation of a node of the node graph includes an indication of a processing resource to which the node is assigned. ### Claim 14 (depends on 13) The user interface of claim 13, wherein the processing resource is a digital signal processing resource in data communication with a system hosting the digital audio workstation application. ### Claim 15 (depends on 13) The user interface of claim 13, wherein the processing resource is a processor of a system hosting the digital audio workstation application. ### Claim 16 (depends on 1) The user interface of claim 1, wherein the user interface further comprises an edit window that displays a table that includes an entry for each of: a plurality of audio inputs to the audio composition; and one or more submixes of the audio composition; and wherein the user is able to interact with the table to specify: a plug-in for the entry; an auxiliary send for the entry; and an output for the entry. ### Claim 17 (depends on 1) The user interface of claim 1, wherein: the user interface further comprises a mix window that displays a representation of a plurality of channels of a mixer including a representation of the first channel; each of a plurality of audio inputs and one or more submixes of the audio composition is mapped to a different channel of the mixer; and the user is able to interact with the mix window to adjust parameters of each of the plurality of audio inputs and the one or more submixes. ### Claim 18 A method of mixing a plurality of audio inputs to create an audio composition, the method comprising: enabling a user of a digital audio workstation application to: route a subset of the plurality of audio inputs to a submix; map the submix to a channel of a mixer, wherein controls of the channel of the mixer enable the user to adjust the submix; and on a graphical user interface of the digital audio workstation application, displaying in real-time a graph representation of a signal routing of the audio composition, wherein the graph representation includes a node representing a submix that is mapped to a channel of a mixer. ### Claim 19 (depends on 18) The user interface of claim 18, wherein adjusting the submix includes at least one of adjusting a gain of the submix, adjusting a pan of the submix, and processing the submix with plug-in software module. ### Claim 20 (depends on 18) The user interface of claim 18, wherein the mixer is implemented in software on a system that hosts the digital audio workstation application. ### Claim 21 (depends on 18) The user interface of claim 18, wherein the mixer is implemented in digital signal processing hardware that is in data communication with a system that hosts the digital audio workstation application. ### Claim 22 (depends on 18) The user interface of claim 18, further comprising enabling a user to edit the audio composition by providing: a toolbox of node types for enabling a user to specify a node type and add a new node of the specified node type to the node graph; and a command for creating one or more audio connections on the node graph between the new node and one or more existing nodes of the node graph. ### Claim 23 A computer program product comprising: a non-transitory computer-readable medium with computer program instructions encoded thereon, wherein the computer program instructions, when processed by a computer system instruct the computer system to provide a user interface for visualizing audio signal routing for an audio composition, the user interface comprising: within a graphical user interface of a digital audio workstation application displaying a node graph representing an audio signal routing of the audio composition, wherein: the node graph includes a first node representing a first independent submix; the first independent submix is mapped to a first channel of a mixer that enables the user to adjust the first independent submix; and the node graph is updated in real-time when the audio signal routing of the audio composition is changed. ### Claim 24 A system comprising: a memory for storing computer-readable instructions; and a processor connected to the memory, wherein the processor, when executing the computer-readable instructions, causes the system to display a user interface for visualizing audio signal routing for an audio composition, the user interface comprising: within a graphical user interface of a digital audio workstation application displaying a node graph representing an audio signal routing of the audio composition, wherein: the node graph includes a first node representing a first independent submix; the first independent submix is mapped to a first channel of a mixer that enables the user to adjust the first independent submix; and the node graph is updated in real-time when the audio signal routing of the audio composition is changed.