# US 2024/0087581 A1 · Time-aligned additive recording

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0087581 A1
- Document ID: US20240087581A1
- Status: Published application
- Kind: A1
- Application number: 18/456,045
- Filed: 2023-08-25
- Published: 2024-03-14
- Earliest claimed: 2021-02-24
- Inventors: Brian Karl Ales
- Web page: https://patentgrep.com/patent/US20240087581A1

## CPC

- G10L 19/018: Audio watermarking, i.e. embedding inaudible data in the audio signal
- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)}
- G11B 27/105: {of operating discs}
- G11B 20/00891: {embedded in audio data}
- G11B 2020/10546: {specifically adapted for audio data}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

The present teachings generally include time-aligned additive recordings, e.g., for remote music production, dialog post-production, and the like. In this manner, the present teachings can provide a substantially real-time, collaborative experience between two or more remote users—e.g., producer and collaborator(s). Specifically, through the use of audio ‘watermarks’ (as discrete signals or embedded within data corresponding to first audio content such as recorded music or film/video audio) that can be sent to a collaborator, replicated in a time-aligned manner, and returned (as discreet signals or embedded within data corresponding to second audio content such as musical or dialog content), an additive multitrack audio recording can be created with precise time-alignment maintained during monitoring of the recording itself and in the resulting second audio, thus effectively emulating an in-person audio production session. The present teachings can also enable the development of supplemental services such as collaborator networks and/or marketplaces.

## Claims

### Claim 1

A method for time-aligned additive recording, the method comprising:
providing control over first audio content at a digital audio workstation of a first user;
establishing a connection, over a data network, between the digital audio workstation of the first user and a computing device of a second user;
prior to and in-between individual additive recordings, inserting one or more first watermarks within first data configured for transmission from the digital audio workstation of the first user to the computing device of the second user, the first data corresponding to the first audio content, wherein the first audio content includes lossless audio;
transmitting the first data corresponding to the first audio content, with the one or more first watermarks, to the computing device of the second user;
detecting the one or more first watermarks at the computing device of the second user and replicating one or more watermarks in second audio content from the second user, each of the one or more watermarks embedded within the second audio content at a temporal location corresponding to the temporal location of a first watermark embedded within the first data of the first audio content, wherein the second audio content includes lossless audio;
receiving the second audio content at the digital audio workstation of the first user with the one or more replicated watermarks;
during creation of each additive recording, facilitating time-aligned monitoring by the first user of the first audio content relative to the second audio content by, upon the first user initiating an additive recording, immediately initiating local playback of the first audio content at the digital audio workstation of the first user at a point earlier in time relative to a temporal position of the first audio content as transmitted to the second user, wherein a difference in temporal positions of the local playback and the temporal position of the first audio content as transmitted to the second user includes at least a round-trip time difference between transmission of at least one of the first watermarks within the first audio content to the second user and reception of a corresponding replicated second watermark within the second audio content at the digital audio workstation of the first user from a play/record temporal location in the digital audio workstation of the first user; and
aligning the one or more watermarks in the second audio content with corresponding first watermarks inserted within the first audio content resulting in a time-aligned additive recording comprising both the first audio content and the second audio content.

### Claim 2 (depends on 1)

The method of claim 1, further comprising testing latency between the digital audio workstation of the first user and the computing device of the second user to determine a worst-case latency.

### Claim 3 (depends on 2)

The method of claim 2, wherein testing latency is conducted when not actively conducting one or more additive recordings so that the worst-case latency is current.

### Claim 4 (depends on 2)

The method of claim 2, wherein one of (i) the worst-case latency and (ii) a largest time difference between a first watermark and a corresponding replicated watermark is inserted between the temporal location of the local playback and the temporal location of the first audio content as transmitted to the second user.

### Claim 5 (depends on 2)

The method of claim 2, further comprising establishing an earlier temporal starting location for the first user at the digital audio workstation equal to at least one of (i) the worst-case latency and (ii) a largest time difference between a first watermark and a corresponding replicated watermark to facilitate time-aligned monitoring of the first audio content and the second audio content during the additive recording.

### Claim 6 (depends on 1)

The method of claim 1, wherein the computing device of the second user includes either a standalone client application or digital audio workstation software compatible with software of the digital audio workstation of a first user.

### Claim 7 (depends on 1)

The method of claim 1, wherein the time-aligned additive recording includes at least one of additional musical audio content added to existing musical audio content or additional non-musical audio content that adds to or replaces existing non-musical content.

### Claim 8 (depends on 1)

The method of claim 1, further comprising, prior to creation of the time-aligned additive recording, communicating with a collaborator network or marketplace for establishing the connection between the digital audio workstation of the first user and the computing device of the second user.

### Claim 9 (depends on 1)

The method of claim 1, wherein one or more of the first watermarks and the second watermarks are either or both (i) inaudible and (ii) removable after each additive recording.

### Claim 10

A computer program product comprising computer executable code embodied in a non-transitory computer readable medium that, when executing on one or more computing devices, performs the steps of:
providing control over first audio content at a digital audio workstation of a first user;
establishing a connection, over a data network, between the digital audio workstation of the first user and a computing device of a second user;
prior to and in-between individual additive recordings, inserting one or more first watermarks within first data configured for transmission from the digital audio workstation of the first user to the computing device of the second user, the first data corresponding to the first audio content, wherein the first audio content includes lossless audio;
transmitting the first data corresponding to the first audio content, with the one or more first watermarks, to the computing device of the second user;
detecting the one or more first watermarks at the computing device of the second user and replicating one or more watermarks in second audio content from the second user, each of the one or more watermarks embedded within the second audio content at a temporal location corresponding to the temporal location of a first watermark embedded within the first data of the first audio content, wherein the second audio content includes lossless audio;
receiving the second audio content at the digital audio workstation of the first user with the one or more replicated watermarks;
during creation of each additive recording, facilitating time-aligned monitoring by the first user of the first audio content relative to the second audio content by, upon the first user initiating an additive recording, immediately initiating local playback of the first audio content at the digital audio workstation of the first user at a point earlier in time relative to a temporal position of the first audio content as transmitted to the second user, wherein a difference in temporal positions of the local playback and the temporal position of the first audio content as transmitted to the second user includes at least a round-trip time difference between transmission of at least one of the first watermarks within the first audio content to the second user and reception of a corresponding replicated second watermark within the second audio content at the digital audio workstation of the first user from a play/record temporal location in the digital audio workstation of the first user; and
aligning the one or more watermarks in the second audio content with corresponding first watermarks inserted within the first audio content resulting in a time-aligned additive recording comprising both the first audio content and the second audio content.

### Claim 11 (depends on 10)

The computer program product of claim 10, further comprising code that, when executing on one or more computing devices, performs the step of testing latency between the digital audio workstation of the first user and the computing device of the second user to determine a worst-case latency.

### Claim 12 (depends on 11)

The computer program product of claim 11, wherein testing latency is conducted when not actively conducting one or more additive recordings so that the worst-case latency is current.

### Claim 13 (depends on 11)

The computer program product of claim 11, wherein one of (i) the worst-case latency and (ii) a largest time difference between a first watermark and a corresponding replicated watermark is inserted between the temporal location of the local playback and the temporal location of the first audio content as transmitted to the second user.

### Claim 14 (depends on 11)

The computer program product of claim 11, further comprising code that, when executing on one or more computing devices, performs the step of establishing an earlier temporal starting location for the first user at the digital audio workstation equal to at least one of (i) the worst-case latency and (ii) a largest time difference between a first watermark and a corresponding replicated watermark to facilitate time-aligned monitoring of the first audio content and the second audio content during the additive recording.

### Claim 15 (depends on 10)

The computer program product of claim 10, wherein the code is executed by a processor disposed on at least one of a computing device of the first user, the computing device of the second user, a cloud-based server, and a remote computing resource in communication with one or more of the computing device of the first user and the computing device of the second user over a data network.

### Claim 16 (depends on 10)

The computer program product of claim 10, wherein the computing device of the second user includes either a standalone client application or digital audio workstation software compatible with software of the digital audio workstation of a first user.

### Claim 17 (depends on 10)

The computer program product of claim 10, wherein the time-aligned additive recording includes at least one of additional musical audio content added to existing musical audio content or additional non-musical audio content that adds to or replaces existing non-musical content.

### Claim 18 (depends on 10)

The computer program product of claim 10, further comprising code that, when executing on one or more computing devices, performs the step of, prior to creation of the time-aligned additive recording, communicating with a collaborator network or marketplace for establishing the connection between the digital audio workstation of the first user and the computing device of the second user.

### Claim 19 (depends on 10)

The computer program product of claim 10, wherein one or more of the first watermarks and the second watermarks are either or both (i) inaudible and (ii) removable after each additive recording.

### Claim 20

A method for time-aligned additive recording, the method comprising:
providing control over first audio content at a digital audio workstation of a first user;
establishing a connection, over a data network, between the digital audio workstation of the first user and a computing device of a second user;
prior to and in-between individual additive recordings, inserting one or more first watermarks within first data configured for transmission from the digital audio workstation of the first user to the computing device of the second user, the first data corresponding to the first audio content;
transmitting the first data corresponding to the first audio content, with the one or more first watermarks, to the computing device of the second user;
detecting the one or more first watermarks at the computing device of the second user and replicating one or more watermarks in second audio content from the second user, each of the one or more watermarks embedded within the second audio content at a temporal location corresponding to the temporal location of a first watermark embedded within the first data of the first audio content;
receiving the second audio content at the digital audio workstation of the first user with the one or more replicated watermarks;
during creation of each additive recording, facilitating time-aligned monitoring by the first user of the first audio content relative to the second audio content by, upon the first user initiating an additive recording, facilitating time-aligned monitoring of the first audio content by the first user relative to the second user by performing one or more of:
immediately initiating local playback of the first audio content at the digital audio workstation of the first user at a point earlier in time relative to a temporal position of the first audio content as transmitted to the second user, such difference in temporal position resulting from subtracting at least a round-trip time difference between transmission of at least one of the first watermarks within the first audio content to the second user and reception of a corresponding replicated second watermark within the second audio content at the digital audio workstation of the first user from a play/record temporal location in the digital audio workstation of the first user,
applying a monitor delay equal to at least a round-trip time difference between transmission of at least one of the first watermarks within the first audio content to the second user and reception of a corresponding replicated second watermark within the second audio content at the digital audio workstation of the first user during the additive recording, and
adding at least a round-trip time difference between transmission of at least one of the first watermarks within the first audio content to the second user and reception of a corresponding replicated second watermark within the second audio content at the digital audio workstation to a play/record temporal location in the digital audio workstation as the temporal position of for the first audio content as transmitted to the second user; and
aligning the one or more watermarks in the second audio content with corresponding first watermarks inserted within the first audio content resulting in a time-aligned additive recording comprising both the first audio content and the second audio content.
