# US 2019/0246204 A1 · Systems and methods for automatic mixing of media > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0246204 A1 - Document ID: US20190246204A1 - Status: Published application - Kind: A1 - Application number: 16/229,701 - Filed: 2018-12-21 - Published: 2019-08-08 - Earliest claimed: 2013-05-30 - Assignees: Spotify AB - Applicants: Spotify AB - Inventors: Par Mikael Bohrarper; Sten Garmark; Niklas Martin Gustavsson; John Fredrik Wilhelm Noren; Gustav Söderström; Babar Zafar - Web page: https://patentgrep.com/patent/US20190246204A1 ## CPC - H04R 3/00: Circuits for transducers (arrangements for producing a reverberation or echo sound G10K15/08; amplifiers H03F) - G06F 16/639: {using playlists} - G10H 1/0025: {Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece (automatically producing a series of tones G10H1/26)} - G10H 1/0058: {Transmission between separate instruments or between individual components of a musical system (G10H1/0083 takes precedence)} - G10H 7/008: {Means for controlling the transition from one tone waveform to another} - G11B 27/036: Insert-editing - G11B 27/038: Cross-faders therefor - H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)} - H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip} - H04N 21/4661: {Deriving a combined profile for a plurality of end-users of the same client, e.g. for family members within a home (user profiles in network data switching protocols H04L67/306)} - H04N 21/8113: {comprising music, e.g. song in MP3 format} - G10H 2210/125: Medley, i.e. linking parts of different musical pieces in one single piece, e.g. sound collage, DJ mix - G10H 2210/131: Morphing, i.e. transformation of a musical piece into a new different one, e.g. remix - G10H 2210/145: Composing rules, e.g. harmonic or musical rules, for use in automatic composition; Rule generation algorithms therefor - G10H 2210/155: Musical effects - G10H 2210/331: Note pitch correction, i.e. modifying a note pitch or replacing it by the closest one in a given scale - G10H 2210/385: Speed change, i.e. variations from preestablished tempo, tempo change, e.g. faster or slower, accelerando or ritardando, without change in pitch - G10H 2220/116: for graphical editing of sound parameters or waveforms, e.g. by graphical interactive control of timbre, partials or envelope - G10H 2240/125: Library distribution, i.e. distributing musical pieces from a central or master library - G10H 2240/131: Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set - G10H 2240/305: Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes - G10H 2250/035: Crossfade, i.e. time domain amplitude envelope control of the transition between musical sounds or melodies, obtained for musical purposes, e.g. for ADSR tone generation, articulations, medley, remix - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Audio mix information is received from a plurality of users. Mix rules are determined from the audio mix information from the plurality of users, wherein the mix rules include a first mix rule associated with a first audio item. The first mix rule relates to an overlap of the first audio item with another audio item. The first mix rule is made available to one or more clients. After making the first mix rule available, an indication, from a respective client device, that the first audio item is to be mixed with a second audio item at the respective client device in accordance with the first mix rule is received. In response to the indication, a specification of the first mix rule is transmitted to the respective client device to be applied by the respective client device to generate a transition between the first audio item and the second item. ## Claims ### Claim 1 (canceled) ### Claim 2 A server system, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: receiving audio mix information for a first audio item from a first client device of a first user, wherein the audio mix information includes user-selected values for one or more playback parameters used to generate transitions between the first audio item and a second audio item, wherein the user-selected values for the one or more playback parameters were specified by user input from the first user; determining a first mix rule using the user-selected values for the one or more playback parameters received from the first user, the first mix rule relating to determining overlap of the first audio item with the second audio item; receiving an indication, from a second client device, that the first audio item is to be mixed with the second audio item at the second client device; and in response to the indication, transmitting a specification of the first mix rule to the second client device to be applied by the second client device to generate a transition between the first audio item and the second audio item. ### Claim 3 (depends on 2) The server system of claim 2, the one or more programs further including instructions for: in accordance with a determination that the user-selected values for the one or more playback parameters did not specify a crossfade duration, determining the first mix rule includes determining to apply no overlap of the first audio item with the second item. ### Claim 4 (depends on 3) The server system of claim 3, wherein determining the first mix rule includes determining to apply a predetermined pause duration between the first audio item and the second audio item. ### Claim 5 (depends on 3) The server system of claim 3, wherein determining the first mix rule includes determining to apply a first selected volume curve to the first audio track. ### Claim 6 (depends on 3) The server system of claim 3, wherein determining the first mix rule includes determining to apply a first selected volume curve to the second audio track. ### Claim 7 (depends on 2) The server system of claim 2, wherein: determining the first mix rule includes determining that a restriction applies to modification of one or more respective audio tracks; and, in accordance with a determination that the restriction applies to modification of the first audio track, applying the restriction to limit modification of the first audio track. ### Claim 8 (depends on 2) The server system of claim 2, wherein the first mix rule specifies an effect to be applied to at least one of the first audio item and the second audio item during the overlap of the first audio item and the second audio item. ### Claim 9 (depends on 8) The server system of claim 8, wherein the effect includes a tempo adjustment to be applied during crossfade between the first audio item and the second audio item. ### Claim 10 (depends on 8) The server system of claim 8, wherein the effect includes a pitch adjustment to be applied during crossfade between the first audio item and the second audio item. ### Claim 11 (depends on 2) The server system of claim 2, wherein the user-selected values for the one or more playback parameters are specified by selection of a predefined set of mix rules. ### Claim 12 (depends on 2) The server system of claim 2, wherein the second audio item is adjacent to the first audio item in a playlist associated with the first user. ### Claim 13 (depends on 12) The server system of claim 12, wherein the first audio item precedes the second audio item in the playlist. ### Claim 14 (depends on 12) The server system of claim 12, wherein the second audio item precedes the first audio item in the playlist. ### Claim 15 (depends on 2) The server system of claim 2, wherein the first mix rule includes an overlap starting position of the first audio item, indicating a playback time at which to begin overlapping the first audio item with a following audio item. ### Claim 16 (depends on 2) The server system of claim 2, wherein the user-selected values for the one or more playback parameters include overlap starting position values. ### Claim 17 (depends on 2) The server system of claim 2, wherein the first mix rule includes an overlap ending position of the first audio item, indicating a playback time at which to end overlapping the first audio item with a preceding audio item. ### Claim 18 A method comprising, at a server having one or more processors and memory storing instructions for execution by the one or more processors: receiving audio mix information for a first audio item from a first client device of a first user, wherein the audio mix information includes user-selected values for one or more playback parameters used to generate transitions between the first audio item and a second audio item, wherein the user-selected values for the one or more playback parameters were specified by user inputs from the first user; determining a first mix rule using the user-selected values for the one or more playback parameters received from the first user, the first mix rule relating to determining overlap of the first audio item with the second audio item; receiving an indication, from a second client device, that the first audio item is to be mixed with a second audio item at the second client device; and in response to the indication, transmitting a specification of the first mix rule to the second client device to be applied by the second client device to generate a transition between the first audio item and the second audio item. ### Claim 19 A non-transitory computer-readable storage medium storing one or more programs for execution by one or more processors of a server, the one or more programs including instructions for: receiving audio mix information for a first audio item from a first client device of a first user, wherein the audio mix information includes user-selected values for one or more playback parameters used to generate transitions between the first audio item and a second audio item, wherein the user-selected values for the one or more playback parameters were specified by user inputs from the first user; determining a first mix rule using the user-selected values for the one or more playback parameters received from the first user, the first mix rule relating to determining overlap of the first audio item with the second audio item; receiving an indication, from a second client device, that the first audio item is to be mixed with a second audio item at the second client device; and in response to the indication, transmitting a specification of the first mix rule to the second client device to be applied by the second client device to generate a transition between the first audio item and the second audio item.