# US 11,798,523 B2 · Systems and methods for generating audio content in a digital audio workstation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,798,523 B2 - Document ID: US11798523B2 - Status: Granted - Kind: B2 - Application number: 17/149,373 - Filed: 2021-01-14 - Published: 2021-08-05 - Granted: 2023-10-24 - Earliest claimed: 2020-01-31 - Assignees: Soundtrap AB - Applicants: Soundtrap AB - Inventors: Jonas Lundquist; Joakim Persson; Nikhil Nair; Jacqueline Sibert - Web page: https://patentgrep.com/patent/US11798523B2 ## CPC - G10H 1/0008: {Associated control or indicating means} - G10H 1/42: comprising tone forming circuits - H04H 60/04: Studio equipment; Interconnection of studios - G10H 2210/105: Composing aid, e.g. for supporting creation, edition or modification of a piece of music - G10H 2220/126: for graphical editing of individual notes, parts or phrases represented as variable length segments on a 2D or 3D representation, e.g. graphical edition of musical collage, remix files or pianoroll representations of MIDI-like files - G10H 2240/171: Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments - G10H 2250/641: Waveform sampler, i.e. music samplers; Sampled music loop processing, wherein a loop is a sample of a performance that has been edited to repeat seamlessly without clicks or artifacts - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE - H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N) ## Abstract A method includes displaying a graphical user interface (GUI) for a step sequencer in a digital audio workstation. The GUI includes a sequence of user interface elements corresponding to a portion of a roll for an audio composition. Each user interface element in the sequence of user interface elements represents a respective time interval for a note. The sequence of user interface elements. The method includes receiving a user input interacting with a first user interface element. The method includes, in response to the user input: splitting a played note represented by the first user interface element into two or more played notes. The method further includes providing the audio composition for playback by a speaker. ## Claims ### Claim 1 A method, comprising; at an electronic device with a display, one or more processors, memory: displaying a graphical user interface for a step sequencer in a digital audio workstation, wherein: the graphical user interface for the step sequencer includes a plurality of user interface elements, the plurality of user interface elements corresponds to a portion of a roll for an audio composition, each user interface element in the plurality of user interface elements represents a respective time interval for a note, the plurality of user interface elements includes a first subset of the plurality of user interface elements representing played notes for the corresponding respective time interval and a second subset of the plurality of user interface elements representing rests for the corresponding respective time interval; the plurality of user interface elements correspond to toggleable buttons arranged in an array comprising a plurality of rows and columns, each toggleable button being activated or inactivated by a user, wherein a row of the plurality of rows corresponds to a sequence of user interface elements; receiving a user input interacting with a first user interface element of the first subset of the plurality of user interface elements; in response to the user input interacting with the first user interface element of the first subset of the plurality of user interface elements: splitting a played note represented by the first user interface element into two or more played notes; replacing display of the first user interface element with two or more additional user interface elements, each of the two or more additional user interface elements representing a respective one of the two or more played notes; and providing the audio composition for playback by a speaker. ### Claim 2 (depends on 1) The method of claim 1, wherein an adjacent played note in the first plurality of user interface elements is not split into two or more notes in response to the user input. ### Claim 3 (depends on 1) The method of claim 1, wherein: the plurality of user interface elements includes a plurality of sequences of user interface elements, wherein a respective row of the plurality of rows corresponds to a respective sequence of the plurality of sequences of user interface elements, each sequence in the plurality of sequences of user interface elements corresponds to a distinct sound made by an instrument. ### Claim 4 (depends on 1) The method of claim 1, further including: receiving a second user input interacting with a respective one of the two or more additional user interface elements representing a respective one of the two or more played notes, in response to the second user input, adjusting a velocity or timing of the respective one of the two or more played notes. ### Claim 5 (depends on 1) The method of claim 1, wherein the plurality of user interface elements is indefinitely scrollable. ### Claim 6 (depends on 1) The method of claim 1, wherein the step sequencer is for editing sounds made by a single instrument. ### Claim 7 (depends on 6) The method of claim 6, wherein the plurality of user interface elements is for editing use of a note made by the single instrument. ### Claim 8 (depends on 6) The method of claim 6, wherein the audio composition includes sounds made by other instruments. ### Claim 9 (depends on 6) The method of claim 6, wherein the single instrument is a percussion set. ### Claim 10 (depends on 1) The method of claim 1, wherein adjustments made within the step sequencer are reflected in the audio composition without additional user input. ### Claim 11 (depends on 1) The method of claim 1, wherein the graphical user interface is displayed in a web browser. ### Claim 12 (depends on 1) The method of claim 1, wherein the audio composition is simultaneously-editable by a plurality of users. ### Claim 13 (depends on 1) The method of claim 1, further comprising: receiving a third user input interacting with a second user interface element of the first plurality of user interface elements and a third user interface element of the first plurality of user interface elements; in response to the third user input interacting with the second user interface element of the first plurality of user interface elements and the third user interface element of the first plurality of user interface elements: merging two played notes, each represented by one of the second user interface element and the third user interface element; and replacing display of the second user interface element and the third user interface element with a single additional user interface element representing the merged two played notes. ### Claim 14 An electronic device, comprising: a display; one or more processors; and memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for: displaying a graphical user interface for a step sequencer in a digital audio workstation, wherein: the graphical user interface for the step sequencer includes a plurality of user interface elements, the plurality of user interface elements corresponds to a portion of a roll for an audio composition, each user interface element in the plurality of user interface elements represents a respective time interval for a note, the plurality of user interface elements includes a first subset of the plurality of user interface elements representing played notes for the corresponding respective time interval and a second subset of the plurality of user interface elements representing rests for the corresponding respective time interval; the plurality of user interface elements correspond to toggleable buttons arranged in an array comprising a plurality of rows and columns, each toggleable button being activated or inactivated by a user, wherein a row of the plurality of rows corresponds to a sequence of user interface elements; receiving a user input interacting with a first user interface element of the first subset of the plurality of user interface elements; in response to the user input interacting with the first user interface element of the first subset of the plurality of user interface elements: splitting a played note represented by the first user interface element into two or more played notes; replacing display of the first user interface element with two or more additional user interface elements, each of the two or more additional user interface elements representing a respective one of the two or more played notes; and providing the audio composition for playback by a speaker. ### Claim 15 (depends on 14) The electronic device of claim 14, wherein an adjacent played note in the first plurality of user interface elements is not split into two or more notes in response to the user input. ### Claim 16 (depends on 14) The electronic device of claim 14, wherein: the plurality of user interface elements includes a plurality of sequences of user interface elements, wherein a respective row of the plurality of rows corresponds to a respective sequence of the plurality of sequences of user interface elements, each sequence in the plurality of sequences of user interface elements corresponds to a distinct sound made by an instrument. ### Claim 17 (depends on 14) The electronic device of claim 14, the one or more programs further including instructions for: receiving a second user input interacting with a respective one of the two or more additional user interface elements representing a respective one of the two or more played notes, in response to the second user input, adjusting a velocity or timing of the respective one of the two or more played notes. ### Claim 18 (depends on 14) The electronic device of claim 14, wherein the plurality of user interface elements is indefinitely scrollable. ### Claim 19 (depends on 14) The electronic device of claim 14, wherein the step sequencer is for editing sounds made by a single instrument. ### Claim 20 A non-transitory computer readable storage medium storing one or more programs for execution by an electronic device with a display and one or more processors, the one or more programs including instructions for: displaying a graphical user interface for a step sequencer in a digital audio workstation, wherein: the graphical user interface for the step sequencer includes a plurality of user interface elements, the plurality of user interface elements corresponds to a portion of a roll for an audio composition, each user interface element in the plurality of user interface elements represents a respective time interval for a note, the plurality of user interface elements includes a first subset of the plurality of user interface elements representing played notes for the corresponding respective time interval and a second subset of the plurality of user interface elements representing rests for the corresponding respective time interval; the plurality of user interface elements correspond to toggleable buttons arranged in an array comprising a plurality of rows and columns, each toggleable button being activated or inactivated by a user, wherein a row of the plurality of rows corresponds to a sequence of user interface elements; receiving a user input interacting with a first user interface element of the first subset of the plurality of user interface elements; in response to the user input interacting with the first user interface element of the first subset of the plurality of user interface elements: splitting a played note represented by the first user interface element into two or more played notes; replacing display of the first user interface element with two or more additional user interface elements, each of the two or more additional user interface elements representing a respective one of the two or more played notes; and providing the audio composition for playback by a speaker.