# US 2024/0135909 A1 · Information processing device, information processing method, and non-transitory computer readable recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0135909 A1
- Document ID: US20240135909A1
- Status: Published application
- Kind: A1
- Application number: 18/396,477
- Filed: 2023-12-26
- Published: 2024-04-25
- Earliest claimed: 2022-10-19
- Assignees: Roland Corporation
- Applicants: Roland Corporation
- Inventors: Hiroya Kurio; Masato UENO; Shinji ASAKAWA
- Web page: https://patentgrep.com/patent/US20240135909A1

## CPC

- G10H 1/0008: {Associated control or indicating means}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G10G 1/00: Means for the representation of music
- G10H 1/0058: {Transmission between separate instruments or between individual components of a musical system (G10H1/0083 takes precedence)}
- G10H 1/0083: {using wireless transmission, e.g. radio, light, infrared}
- G10H 1/0091: {Means for obtaining special acoustic effects (combined with modulation G10H1/043)}
- G10H 1/24: for selecting plural preset register stops
- G10H 1/368: {displaying animated or moving pictures synchronized with the music or audio part}
- G10K 15/02: Synthesis of acoustic waves (synthesis of speech G10L13/00)
- G10H 2210/155: Musical effects
- G10H 2220/106: using icons, e.g. selecting, moving or linking icons, on-screen symbols, screen regions or segments representing musical elements or parameters
- G10H 2220/116: for graphical editing of sound parameters or waveforms, e.g. by graphical interactive control of timbre, partials or envelope
- G10H 2240/021: for MIDI-like files or data streams
- G10H 2240/031: File merging MIDI, i.e. merging or mixing a MIDI-like file or stream with a non-MIDI file or stream, e.g. audio or video
- G10H 2240/131: Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
- G10H 2240/171: Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
- G10H 2240/311: MIDI transmission (G10H2240/056 takes precedence)
- G10H 2240/321: Bluetooth®
- G10H 2240/325: Synchronizing two or more audio tracks or files according to musical features or musical timings
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10G: REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS (music stands A47B; non-musical aspects of musical toy instruments A63H5/00; metronomes G04F5/02; teaching music G09B15/00)
- G10K: SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR

## Abstract

This information processing device comprises: a control unit which receives an input of information indicating one or more timings in a playback time of a piece of music, and generates a file including information pertaining to a timbre control performed from each of the one or more timings; and a transmission unit which transmits an audio signal of the piece of music and the information pertaining to the timbre control in the file to a device which outputs a synthesized sound of the playback sound of the piece of music and the playing sound of a musical instrument.

## Claims

### Claim 1

An information processing device comprising processing electronics and electronic memory storing instructions for controlling the processing electronics to:
obtain musical piece data including data defining at least one storage location or network location associated with a musical piece, data defining effect setting information, and data defining effect switch timing information corresponding to one or more timepoints in a playback time of the musical piece;
obtain an audio signal of the musical piece with which the at least one storage location or network location is associated; and
transmit the audio signal of the musical piece and the effect setting information to a device that performs an effect control on a playback sound of a musical instrument and outputs a synthetic sound of a playback sound of the musical piece and the playing sound of the musical instrument with one or more effects associated with the effect setting information being applied according to the one or more timepoints in the playback time of the musical piece.

### Claim 2 (depends on 1)

The information processing device of claim 1, wherein to transmit the effect setting information, comprises controlling the processing electronics to:
obtain the effect setting information based on the data defining the effect setting information; and
transmit the effect setting information at a timing based on the one or more timepoints in the playback time of the musical piece.

### Claim 3 (depends on 2)

The information processing device of claim 2, wherein the data defining the effect setting information comprises an identifier corresponding to at least one storage location at which the effect setting information is stored.

### Claim 4 (depends on 1)

The information processing device of claim 1, wherein to transmit the effect setting information comprises controlling the processing electronics to:
determine, during the playback time of the musical piece, that one of the one or more timepoints in the playback time of the musical piece is reached; and
transmit the effect setting information upon determining that the one of the one or more timepoints is reached.

### Claim 5 (depends on 1)

The information processing device of claim 1, wherein the one or more timepoints comprise a plurality of timepoints in the playback time of the musical piece, and wherein to transmit the effect setting information comprises controlling the processing electronics to:
determine, during the playback time of the musical piece, when each of the plurality of timepoints is reached; and
transmit at least some of the effect setting information when each of the plurality of timepoints is reached during the playback time of the musical piece.

### Claim 6 (depends on 1)

The information processing device of claim 1, wherein to obtain an audio signal comprises controlling the processing electronics to receive the audio signal over a communication network, based on the at least one storage location or network location.

### Claim 7 (depends on 5)

The information processing device of claim 5, wherein the at least one storage location or network location comprises at least one URL.

### Claim 8 (depends on 1)

The information processing device of claim 1, wherein to obtain musical piece data comprises controlling the processing electronics to acquire a file that includes the musical piece data.

### Claim 9 (depends on 1)

The information processing device of claim 1, wherein to obtain musical piece data comprises controlling the processing electronics to:
transmit, over a communication network, a request for a file that includes the musical piece data; and
receive the file from the communication network.

### Claim 10 (depends on 1)

The information processing device of claim 1, wherein to obtain musical piece data comprises controlling the processing electronics to:
store, in a storing device, a file that includes the musical piece data; and
retrieve the file from the storing device.

### Claim 11 (depends on 10)

The information processing device of claim 10, wherein to store the file comprises controlling the processing electronics to:
receive, through a user interface, user edits associated with at least one of the effect setting information and the effect switch timing information;
update the file based on the user edits; and
save the file in a storage device after updating the file.

### Claim 12 (depends on 11)

The information processing device of claim 11, wherein to receive user edits comprises controlling the processing electronics to display the user interface on a display device, the user interface including a screen for displaying information indicating a playback time of the musical piece, and user input for setting at least one of the effect setting information and the effect switch timing information.

### Claim 13 (depends on 12)

The information processing device of claim 12, wherein the information indicating a playback time comprises:
a timeline associated with the playback time of the musical piece; and
a plurality of markers at locations along the timeline, the locations being defined by the effect switch timing information.

### Claim 14 (depends on 13)

The information processing device of claim 13, wherein:
the data defining the effect setting information comprises one or more identifiers, each identifier being associated with a different memory location corresponding to effect information; and
each marker is associated with at least one identifier.

### Claim 15 (depends on 1)

The information processing device of claim 1, wherein to:
obtain the audio signal of the musical piece comprises controlling the processing electronics to receive a streamed audio signal;
transmit the audio signal of the musical piece comprises controlling the processing electronics to transmit an audio signal based on the streamed audio signal over a period of time; and
transmit the effect setting information comprises controlling the processing electronics to transmit the effect setting information at the one or more timepoints during the period of time that the audio signal is transmitted to the device that performs the effect control on the playback sound of the musical instrument.

### Claim 16 (depends on 1)

The information processing device of claim 1, wherein to:
obtain the audio signal of the musical piece comprises controlling the processing electronics to download the audio signal from a storage device or a network device;
transmit the audio signal of the musical piece comprises controlling the processing electronics to transmit the downloaded audio signal over a period of time; and
transmit the effect setting information comprises controlling the processing electronics to transmit the effect setting information at the one or more timepoints during the period of time that the downloaded audio signal is transmitted to the device that performs the effect control.

### Claim 17

An information processing method, comprising, by an information processing device:
obtaining musical piece data including data defining at least one storage location or network location associated with a musical piece, data defining effect setting information, and data defining effect switch timing information corresponding to one or more timepoints in a playback time of the musical piece;
obtaining an audio signal of the musical piece with which the at least one storage location or network location is associated; and
transmitting the audio signal of the musical piece and the effect setting information to a device that performs an effect control on a playback sound of a musical instrument and outputs a synthetic sound of a playback sound of the musical piece and the playing sound of the musical instrument with one or more effects associated with the effect setting information being applied according to the one or more timepoints in the playback time of the musical piece.

### Claim 18 (depends on 17)

The information processing method of claim 17, wherein transmitting the effect setting information comprises transmitting the effect setting information at a timing based on the one or more timepoints in the playback time of the musical piece.

### Claim 19 (depends on 17)

The information processing method of claim 17, wherein transmitting the effect setting information comprises:
determining, during the playback time of the musical piece, that one of the one or more timepoints in the playback time of the musical piece is reached; and
transmitting the effect setting information upon determining that the one of the one or more timepoints is reached.

### Claim 20

A non-transitory computer readable recording medium storing a program, the program causing processing electronics of an information processing device to:
obtain musical piece data including data defining at least one storage location or network location associated with a musical piece, data defining effect setting information, and data defining effect switch timing information corresponding to one or more timepoints in a playback time of the musical piece;
obtain an audio signal of the musical piece with which the at least one storage location or network location is associated; and
transmit the audio signal of the musical piece and the effect setting information to a device that performs an effect control on a playback sound of a musical instrument and outputs a synthetic sound of a playback sound of the musical piece and the playing sound of the musical instrument with one or more effects associated with the effect setting information being applied according to the one or more timepoints in the playback time of the musical piece.
