Information processing method, information processing device and a non-transitory storage medium
AssigneeYamaha Corporation
InventorsMisa Uehara, Akira Maezawa
Life of this patent
Estimating the term…
Abstract
An information processing method implemented by a computer, the information processing method including, generating pedal data representing an operation period of a pedal that extends sound production by key depression, from playing data representing a playing content.
Claims18
An information processing method implemented by a computer for a keyboard musical instrument provided with a pedal function for a pedal to extend sound production of a depressed key representing a pitch of a keyboard thereof, the information processing method comprising:
- obtaining playing data representing a playing content that includes key data for operating the keyboard, but does not include any pedal data for operating the pedal;
- and
- generating pedal operation data representing a pedal operation period of the pedal from the obtained playing data by a learned model, which is a statistical prediction model generated from machine learning using a plurality of sets of learning data, that has learned a relationship between an input corresponding to the playing data and an output corresponding to the pedal operation data,
- wherein the playing data is musical instrument digital interface (MIDI) data compliant with a MIDI standard, and includes pitch operation data representing a sound production period for each of a plurality of pitches of the keyboard.
An information processing device for a keyboard musical instrument provided with a pedal function for a pedal to extend sound production of a depressed key representing a pitch of a keyboard thereof, the information processing device comprising:
- an electronic controller including at least one processor,
- wherein the electronic controller is configured to execute a plurality of tasks, including:
- an obtaining task that obtains playing data representing a playing content that includes key data for operating the keyboard, but does not include any pedal data for operating the pedal;
- and
- a generating task that generates pedal operation data representing a pedal operation period of the pedal from the obtained playing data by a learned model, which is a statistical prediction model generated from machine learning using a plurality of sets of learning data, that has learned a relationship between an input corresponding to the playing data and an output corresponding to the pedal operation data,
- wherein the playing data is musical instrument digital interface (MIDI) data compliant with a MIDI standard, and includes pitch operation data representing a sound production period for each of a plurality of pitches of the keyboard.
An information processing method implemented by a computer for a keyboard musical instrument provided with a pedal function for a pedal to extend sound production of a depressed key representing a pitch of a keyboard thereof, the information processing method comprising:
- obtaining playing data representing a playing content that includes key data for operating the keyboard, but does not include any pedal data for operating the pedal or any included pedal data for operating the pedal is indistinguishable from the included key data;
- and
- generating pedal operation data representing a pedal operation period of the pedal from the obtained playing data, wherein:
- the generating further generates key operation data representing a key depression period together with the pedal operation period from the playing data;
- the generating generates both the pedal operation data and the key operation data from the playing data by a learned model that has learned a relationship between an input corresponding to the playing data and outputs corresponding to the key operation data and the pedal operation data,
- the learned model is a recurrent neural network that, for each period, uses first data corresponding to the obtained playing data as an input, to output second data corresponding to the key operation data, and third data corresponding to the pedal operation data,
- the first data includes sound production data indicating presence or absence of sound production of each of the pitches of the keyboard,
- the second data indicates presence or absence of a key depression of a key corresponding to each of the pitches,
- the third data indicates presence or absence of an operation of the pedal, and
- the first data includes start point data indicating, for each of the pitches, whether or not the sound production of each of the pitches is a sound-production start point.
Dependencies are inferred from the claim text.