Music instruction system

A method comprising:

• receiving a user selection of a musical piece;
• providing performance cues to a user to perform musical events on a musical instrument, wherein the performance cues are synchronized to expert performance data of the musical piece, wherein performance cues data and the expert performance data are obtained from a server;
• providing the expert performance data to the user;
• receiving audio data corresponding to musical events performed by the user on the musical instrument;
• detecting fundamental frequencies associated with the user-performed musical events;
• determining an extent to which the user-performed musical events have been correctly or incorrectly performed;
• providing real-time or near real-time audio feedback, visual feedback and/or tactile feedback indicating the extent to which the user-performed musical events have been correctly or incorrectly performed;
• using the expert performance data as real-time or near real-time audible or real-time or near real-time visual feedback;
• reporting user performance data of a session to a server;
• and
• storing the user performance data in a database,
• wherein, when using the expert performance data, the user-performed musical events are muted and an output level of the expert performance data is increased when the user-performed musical events have been correctly performed.

A method comprising:

• receiving a user selection of a musical piece;
• providing performance cues to a user to perform musical events on a musical instrument, wherein the performance cues are synchronized to expert performance data of the musical piece, wherein performance cues data and the expert performance data are obtained from a server;
• providing the expert performance data to the user;
• receiving audio data corresponding to musical events performed by the user on the musical instrument;
• detecting fundamental frequencies associated with the user-performed musical events;
• determining an extent to which the user-performed musical events have been correctly or incorrectly performed;
• providing real-time or near real-time audio feedback, visual feedback and/or tactile feedback indicating the extent to which the user-performed musical events have been correctly or incorrectly performed;
• using the expert performance data as real-time or near real-time audible or real-time or near real-time visual feedback;
• reporting user performance data of a session to a server;
• and
• storing the user performance data in a database,
• wherein the detecting further comprises:
• forming blocks of audio data having a first size to detect the onsets;
• forming blocks of audio data having a second size to detect the fundamental frequencies, wherein the first size is smaller than the second size;
• detecting onsets of the user-performed musical events;
• and
• performing fundamental frequency detection on a set of contiguous blocks in the audio data that do not include the onsets.

A device comprising:

• one or more memories to store instructions;
• and
• one or more processors to execute the instructions in the one or more memories to:
• receive a user selection of a musical piece;
• provide performance cues to a user to perform musical events associated with the musical piece on a musical instrument, wherein the performance cues are synchronized to expert performance data of the musical piece, and wherein performance cues data and the expert performance data are obtained from a server;
• provide the expert performance data to the user;
• receive audio data from the musical instrument, wherein the audio data comprises user-performed musical events;
• detect fundamental frequencies associated with the user-performed musical events;
• determine an extent to which the user-performed musical events have been correctly or incorrectly performed based on one or more musical characteristic tolerances associated with the musical events;
• and
• provide real-time or near real-time visual feedback and/or audio feedback to the user, that indicates the extent to which the user-performed musical events have been correctly or incorrectly performed based on the determination of the extent to which the user-performed musical events have been correctly or incorrectly performed, wherein when providing the audio feedback to the user, the one or more processors further execute the instructions to:
• introduce one or more first signal processing audio effects to an audio output of the user-performed musical events when it is determined that the user-performed musical events have been correctly performed;
• and
• introduce one or more second signal processing audio effects to the output of the user-performed musical events when it is determined that the user-performed musical events have not been correctly performed, wherein the one or more first signal processing audio effects enhance the user-performed musical events and the one or more second signal processing audio effects diminish the user-performed musical events.

A device comprising:

• one or more memories to store instructions;
• and
• one or more processors to execute the instructions in the one or more memories to:
• receive a user selection of a musical piece;
• provide performance cues to a user to perform musical events associated with the musical piece on a musical instrument, wherein the performance cues are synchronized to expert performance data of the musical piece, and wherein performance cues data and the expert performance data are obtained from a server;
• provide the expert performance data to the user;
• receive audio data from the musical instrument, wherein the audio data comprises user-performed musical events;
• detect fundamental frequencies associated with the user-performed musical events;
• determine an extent to which the user-performed musical events have been correctly or incorrectly performed based on one or more musical characteristic tolerances associated with the musical events;
• and
• provide real-time or near real-time visual feedback and/or audio feedback to the user, that indicates the extent to which the user-performed musical events have been correctly or incorrectly performed based on the determining,
• wherein when detecting the fundamental frequencies, the one or more processors are to execute the instructions to:
• form first blocks of audio data having a first size to detect onsets of the user-performed musical events;
• and
• form second blocks of audio data having a second size to detect fundamental frequencies, wherein the first size is smaller than the second size, and the second blocks include a set of contiguous first blocks that do not include the onsets.

A device comprising:

• one or more memories to store instructions;
• and
• one or more processors to execute the instructions in the one or more memories to:
• receive a user selection of a musical piece;
• provide performance cues to a user to perform musical events associated with the musical piece on a musical instrument, wherein the performance cues are synchronized to expert performance data of the musical piece, and wherein performance cues data and the expert performance data are obtained from a server;
• provide the expert performance data to the user;
• receive audio data from the musical instrument, wherein the audio data comprises user-performed musical events;
• detect fundamental frequencies associated with the user-performed musical events;
• determine an extent to which the user-performed musical events have been correctly or incorrectly performed based on one or more musical characteristic tolerances associated with the musical events;
• and
• provide real-time or near real-time visual feedback and/or audio feedback to the user, that indicates the extent to which the user-performed musical events have been correctly or incorrectly performed based on the determining,
• wherein the one or more processors are further to execute the instructions to:
• calculate a weighted sum of magnitudes associated with frequencies included with the user-performed musical events, wherein the weighted sum is calculated based on multipliers having values corresponding to indexes that are multiplied by the magnitudes.

A non-transitory computer-readable medium storing instructions executable by at least one processor, the instructions comprising instructions to:

• provide different levels of difficulties for performing a musical piece;
• receive a user selection of one of the levels of difficulties;
• receive a user selection of the musical piece;
• provide performance cues to a user to perform musical events associated with the musical piece on a musical instrument, wherein the performance cues are synchronized to expert performance data of the musical piece, wherein performance cues data and the expert performance data are obtained from a server;
• provide the expert performance data to the user;
• receive audio data from the musical instrument, wherein the audio data comprises user-performed musical events;
• determine whether to detect fundamental frequencies associated with the user-performed musical events based on at least one of the audio data or the musical instrument;
• determine an extent to which the user-performed musical events have been correctly or incorrectly performed;
• automatically increase a difficulty level of the musical piece during a session when the extent to which the user-performed musical events have been correctly performed exceeds a first threshold value;
• provide feedback to the user indicating the extent to which the user-performed musical events have been correctly performed based on a determination of the extent;
• automatically decrease a difficulty level of the musical piece during the session when the extent to which the user-performed musical events been incorrectly performed is below a second threshold value;
• and
• automatically end the session when the extent to which the user-performed musical events have been incorrectly performed is below a stoppage threshold value.

A non-transitory computer-readable medium storing instructions executable by at least one processor, the instructions comprising instructions to:

• receive a user selection of a musical piece;
• provide performance cues to a user to perform musical events associated with the musical piece on a musical instrument, wherein the performance cues are synchronized to expert performance data of the musical piece, wherein performance cues data and the expert performance data are obtained from a server;
• provide the expert performance data to the user;
• receive audio data from the musical instrument, wherein the audio data comprises user-performed musical events;
• determine whether to detect fundamental frequencies associated with the user-performed musical events based on at least one of the audio data or the musical instrument;
• determine an extent to which the user-performed musical events have been correctly or incorrectly performed;
• provide feedback to the user indicating the extent to which the user-performed musical events have been correctly performed based on a determination of the extent;
• detect fundamental frequencies associated with the user-performed musical events;
• calculate a weighted sum of magnitudes associated with frequencies included with the user-performed musical events;
• detect onsets of the user-performed musical events;
• perform fundamental frequency detection on a set of contiguous blocks of the audio data that do not include the onsets;
• calculate peak estimations associated with frequencies included in the set of contiguous blocks;
• and
• wherein the instruction to calculate the weighted sum comprise instructions to:
• calculate the weighted sum based on multipliers having values corresponding to indexes that are multiplied by the magnitudes.