Smart detecting and feedback system for smart piano

A method for operating a smart musical instrument system for replaying user performance with auto-play, electronic sound source or video, the method comprising:

• obtaining, by a plurality of sensors, performance data of a user, the performance data including first performance data indicating operations of a musical instrument obtained by a first sensor in the plurality of sensors, wherein the plurality of sensors includes the first sensor;
• comparing, by a processing device, the performance data with reference music data to generate a comparison result;
• obtaining, by the processing device, at least one setting, wherein the setting indicates a difficulty level of playing the musical instrument;
• and
• generating, by the processing device, the feedback based on the comparison result and the setting.

A non-transitory computer readable medium comprising at least one set of instructions, wherein when executed by at least one processor, the at least one set of instructions cause the at least one processor to effectuate a method comprising:

• obtaining, by a plurality of sensors, performance data of a user, the performance data including first performance data indicating operations of a musical instrument obtained by a first sensor in the plurality of sensors, wherein the plurality of sensors includes the first sensor;
• comparing, by a processing device, the performance data with reference music data to generate a comparison result;
• obtaining, by the processing device, at least one setting, wherein the setting indicates a difficulty level of playing the musical instrument;
• and
• generating, by the processing device, the feedback based on the comparison result and the setting.