AI-based piano co-pilot system and method thereof for enhancing piano skills

A method of operating a piano co-pilot system for enhancing piano skills of a student, the piano co-pilot system including:

• a co-pilot hardware having a LED strip and having a plurality of LED lights and a listener/interface unit, the listener/interface unit including a processor unit and a touch screen/listener device;
• a cloud computing center having at least one application programing interface (API) and an artificial intelligence (AI) module, the co-pilot hardware being in communication with the cloud computing center,
• a piano, which is a keyboard having a plurality of arranged keys;
• whereby the LED strip is positioned on the keyboard with the plurality of LED lights corresponding to the plurality of arranged keys;
• whereby the listener/interface unit is positioned upon the piano and the touch screen/listener device is accessible for visual and tactile interface by the student;
• the method comprising:
• operating the piano co-pilot system in a learning mode and in an auto correct mode, with the student interfacing with the listener/interface unit;
• operating the piano co-pilot system in a playback mode with the student interfacing with the listener/interface unit;
• operating the piano co-pilot system in a new song recording configuration/sequence;
• operating the piano co-pilot system in a song storage configuration/sequence;
• operating the piano co-pilot system with a new song recording module;
• and
• operating the piano co-pilot system in a note generation configuration/sequence;
• whereby the plurality of LED lights includes a plurality of colors, the plurality of LED lights and colors serve to prompt the student and to correspond to ones of the plurality of keys;
• whereby the learning mode comprises the step of:
• a song is selected from the system by the student, whereby the student interfaces with the listener/interface to choose a song that will be prompted by the co-pilot for the student to play;
• select tempo and color combinations, whereby the student further selects a desired song tempo and one or more desired color combinations of the plurality of LIED lights for the next step;
• the LED strip illuminates based on song notes, whereby the student is prompted by the co-pilot system to play the chosen song with the plurality of LED lights prompting the student by sequentially lighting ones of the plurality of LED lights corresponding to ones of the plurality of keys;
• and
• the co-pilot system stores student mistakes, strengths, and practice times, whereby the co-pilot system records and stores student mistakes (incorrect key pressed versus LED light prompt), strengths (correct key pressed versus LED light prompt), and practice times, whereby a clock in the processor unit serves to track times;
• whereby the auto correct mode comprises the steps of:
• a song for feedback is selected by the student, whereby the student interfaces with the listener/interface unit to select a song previously played and recorded by the co-pilot system, to subsequently give student feedback;
• the co-pilot system listens to music and removes noise, the system removes noise (non-piano sounds) and saves the resultant music played by the student;
• listened music is converted to notes using AI based pitch-detection, whereby the resultant music is converted to music notes using AI based pitch detection;
• and
• a session review is requested by the student from the co-pilot system, whereby the student requests a session from the co-pilot, in which the LED strip lights are activated to show the student missing keys and notes.