Performance instruction apparatus and performance instruction program used in the performance instruction apparatus

A performance instruction apparatus comprising:

• goggle-type teaching equipment for use by a practitioner;
• a display section provided on the teaching equipment;
• an image memory for storing a plurality of guide images, each comprising an image representative of a hand of the practitioner playing a musical instrument and information for indicating a key to be played of a keyboard of the musical instrument and for teaching the practitioner how to manipulate his/her fingers to play keys of the keyboard;
• an image pickup section provided on the teaching equipment for capturing an image of at least the keyboard of the musical instrument and the hand of the practitioner playing the keyboard, so as to generate an eyesight image corresponding to an eyesight of the practitioner;
• a key number detecting section for detecting a number of keys from the keyboard image included in the eyesight image;
• a selecting section for selecting a guide image from among the plurality of guide images stored in the image memory that includes a same number of the keys as detected by the key number detecting section;
• and
• an adjusting section for reading out the selected guide image from the image memory and adjusting a size and a position of the read out guide image, and for displaying on the display section the eyesight image generated by the image pickup section and the adjusted guide image in a superimposed manner to indicate the key to be played and to teach the practitioner how to manipulate his/her finger to play the key.

A performance instruction apparatus comprising:

• goggle-type teaching equipment for use by a practitioner;
• a display section provided on the teaching equipment;
• an image memory for storing a guide image comprising an image representative of a hand of the practitioner playing a musical instrument and information for indicating a key to be played of a keyboard of the musical instrument and for teaching the practitioner how to manipulate his/her fingers to play keys of the keyboard;
• an image pickup section provided on the teaching equipment for capturing an image of at least the keyboard of the musical instrument and the hand of the practitioner playing the keyboard, so as to generate an eyesight image corresponding to an eyesight of the practitioner;
• and
• a transforming section for transforming a number of colors and a number of pixels of at least a part of the eyesight image generated by the image pickup section based on a number of colors and a number of pixels of the guide image read out from the image memory, and for displaying on the display section the transformed eyesight image and the guide image in a superimposed manner to indicate the key to be played and to teach the practitioner how to manipulate his/her finger to play the key.

A performance instruction apparatus comprising:

• a memory for storing judgment data for defining positions of a wrist, predetermined points of a hand, a back of the hand, and at least one fingertip to show model performance manipulation to show a model posture of a hand of a practitioner playing a musical instrument, and for judging, in synchronization with progress of performance of a song, a posture of the hand of the practitioner;
• an image pickup section for capturing an image of a side of the hand of the practitioner to obtain a side eyesight image;
• an extracting section for extracting an image of the hand of the practitioner from the side eyesight image;
• and
• a judging section for periodically judging, in synchronization with the progress of the performance of the song, whether or not the extracted image of the hand of the practitioner coincides with the model shown based on the stored judgment data at the positions of the wrist, the predetermined points of the hand, the back of the hand, and the fingertip, and for advising the practitioner of a judgment result.

A performance instruction method for use in a performance instruction apparatus, wherein the performance instruction apparatus comprises a memory for storing judgment data defining positions of a wrist, predetermined points of a hand, a back of the hand, and at least one fingertip to show model performance manipulation to show a model posture of hand manipulation of a practitioner playing a musical instrument in synchronization with progress of performance of a song, said method comprising:

• capturing an image of a side of a hand of the practitioner to obtain a side eyesight image of the practitioner;
• extracting an image of the hand of the practitioner from the obtained side eyesight image;
• and
• judging periodically, in synchronization with the progress of the performance of the song, whether or not the extracted image of the hand of the practitioner coincides with the model posture of hand manipulation shown based on the stored judgment data at the positions of the wrist, the predetermined points of the hand, the back of the hand, and the fingertip, and advising the practitioner of a judgment result.

A computer readable storage medium having a performance instruction program stored thereon to be executable by a computer of a performance instruction apparatus, wherein the performance instruction apparatus comprises:

• (a) goggle-type teaching equipment for use by a practitioner, (b) a display section provided on the teaching equipment, (c) an image memory for storing a guide image comprising an image representative of a hand of the practitioner playing a musical instrument and information for indicating a key to be played of a keyboard of the musical instrument and for teaching the practitioner how to manipulate his/her fingers to play keys of the keyboard of, and (d) an image pickup section provided on the teaching equipment for capturing an image of at least the keyboard of the musical instrument and the hand of the practitioner playing the keyboard, so as to generate an eyesight image corresponding to an eyesight of the practitioner, said program being executable by the computer to cause the computer to execute a process comprising:
• transforming a number of colors and a number of pixels of at least a part of the eyesight image generated by the image pickup section based on a number of colors and a number of pixels of the guide image read out from the guide memory to generate a transformed eyesight image;
• and
• controlling the display section so as to display the transformed eyesight image and the guide image in a superimposed manner to indicate the key to be played and to teach the practitioner how to manipulate his/her finger to play the key.

A computer readable storage medium having a performance instruction program stored thereon to be executable by a computer of a performance instruction apparatus, wherein the performance instruction apparatus comprises:

• (a) an image pickup section for capturing an image of a side of a practitioner playing a musical instrument to obtain a side eyesight image, and (b) a memory for storing judgment data defining positions of a wrist, predetermined points of a hand, a back of the hand, and at least one fingertip to show model performance manipulation for showing a model posture of hand manipulation of the practitioner in synchronization with progress of performance of a song, said program being executable by the computer to cause the computer to execute a process comprising:
• extracting an image of a hand of the practitioner from the obtained side eyesight image;
• and
• judging periodically, in synchronization with the progress of the performance of the song, whether or not the extracted image of the hand coincides with the model posture of hand manipulation shown based on the stored judgment data, and advising the practitioner of a judgment result.

A computer readable storage medium having a performance instruction program stored thereon to be executable by a computer of a performance instruction apparatus, wherein the performance instruction apparatus comprises:

• (a) goggle-type teaching equipment for use by a practitioner, (b) a display section provided on the teaching equipment, (c) an image memory for storing a guide image comprising an image representative of a hand of a practitioner playing a musical instrument and information for indicating a key to be played of a keyboard of the musical instrument and for teaching the practitioner how to manipulate his/her fingers to play keys of the keyboard of the musical instrument, and (d) an image pickup section provided on the teaching equipment for capturing an image of at least the keyboard of the musical instrument and the hand of the practitioner playing the keyboard, so as to generate an eyesight image corresponding to an eyesight of the practitioner, said program being executable by the computer to cause the computer to execute a process comprising:
• reading out the guide image from the image memory;
• adjusting a size and a position of the read out guide image;
• and
• controlling the display section to display the generated eyesight image and the adjusted guide image in a superimposed manner to indicate the key to be played and to teach the practitioner how to manipulate his/her finger to play the key;
• wherein, when a difference between the eyesight image and the guide image exceeds a predetermined value, it is determined that the practitioner has intentionally shifted his/her eye from the keyboard and the superimposition of the guide image on the eyesight image on the display screen is ceased, and when the difference between the eyesight image and the guide image does not exceed the predetermined value, a resolution of the guide image is adjusted in accordance with the difference between the guide image and the eyesight image and the adjusted guide image is superimposed on the eyesight image.

A computer readable storage medium having a performance instruction program stored thereon to be executable by a computer of a performance instruction apparatus, wherein the performance instruction apparatus comprises:

• (a) goggle-type teaching equipment for use by a practitioner, (b) a display section provided on the teaching equipment, (c) an image memory for storing a plurality of guide images, each comprising an image representative of a hand of a practitioner playing a musical instrument and information for indicating a key to be played of a keyboard of the musical instrument and for teaching the practitioner how to manipulate his/her fingers to play keys of the keyboard of the musical instrument, and (d) an image pickup section provided on the teaching equipment for capturing an image of at least the keyboard of the musical instrument and the hand of the practitioner playing the keyboard, so as to generate an eyesight image corresponding to an eyesight of the practitioner, said program being executable by the computer to cause the computer to execute a process comprising:
• detecting a number of keys from the keyboard image included in the eyesight image;
• selecting a guide image from among the plurality of guide images stored in the image memory that includes a same number of the keys as detected by the key number;
• reading out the selected guide image from the image memory;
• adjusting a size and a position of the read out guide image;
• and
• controlling the display section to display the generated eyesight image and the adjusted guide image in a superimposed manner to indicate the key to be played and to teach the practitioner how to manipulate his/her finger to play the key.