Music apparatus with motion picture responsive to body action

A performance processing apparatus operable by an operation device and equipped with a sound device and a display device, comprising:

• a storing section that stores song data representative of a music sound constituting a music song, and stores image data representative of an image;
• an acquiring section that acquires detection information from the operation device, which is used by a user and which has a detector for detecting a chronological action or state of the user and outputting the detection information representative of the detected chronological action or state;
• a sound control section that generates the music sound through the sound device according to the song data and controls the generating of the music sound according to the acquired detection information;
• and
• a display control section that displays the image by the display device according to the image data and controls a rendering mode of the image displayed on the display device according to the acquired detection information.

A computer program for use in a performance processing apparatus being operable by an operation device and being equipped with a sound device, a display device, and a storage device which stores song data representative of a music sound constituting a music song and image data representative of an image, the computer program being executable by the performance processing apparatus for performing a process comprising the steps of:

• acquiring detection information from the operation device, which is used by a user and which has a detector for detecting a chronological action or state of the user and outputting the detection information representative of the detected chronological action or state;
• generating the music sound through the sound device according to the song data;
• controlling a progression degree of the generation of the music sound according to the acquired detection information;
• and
• displaying the image by the display device according to the image data in correspondence with the progression degree of the generating of the music sound.

A computer program for use in a performance processing apparatus being operable by an operation device and being equipped with a sound device, a display device, and a storage device which stores song data representative of a music sound constituting a music song and image data representative of an image, the computer program being executable by the performance processing apparatus for performing a process comprising the steps of:

• acquiring detection information from the operation device, which is used by a user and which has a detector for detecting a chronological action or state of the user and outputting the detection information representative of the detected chronological action or state;
• generating the music sound through the sound device according to the song data;
• controlling the generating of the music sound according to the acquired detection information;
• displaying the image by the display device according to the image data;
• and
• controlling a rendering mode of the image displayed on the display device according to the acquired detection information.

A file creating apparatus for creating a data file used in a performance processing apparatus which generates a music sound constituting a music song through a sound device at a progression degree corresponding to a chronological action or state of a user and which displays an image on a display device at a timing corresponding to progression of the music sound, the file creating apparatus comprising:

• a storing section that stores song data representative of the music sound to be generated through the sound device;
• another storing section that stores image data representative of the image to be displayed on the display device along with the generating of the music sound;
• and
• a creating section that provides timing specification data which specifies a timing to display the image in correspondence to the progression of the music sound, and that integrates the song data, the image data and the timing specification data into the data file for use in the performance processing apparatus.

A file creating apparatus for creating a data file used in a performance processing apparatus which controls a music sound constituting a music song generated by a sound device and which displays an image on a display device along with a progression of the music song in response to a chronological action or state of a user, the file creating apparatus comprising:

• a storing section that stores song data representative of the music sound to be generated through the sound device;
• another storing section that stores image data representative of the image to be displayed on the display device along with the progression of the music song;
• and
• a creating section that provides rendering specification data which specifies a rendering mode of the image in accordance with the chronological action or state of the user, and that integrates the song data, the image data and the rendering specification data into the data file for use in the performance processing apparatus.

A method carried out in a performance processing apparatus being operable by an operation device and being equipped with a sound device, a display device, and a storage device which stores song data representative of a music sound constituting a music song and image data representative of an image, the method comprising the steps of:

• acquiring detection information from the operation device, which is used by a user and which has a detector for detecting a chronological action or state of the user and outputting the detection information representative of the detected chronological action or state;
• generating the music sound through the sound device according to the song data;
• controlling a progression degree of the generation of the music sound according to the acquired detection information;
• and
• displaying the image by the display device according to the image data in correspondence with the progression degree of the generating of the music sound.

A method carried out in a performance processing apparatus being operable by an operation device and being equipped with a sound device, a display device, and a storage device which stores song data representative of a music sound constituting a music song and image data representative of an image, the method comprising the steps of:

• acquiring detection information from the operation device, which is used by a user and which has a detector for detecting a chronological action or state of the user and outputting the detection information representative of the detected chronological action or state;
• generating the music sound through the sound device according to the song data;
• controlling the generating of the music sound according to the acquired detection information;
• displaying the image by the display device according to the image data;
• and
• controlling a rendering mode of the image displayed on the display device according to the acquired detection information.