Method of competition scoring, non-transitory computer readable recording medium, and competition scoring apparatus

A non-transitory computer-readable storage medium storing a display program that causes a processor included in an information processing apparatus that outputs a result of scoring for a performance of a scoring competition to execute a process, the process comprising:

• obtaining sensing data comprising time-series three-dimensional coordinates of a plurality of joints of an athlete;
• generating skeletal motion data from the time-series three-dimensional coordinates;
• obtaining input information including an event, gender, and class classification of the scoring competition;
• determining a first rule among the plurality of types of scoring rules based on the input information;
• identifying a plurality of elements included in the performance by comparing the generated skeletal motion data with a plurality of pre-defined element motion patterns;
• applying the first rule to the identified plurality of elements to determine a final difficulty level for each of the plurality of elements by determining an upgrade or a downgrade of difficulty level;
• selecting a part of the plurality of elements to be used for the scoring in descending order of the final difficulty level;
• calculating a score of the performance based on the selected part of the elements;
• generating an interactive scoring screen that includes a first display area, a second display area, a third display area, and a fourth display area, the first display area displaying the identified plurality of elements and the final difficulty level of each of the elements in chronological order and highlighting the selected part of the plurality of elements in different style from other elements, the second display area being an area for an aggregate result of a number of elements of each difficulty level for the limited part of the elements, the third display area being an area for a score of the performance directed to the limited part of the elements, the fourth display area being area for a 3D model of the athlete generated on the basis of the sensing data;
• and
• in response to a user selection of an element in the first display area or a position on a timeline of the performance, cause the fourth display area to play back the 3D model corresponding to the user selected element or position on the timeline.

An information processing apparatus that outputs a result of scoring for a performance of a scoring competition, the information processing apparatus comprising:

• a memory;
• and
• a processor coupled to the memory and configured to:
• obtain sensing data comprising time-series three-dimensional coordinates of a plurality of joints of an athlete;
• generate skeletal motion data from the time-series three-dimensional coordinates;
• obtain input information including an event, gender, and class classification of the scoring competition;
• determine a first rule among the plurality of types of scoring rules based on the input information;
• identify a plurality of elements included in the performance by comparing the generated skeletal motion data with a plurality of pre-defined element motion patterns;
• apply the first rule to the identified plurality of elements to determine a final difficulty level for each of the plurality of elements by determining an upgrade or a downgrade of difficulty level;
• select a part of the plurality of elements to be used for the scoring in descending order of the final difficulty level;
• calculate a score of the performance based on the selected part of the elements;
• generate an interactive scoring screen that includes a first display area, a second display area, a third display area, and a fourth display area, the first display area displaying the identified plurality of elements and the final difficulty level of each of the elements in chronological order and highlighting the selected part of the plurality of elements in different style from other elements, the second display area being an area for an aggregate result of a number of elements of each difficulty level for the limited part of the elements, the third display area being an area for a score of the performance directed to the limited part of the elements, the fourth display area being area for a 3D model of the athlete generated on the basis of the sensing data;
• and
• in response to a user selection of an element in the first display area or a position on a timeline of the performance, cause the fourth display area to play back the 3D model corresponding to the user selected element or position on the timeline.