Non-transitory computer readable recording medium, element recognition method, and element recognition system

An element recognition method comprising:

• acquiring distance image information including a subject performing a series of performances sensed by a 3D laser sensor, using a processor;
• acquiring three-dimensional skeleton information on the subject, obtained from the distance image information, in chronological order, using the processor;
• segmenting a time axis of the distance image information, based on movement amount of each joint position of the subject calculated from the three-dimensional skeleton information acquired in chronological order, into a plurality of units, using the processor;
• recognizing a stationary motion name of a postural motion at a first unit among the units based on the three-dimensional skeleton information and a table stored in a memory that associates a stationary motion name with a stationary motion success condition, wherein the postural motion is determined, from the movement amount, to have a feature indicating that the subject is stationary, using the processor;
• and
• recognizing a moving motion name at a second unit that is continuous with the first unit based on the three-dimensional skeleton information and a table stored in the memory that associates a moving motion name with a moving motion success condition, and determining an element name corresponding to a combination including at least the recognized stationary motion name at the first unit and the recognized moving motion name at the second unit, based on a table stored in the memory that associates an element name and a success condition indicating the stationary motion name and the moving motion name, using the processor.

An element recognition system comprising:

• a 3D laser sensor sensing a subject performing a series of performances to generate distance image information;
• and
• an element recognition apparatus comprising:
• a processor configured to:
• acquire the distance image information from the 3D laser sensor,
• acquire three-dimensional skeleton information on the subject, obtained from the distance image information, in chronological order and segments a time axis of the distance image information, based on movement amount of each joint position of the subject calculated from the three-dimensional skeleton information acquired in chronological order into a plurality of units,
• recognize a stationary motion name of a postural motion at a first unit among the units based on the three-dimensional skeleton information and a table stored in a memory that associates a stationary motion name with a stationary motion success condition, wherein the postural motion is determined, from the movement amount, to have a feature indicating that the subject is stationary, and
• recognize a moving motion name at a second unit that is continuous with the first unit based on the three-dimensional skeleton information and a table stored in the memory that associates a moving motion name with a moving motion success condition, and determine an element name corresponding to a combination including at least the recognized stationary motion name at the first unit and the recognized moving motion name at the second unit, based on a table stored in the memory that associates an element name and a success condition indicating the stationary motion name and the moving motion name.