Timing prediction method, timing prediction device, timing prediction system, program, and construction machinery system

An apparatus comprising:

• a processor;
• and
• memory storing instructions that, when executed by the processor, cause the apparatus to:
• store an action model obtained by learning a transition sequence of a primitive action obtained by segmenting a movement state of a training object performing a movement action;
• receive, from at least one sensor attached to construction machinery, movement data of a plurality of positions of the construction machinery performing a predetermined movement action, wherein the at least one sensor comprises at least one of a gyroscope, an acceleration sensor, or an inertial movement unit;
• generate feature data by performing frequency analysis on the movement data;
• segment the feature data to extract a transition sequence of a primitive action;
• predict an end timing of the predetermined movement action by analyzing an occurrence rate of the primitive action in the predetermined movement action and extracting a pattern of the primitive action based on the transition sequence and the action model;
• and
• cause at least one of an audible alarm or a visual alarm to be provided to a user, wherein the at least one of the audible alarm or the visual alarm is based on the predicted end timing of the predetermined movement action.

A system comprising:

• at least one sensor attached to construction machinery and configured to measure movements of the construction machinery and to generate movement data for a plurality of positions of the construction machinery performing a predetermined movement action, wherein the at least one sensor comprises at least one of a gyroscope, an acceleration sensor, or an inertial movement unit;
• and
• a device comprising a processor and memory storing instructions that, when executed by the processor, cause the device to:
• store an action model obtained by learning a transition sequence of a primitive action obtained by segmenting a movement state of a training object performing a movement action,
• receive the movement data,
• generate feature data by performing frequency analysis on the movement data,
• segment the feature data to extract a transition sequence of a primitive action,
• predict an end timing of the predetermined movement action by analyzing an occurrence rate of the primitive action in the predetermined movement action and extracting a pattern of the primitive action based on the transition sequence and the action model, and
• cause at least one of an audible alarm or a visual alarm to be provided to a user, wherein the at least one of the audible alarm or the visual alarm is based on the predicted end timing of the predetermined movement action.

A non-transitory computer-readable medium storing instructions that, when executed, cause a computer to:

• receive, from at least one sensor attached to construction machinery, movement data of a plurality of positions of the construction machinery performing a predetermined movement action, wherein the at least one sensor comprises at least one of a gyroscope, an acceleration sensor, or an inertial movement unit;
• generate feature data by performing frequency analysis on the movement data;
• segment the generated feature data to extract a transition sequence of a primitive action;
• predict an end timing of the predetermined movement action by analyzing an occurrence rate of the primitive action in the predetermined movement action and extracting a pattern of the primitive action based on the extracted transition sequence and a predetermined action model, wherein the action model is obtained by learning a transition sequence of a primitive action obtained by segmenting a movement state of a training object performing a movement action;
• and
• cause at least one of an audible alarm or a visual alarm to be provided to a user, wherein the at least one of the audible alarm or the visual alarm is based on the predicted end timing of the predetermined movement action.

A system comprising:

• at least one sensor attached to first construction machinery and configured to measure movement data of a plurality of positions of the first construction machinery performing a predetermined movement action, wherein the at least one sensor comprises at least one of a gyroscope, an acceleration sensor, or an inertial movement unit;
• and
• a device comprising a processor and memory storing instructions that, when executed by the processor, cause the device to:
• store an action model obtained by learning a transition sequence of a primitive action obtained by segmenting a movement state of training construction machinery performing a movement action,
• receive the movement data,
• generate feature data by performing frequency analysis on the movement data,
• segment the feature data and extract a transition sequence of a primitive action,
• predict an end timing of the predetermined movement action by analyzing an occurrence rate of the primitive action in the predetermined movement action and extracting a pattern of the primitive action based on the transition sequence and the action model, and
• cause autonomous movement of second construction machinery to be performed based on the predicted end timing of the predetermined movement action of the first construction machinery.