Information processing apparatus, information processing method, and computer-readable non-transitory storage medium

An information processing method, comprising:

• detecting, by at least one processor, a person, a first object, and a second object based on a plurality of images included in sensor information;
• recognizing, by the at least one processor, a first action of the person based on a distance between the person and the first object being equal to or less than a predetermined length;
• measuring, by the at least one processor based on a recognition result of the first action, a time period for which the person has continued the first action;
• and
• generating, by the at least one processor, information indicating a degree of divergence from an action plan based on (i) the time period which has been measured and for which the first action has been continued and (ii) a time period which is included in the action plan planned for the first action and for which the first action is to be continued, the action plan being related to the first action of the person which has been recognized;
• wherein the recognizing recognizes an unidentified action occurring between the first action and a second action related to the second object,
• wherein the measuring measures the time period of the first action by:
• calculating, during the unidentified action, a first distance between the person and the first object and a second distance between the person and the second object;
• and
• adding a duration of the unidentified action to the time period of the first action in a case where the second distance is greater than the first distance, and
• wherein the detecting is based on the sensor information acquired from a plurality of sensors, and wherein the recognizing is decision making based on a majority decision to identify the first object or the second object when detection results differ among the plurality of sensors.

A computer-readable non-transitory storage medium storing a program for causing a computer to function as an information processing apparatus, the program causing the computer to carry out:

• a detection process of detecting a person, a first object, and a second object based on a plurality of images included in sensor information;
• a recognition process of recognizing a first action of the person based on a distance between the person and the first object being equal to or less than a predetermined length;
• a measurement process of measuring, based on a recognition result of the first action, a time period for which the person has continued the first action;
• and
• a generation process of generating information indicating a degree of divergence from an action plan based on (i) the time period which has been measured and for which the first action has been continued and (ii) a time period which is included in the action plan planned for the first action and for which the first action is to be continued, the action plan being related to the first action of the person which has been recognized;
• wherein the recognition process is configured to recognize an unidentified action occurring between the first action and a second action related to the second object,
• wherein the measurement process measures the time period of the first action by:
• calculating, during the unidentified action, a first distance between the person and the first object and a second distance between the person and the second object;
• and
• adding a duration of the unidentified action to the time period of the first action in a case where the second distance is greater than the first distance, and
• wherein the detection process is based on the sensor information acquired from a plurality of sensors, and wherein the recognition process performs decision making based on a majority decision to identify the first object or the second object when detection results differ among the plurality of sensors.