Data analysis and training data, generation device, system, method, and generation program

A data analysis system, comprising:

• a generation device, including a processor configured to execute a program and a storage device configured to store the program, the generation device being configured to generate a learning model;
• and
• an edge system, including a plurality of edge devices, each of which includes a sensor, and an edge management device that manages the plurality of edge devices, the edge system being configured to acquire analysis target data, wherein
• the generation device is configured to execute:
• a first inference process of inputting first analysis target data, which is image data including a plurality of time-series frames, to a plurality of inference models and outputting a plurality of inference results related to an object included in the first analysis target data from the plurality of inference models;
• a determination process of determining, based on a movement amount of a skeleton point of a skeleton of the object, between a first frame and a second frame in each of the plurality of inference results, wherein the skeleton indicates a shape of the object, one of the plurality of inference results output by the first inference process, for which the movement amount is below a predetermined threshold, as a specific inference result;
• a generation process of generating a training data set including the specific inference result determined by the determination process and the analysis target data;
• a determination process of determining a specific inference model from the plurality of inference models based on the number of outputs of the specific inference result in each of the inference models;
• and
• a learning process of training the specific inference model, which is determined by the determination process, by using the training data set generated by the generation process, and outputting the specific inference model as a learning model;
• and
• the edge system is configured to execute:
• an acquisition process of acquiring the first analysis target data and second analysis target data from an analysis environment;
• an output process of outputting the first analysis target data acquired by the acquisition process;
• and
• a second inference process of inputting the second analysis target data acquired by the acquisition process to the learning model output by the learning process and outputting an inference result related to an object included in the second analysis target data from the learning model.

A generation method to be executed by a generation device including a processor configured to execute a program, and a storage device configured to store the program, the generation method comprising:

• the processor executing:
• an inference process of inputting analysis target data, which is image data including a plurality of time-series frames, to a plurality of inference models and outputting a plurality of inference results related to an object included in the analysis target data from the plurality of inference models;
• a determination process of determining, based on a movement amount of a skeleton point of a skeleton of the object, between a first frame and a second frame in each of the plurality of inference results, wherein the skeleton indicates a shape of the object, one of the plurality of inference results output by the inference process, for which the movement amount is below a predetermined threshold, as a specific inference result;
• and
• a generation process of generating a training data set including the specific inference result determined by the determination process and the analysis target data.

A non-transitory computer-readable medium storing a generation program for causing a processor to execute:

• an inference process of inputting analysis target data, which is image data including a plurality of time-series frames, to a plurality of inference models and outputting a plurality of inference results related to an object included in the analysis target data from the plurality of inference models;
• a determination process of determining, based on a movement amount of a skeleton point of a skeleton of the object, between a first frame and a second frame in each of the plurality of inference results, wherein the skeleton indicates a shape of the object, one of the plurality of inference results output by the inference process, for which the movement amount is below a predetermined threshold, as a specific inference result;
• and
• a generation process of generating a training data set including the specific inference result determined by the determination process and the analysis target data.