Data analysis system, data analysis method, and data analysis program
AssigneeHitachi, Ltd.
InventorTaichi Matsuo
Life of this patent
Estimating the term…
Abstract
A data analysis system executes data analysis in response to a data analysis request from a plurality of data analysis request sources and includes a filtering unit, a data analysis unit, a data storage unit, and a filter control unit. The filtering unit filters input data by applying a predetermined filter to the input data. The data analysis unit analyzes the filtered input data. The data storage unit stores the input data and result data as data that has been analyzed. The filter control unit records application history of a filter applied in response to the data analysis request, and refers to the filter application history for a new data analysis request to select a filter suitable for data analysis to be executed, and transfers the selected filter to the filtering unit.
Claims9
A data analysis system that executes data analysis in response to a data analysis request from a plurality of data analysis request sources, the data analysis system comprising:
- at least one processor;
- at least one memory;
- a filtering unit that filters input data by applying a predetermined filter to the input data;
- a data analysis unit that analyzes the filtered input data;
- a data storage that stores the input data and result data as data that has been analyzed;
- and
- a filter control unit that records application history of a filter applied in response to the data analysis request, and refers to the filter application history for a new data analysis request to select a filter suitable for data analysis to be executed, and transfers the selected filter to the filtering unit as the predetermined filter,
- wherein the filter control unit records a filter conformity rate, which is an index indicating a degree of conformity of a filter in data analysis processing executed on a type of each of the filters, and a filter condition for each of stored filters in association with a filter selection criterion and a filter selection criterion content included in the data analysis request for each of the data analysis request sources,
- wherein the filter conformity rate is calculated as a sum of a conformity rate recorded for a data analysis request source of a data analysis request to be processed and a corrected conformity rate, obtained by multiplying a conformity rate recorded for another data analysis request source by a predetermined weighting factor, for each extracted filter, and
- wherein the filter control unit selects a filter having a maximum sum of filter conformity rates of the extracted filters as a recommended filter.
A data analysis method for executing data analysis in response to a data analysis request from a plurality of data analysis request sources, a computer comprising a processor and a memory stores input data to be analyzed for each of the data analysis request sources and an application history of a filter applied in response to the data analysis request, the method causing the computer to execute:
- receiving the data analysis request to extract the input data to be analyzed;
- referring to the filter application history for the data analysis request to select a filter suitable for data analysis to be executed;
- applying the selected filter to the input data to perform filtering of the input data;
- performing analysis processing of the filtered input data;
- storing result data which is the analyzed data;
- recording a filter conformity rate, which is an index indicating a degree of conformity of a filter in data analysis processing executed on a type of each of the filters, and a filter condition for each of stored filters in association with a filter selection criterion and a filter selection criterion content included in the data analysis request for each of the data analysis request sources,
- calculating the filter conformity rate as a sum of a conformity rate recorded for a data analysis request source of a data analysis request to be processed and a corrected conformity rate, obtained by multiplying a conformity rate recorded for another data analysis request source by a predetermined weighting factor, for each extracted filter, and
- selecting a filter having a maximum sum of filter conformity rates of the extracted filters as a recommended filter.
A non-transitory computer readable storage medium storing thereon a data analysis program, which when executed, causes a computer comprising a processor and a memory to execute data analysis in response to a data analysis request from a plurality of data analysis request sources, the computer storing input data to be analyzed for each of the data analysis request sources and an application history of a filter applied in response to the data analysis request, the program causing the computer to execute:
- a process of receiving the data analysis request to extract the input data to be analyzed;
- a process of referring to the filter application history for the data analysis request to select a filter suitable for data analysis to be executed;
- a process of applying the selected filter to the input data to perform filtering of the input data;
- a process of performing analysis processing of the filtered input data;
- a process of storing result data which is the analyzed data;
- a process of recording a filter conformity rate, which is an index indicating a degree of conformity of a filter in data analysis processing executed on a type of each of the filters, and a filter condition for each of stored filters in association with a filter selection criterion and a filter selection criterion content included in the data analysis request for each of the data analysis request sources;
- a process or calculating the filter conformity rate as a sum of a conformity rate recorded for a data analysis request source of a data analysis request to be processed and a corrected conformity rate, obtained by multiplying a conformity rate recorded for another data analysis request source by a predetermined weighting factor, for each extracted filter;
- and
- a process of selecting a filter having a maximum sum of filter conformity rates of the extracted filters as a recommended filter.
Dependencies are inferred from the claim text.