Evaluation method for learning models, training method, device, and program
AssigneeRenesas Electronics Corporation
InventorsTadaaki TANIMOTO, Motoki KIMURA
Life of this patent
Estimating the term…
Abstract
Provided are a device, a method, and a program which allow learning models to be appropriately evaluated or trained. The evaluation device according to an aspect performs the steps of: (A) obtaining, using checking data, a first execution result based on a first learning model as an exemplar model; (B) obtaining, using the checking data, a second execution result based on a second learning model; (C) determining whether or not the first and second execution results satisfy a logical formula; and (D) comparing, using a Bayesian statistical model checking method, respective behaviors of the first and second learning models with each other on the basis of a result of the determination in the step (C).
Claims16
A method of evaluating learning models by using a memory and a processor, the method comprising the steps of:
- (A) generating a first execution result of a first learning model as an exemplar model using checking data by the processor;
- (B) generating a second execution result of a second learning model using the checking data by the processor;
- (C) determining whether or not the first and second execution results satisfy a predetermined logical formula by the processor;
- and
- (D) comparing by the processor, using a Bayesian statistical model checking method, respective behaviors of the first and second learning models with each other on the basis of a result of the determination in the step (C).
A device for evaluating learning models which performs the steps of:
- (A) obtaining, using checking data, a first execution result based on a first learning model as an exemplar model;
- (B) obtaining, using the checking data, a second execution result based on a second learning model;
- (C) determining whether or not the first and second execution results satisfy a logical formula;
- and
- (D) comparing, using a Bayesian statistical model checking method, respective behaviors of the first and second learning models with each other on the basis of a result of the determination in the step (C).
A training method which is implemented by using a memory and a processor, the training method comprising the steps of:
- (1) obtaining, using training data, a first output result based on a first learning model as a teacher model;
- (2) obtaining, using the training data, a second output result based on a second learning model as a student model;
- (3) performing, using an evaluation parameter based on the first and second output results, training of the second learning model;
- and
- (4) comparing respective behaviors of the first learning model and the pre-trained second learning model with each other.
Dependencies are inferred from the claim text.