Determination apparatus, test system, determination method, and computer-readable medium

A testing method comprising:

• acquiring test results of tests performed using a test head configured to transmit test signals on a plurality of items which are performed on a device under measurement;
• first determining of whether to retest the device under measurement that has failed the tests and;
• if it is determined to retest the device under measurement, signaling to a testing apparatus to retest the device under measurement;
• wherein
• in the first determining, the determination is performed based on reproducibility of the test results in a case where the tests have been performed on a plurality of ones of the device under measurement multiple times;
• in the first determining, the determination is performed, based on the calculated reproducibility, whether to retest ones of the device under measurement that have failed a test of a corresponding item;
• and
• in the first determining, the determination is performed by using a learning model that has learned the reproducibility;
• outputting a prediction result of the retest according to inputs of the test results of the plurality of items;
• supplying, to the learning model, the test results of the acquired plurality of items of ones of the device under measurement;
• executing learning processing of the learning model by using training data including at least an item ID of a failed item among the plurality of items, and a result of a retest;
• and
• acquiring the reproducibility from the prediction result of the retest which is output by the learning model according to the test results of the plurality of items being supplied to the learning model.

A non-transitory computer-readable medium having stored thereon a testing program that is executed by a computer having at least one processor configured to:

• acquire test results performed using a test head configured to transmit test signals of tests on a plurality of items which are performed on a device under measurement;
• perform a first determination as to whether to retest the device under measurement that has failed the tests;
• and
• if it is determined to retest the device under measurement, signal to a testing apparatus to retest the device under measurement;
• wherein
• the at least one processor:
• performs the first determination based on reproducibility of the test results in a case where the tests have been performed on a plurality of ones of the devices under measurement multiple times;
• performs the first determination, based on the reproducibility, where ones of the device under measurement that have failed a test of a corresponding item;
• performs the first determination by using a learning model that has learned the reproducibility;
• outputs a prediction result of the retest according to inputs of the test results of the plurality of items;
• supplies, to the learning model, the test results of the acquired plurality of items of ones of the device under measurement;
• executes learning processing of the learning model by using training data including at least an item ID of a failed item among the plurality of items, and a result of a retest;
• and
• acquires the reproducibility from the prediction result of the retest which is output by the learning model according to the test results of the plurality of items being supplied to the learning model.

A testing apparatus comprising:

• a main body;
• a test head operatively connected to the main body configured to transmit test signals to a device under measurement;
• and
• a determination apparatus having at least one processor configured to:
• acquire test results of tests performed using the test head on a plurality of items which are performed on the device under measurement;
• perform a first determination as to whether to retest the device under measurement that has failed the tests;
• and
• if it is determined to retest the device under measurement, signal to the main body to retest the device under measurement;
• wherein
• the at least one processor:
• performs the first determination based on reproducibility of the test results in a case where the tests have been performed on a plurality of ones of the devices under measurement multiple times;
• performs the first determination, based on the reproducibility, where ones of the device under measurement have failed a test of a corresponding item;
• performs the first determination by using a learning model that has learned the reproducibility;
• calculates the reproducibility from the test results of the plurality of tests on ones of the device under measurement and test results of a plurality of retests;
• performs a second determination as to whether to update the reproducibility by using a result of the retest and the first determination;
• and
• updates the reproducibility according to the second determination.