Detecting error in executing computation graph on heterogeneous computing devices

A system for detecting error in executing a computation graph on heterogeneous computing devices, the system comprising:

• heterogeneous computing devices including a reference computing device and a target computing device each of which is configured to execute the computation graph representing a machine learning model;
• and
• an error detection apparatus configured to:
• receive a first reference value from the reference computing device as an execution result by the reference computing device for a first node of the computation graph;
• receive a first target value from the target computing device as an execution result by the target computing device for the first node;
• compare the first reference value and the first target value;
• and
• determine whether the first target value is in error based on the comparison of the first reference value and the first target value.

A non-transitory computer readable medium that stores a set of instructions that is executable by at least one processor of a computing device to cause the computing device to perform a method for detecting error in executing a computation graph on heterogeneous computing devices, the method comprising:

• receiving a first reference value from a reference computing device included in the heterogeneous computing devices, the first reference value being an execution result by the reference computing device for a first node of the computation graph representing a machine learning model;
• receiving a first target value from a target computing device included in the heterogeneous computing devices as an execution result by the target computing device for the first node;
• comparing the first reference value and the first target value;
• and
• determining whether the first target value is in error based on the comparison of the first reference value and the first target value.