Monitoring the health of a question/answer computing system

An information handling system comprising:

• one or more processors;
• a memory coupled to at least one of the processors;
• and
• a set of instructions stored in the memory and executed by at least one of the processors to monitor a health of a QA system, wherein the set of instructions perform actions of:
• periodically submitting a plurality of static questions to the QA system, wherein each of the plurality of static questions corresponds to a previously established verified answer;
• receiving a plurality of responses from the QA system, wherein the plurality of responses include QA system answers corresponding to the submitted static questions;
• monitoring a performance of the QA system based on the received responses;
• and
• responsive to the monitoring detecting a problem with the QA system, notifying a user of the QA system regarding the detected problem.

A computer program product stored in a non-transitory computer readable storage medium, comprising computer instructions that, when executed by an information handling system, causes the information handling system to monitor a health of a QA system by performing actions comprising:

• periodically submitting a plurality of static questions to the QA system, wherein each of the plurality of static questions corresponds to a previously established verified answer;
• receiving a plurality of responses from the QA system, wherein the plurality of responses include QA system answers corresponding to the submitted static questions;
• monitoring a performance of the QA system based on the received responses;
• and
• responsive to the monitoring detecting a problem with the QA system, notifying a user of the QA system regarding the detected problem.