Quality control system for providing results in response to queries

A host computer system for providing results in response to queries, comprising:

• at least a first engine;
• a quality control system, including:
• a challenge keyword transmission module transmitting the challenge keyword to a remote search engine computer system;
• and
• a reference result receiving module receiving at least one reference result from the search engine computer system in response to the transmission of the challenge keyword to the remote search engine computer system;
• a reference score calculation module calculating a reference score, wherein the reference score is calculated based on the reference search result;
• a challenge keyword submission module entering a challenge keyword into at least a first engine;
• a challenge result receiving module receiving at least one challenge result from the first engine in response to the challenge keyword;
• a challenge answer score calculation module calculating a challenge answer score based on the challenge result;
• a challenge answer-to-reference score calculation module calculating a challenge reference score for the first engine based on a comparison of the challenge answer score for the first engine with the reference score;
• and
• an engine relevance score publishing module publishing an engine relevance score based on the challenge reference score for the first engine;
• and
• a live system including:
• a live query receiving module receiving a live query having a user keyword over a network from at least one live remote computer system;
• a user keyword submission module entering the user keyword into the first engine;
• a live result receiving module receiving at least one live result from the first engine based on the user keyword;
• and
• a live result transmission module transmitting the live result from the first engine over the network to the at least one live remote computer system.