Method and apparatus for testing full-duplex speech interaction system

An apparatus for testing a full-duplex speech interaction system, comprising:

• a corpus set determination program module configured to determine a scene mixed corpus set by mixing a valid corpus set related to a test scene with an invalid corpus set unrelated to the test scene;
• a test program module configured to play each corpus audio in the scene mixed corpus set to a speech interaction device under test equipped with the full-duplex speech interaction system;
• a log acquisition program module configured to acquire a work log of the speech interaction device under test, the work log comprising at least a first log and a second log, wherein,
• the first log records valid/invalid attributes recognized for each corpus audio and corresponding corpus text, and
• the second log records a decision result for each corpus audio, the decision results comprising response result and discarding result;
• a rejection rate determination program module configured to determine a rejection rate based on number of invalid corpus audios in the first log and number of discarding results in the second log;
• and
• a false response rate determination program module configured to obtain number of false responses according to a counted number of log entries which have false response result in the second log, the false response result referring to the response result that is expected not to be output but is actually output from the speech interaction device under test, and determine a false response rate based on the number of false responses and a total number of the played corpus audios in the scene mixed corpus set.