State machine based context-sensitive system for managing multi-round dialog

A state machine based context-sensitive multi-round dialog management method, comprising the steps of:

• an input module receiving multi-modal input information;
• an intention identification engine module identifying intention information in the multi-modal input information;
• an intention module bringing multiple intention information identified by the intention identification engine module into one-to-one correspondence with multiple intention sub-modules at back ends;
• a state machine module managing a relevant context in the dialog management system, and provides support for an output result;
• an instruction parsing engine module parsing the intention information;
• and
• an output module acquiring policy information according to the results from the parsing engine module and the intention identification module, and transmitting the policy information to the state machine module.

A state machine based context-sensitive multi-round dialog management system, comprising an input device, a processor, an output controller and an output device, wherein:

• the input device is configured to receive multi-modal input information input by a user;
• the input device comprises a microphone, an analog-to-digital converter, a voice identification processor, an image acquisition device and an image processor;
• the microphone, the analog-to-digital converter and the voice identification processor are sequentially connected;
• the microphone is configured to acquire a voice signal of the user when the user and a robot are dialoging;
• the analog-to-digital converter is configured to convert the voice signal into voice digital information;
• the voice identification processor is configured to convert the voice digital information into word information, and input the word information into the processor;
• the image acquisition device is configured to acquire an image containing the user;
• the image processor is configured to identify and acquire user information from the image containing the user, and input the user information into the processor;
• the processor comprises an intention identification engine module, an intention module, a state machine module, an instruction parsing engine module and an output module;
• the intention identification engine module is configured to identify intention information in the multi-modal input information;
• the intention module comprises intention sub-modules for bringing multiple intention information identified by the intention identification engine module into one-to-one correspondence with multiple intention sub-modules at back ends;
• the instruction parsing engine module comprises a plurality of instruction parsing engine sub-modules for parsing corresponding intention information and acquiring the parsed multiple intention information;
• the output module is configured to acquire policy information according to the result from the instruction parsing engine module, and transmit the policy information to the state machine module;
• the state machine module comprises a plurality of state machines for managing a relevant context in the dialog management system and providing the support for completing context information for the intention identification engine module, the intention module, the instruction parsing engine module and the output module;
• and
• the output controller selects the intention information which conforms to the real intention of the user from the intention information parsed out by the plurality of instruction parsing engine sub-modules according to the policy information output from the output module, generates output information, and controls the output device to output corresponding information to the user according to the output information.