Synchronizing Visual And Speech Events In A Multimodal Application

A system for synchronizing visual and speech events in a multimodal application, the system comprising at least one computer processor, at least one computer memory operatively coupled to the computer processor, and computer program instructions disposed within the computer memory capable of:

• receiving from a user speech;
• determining a semantic interpretation of the speech;
• calling a global application update handler;
• identifying, by the global application update handler, an additional processing function in dependence upon the semantic interpretation;
• and
• executing the additional processing function.

A computer program product for synchronizing visual and speech events in a multimodal application, the computer program product embodied on a computer-readable recording medium, the computer program product comprising:

• computer program instructions that receive from a user speech;
• computer program instructions that determine a semantic interpretation of the speech;
• computer program instructions that call a global application update handler;
• computer program instructions that identify, by the global application update handler, an additional processing function in dependence upon the semantic interpretation;
• and
• computer program instructions that execute the additional processing function.