Method and apparatus for multimodal voice and web services

A switch for controlling an audio connection from an audio interface with a client to an audio processor with a remote voice server comprising:

• means for setting up a processor link for audio data with the audio processor and a server switch;
• means for setting up an audio interface session comprising establishing an interface link for audio data with the audio interface and the server switch;
• means for, in response to a signal indicating the start of an audio interaction comprising a multimodal dialogue within the audio interface session, connecting the processor link and the interface link whereby audio data can flow between the audio interface session and the audio processor, and wherein the server switch is to buffer and play back the audio data to the audio processor later if all ports on the audio processor are being utilized;
• means for, in response to a signal indicating the end of the audio interaction comprising synchronization of fields in a multimodal dialogue, terminating the audio interface session by disconnecting, by the server switch, the processor link and the interface link;
• and means for, in response to the end of the interface session, taking down the interface link.

A multimodal web server comprising:

• an Extensible HyperText Markup Language (XHTML) and voice documents database;
• an XHTML and voice filter;
• a Voice Extensible Markup Language (VoiceXML) browser;
• an interactive voice response server (IVR);
• a voice server;
• and
• a switch for controlling an audio connection from a client audio interface to the IVR, said switch comprising:
• means for setting up an IVR link for audio data with the IVR;
• means for setting up an client interface link for audio data with the client audio interface;
• means for, in response to a signal indicating the start of an audio interaction comprising a multimodal dialogue, connecting the IVR link and the client interface link, whereby audio data can flow between the client audio interface session and the IVR, and wherein the switch is to buffer and play back the audio data later to the IVR if all ports on the IVR are being utilized;
• means for, in response to a signal indicating the end of the client audio interaction comprising synchronization of fields in the multimodal dialogue, disconnecting, by the switch, the IVR link and the client interface link;
• and
• means for, in response to the end of the client interface session, taking down the client interface.

A computer program product for controlling an audio connection between an audio interface with a client and an audio processor with a remote voice server, said computer program product including a computer readable storage device having computer usable program code embodied therewith, said computer program code comprising:

• computer usable program code configured to set up a processor link for audio data with the audio processor and a server switch;
• computer usable program code configured to set up an audio interface session comprising establishing an interface link for audio data with the audio interface and the server switch;
• computer usable program code configured to, in response to a signal indicating the start of an audio interaction comprising a multimodal dialogue within the audio interface session, connect the processor link and the interface link whereby audio data can flow between the audio interface and the audio processor, and wherein the server switch is to buffer and play back the audio data to the audio processor later if all ports on the audio processor are being utilized;
• computer usable program code configured to, in response to a signal indicating the end of the audio interaction comprising synchronization of fields in a multimodal dialogue, terminate the audio interface session by disconnecting, by the server switch, the processor link and the interface link;
• and
• computer usable program code configured to, in response to the end of the interface session, take down the interface link.

An apparatus for controlling an audio connection from a client audio interface to a interactive voice response server (IVR), said apparatus comprising:

• means for setting up an IVR link for audio data with the IVR;
• means for setting up an client interface link for audio data with the client audio interface;
• means for, in response to a signal indicating the start of an audio interaction comprising a multimodal dialogue, connecting the IVR link and the client interface link, whereby audio data can flow between the client audio interface session and the IVR, and wherein a server switch is to buffer and play back the audio data to the IVR later if all ports on the IVR are being utilized;
• means for, in response to a signal indicating the end of the client audio interaction comprising synchronization of fields in the multimodal dialogue, disconnecting, by the server switch, the IVR link and the client interface link;
• and
• means for, in response to the end of the client interface session, taking down the client interface.