Dialog management system for using multiple artificial intelligence service providers

A non-transitory computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:

• receiving, by a channel adapter of a dialog management system, a query, the dialog management system including (i) the channel adaptor, (ii) a dispatcher bot, (iii) multiple worker bots that are each associated with a different, cloud-based, third party AI service provider, (iv) multiple AI adapters that are each associated with a different one of the, cloud-based, third party AI service providers, and (v) a knowledge retriever;
• dynamically selecting, by the dispatcher bot, a particular worker bot to handle the query based at least on (i) data that associates the particular worker bot with a subject matter of the query, and (ii) historical latency data or cost data associated with a particular cloud-based, third party AI service provider that is configured to provide a natural language processing of the query and that is assigned to the particular worker bot;
• generating, by a particular AI adapter that is associated with the particular cloud-based, third party AI service provider, a query message based on the query;
• sending, by the particular AI adapter, the query message to the particular cloud-based, third party AI service provider;
• receiving, by the particular AI adapter, a response message from the particular cloud-based, third party AI service provider, the response message includes first data that indicates content of the query message;
• generating, by the particular AI adapter, a representation of the response message that is consumable by the knowledge retriever, comprising discarding, without outputting to a submitter of the query, one or more portions of the response message that were generated by the third party AI service provider as a substantive response to the query but that are not used by the knowledge retriever or the particular worker bot to generate an answer for the query;
• sending, by the knowledge retriever, the representation of the response message to the particular worker bot, and in response:
• receiving, by the knowledge retriever, the answer for the query from the particular worker bot, and
• forwarding the answer to the channel adapter;
• and
• providing, by the channel adapter, the answer for output.

A system, comprising:

• a computing device;
• and
• a computer-readable storage device coupled to the computing device and having instructions stored thereon which, when executed by the computing device, cause the computing device to perform operations, the operations comprising:
• receiving, by a channel adapter of a dialog management system, a query, the dialog management system including (i) the channel adaptor, (ii) a dispatcher bot, (iii) multiple worker bots that are each associated with a different, cloud-based, third party AI service provider, (iv) multiple AI adapters that are each associated with a different one of the, cloud-based, third party AI service providers, and (v) a knowledge retriever;
• dynamically selecting, by the dispatcher bot, a particular worker bot to handle the query based at least on (i) data that associates the particular worker bot with a subject matter of the query, and (ii) historical latency data or cost data associated with a particular cloud-based, third party AI service provider that is configured to provide a natural language processing of the query and that is assigned to the particular worker bot;
• generating, by a particular AI adapter that is associated with the particular cloud-based, third party AI service provider, a query message based on the query;
• sending, by the particular AI adapter, the query message to the particular cloud-based, third party AI service provider;
• receiving, by the particular AI adapter, a response message from the particular cloud-based, third party AI service provider, the response message includes first data that indicates content of the query message;
• generating, by the particular AI adapter, a representation of the response message that is consumable by the knowledge retriever, comprising discarding, without outputting to a submitter of the query, one or more portions of the response message that were generated by the third party AI service provider as a substantive response to the query but that are not used by the knowledge retriever or the particular worker bot to generate an answer for the query;
• sending, by the knowledge retriever, the representation of the response message to the particular worker bot, and in response:
• receiving, by the knowledge retriever, the answer for the query from the particular worker bot, and
• forwarding the answer to the channel adapter;
• and
• providing, by the channel adapter, the answer for output.