Multimodal artificial intelligence-based communication systems

A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computing device to cause the computing device to:

• generate, using a first set of one or more artificial intelligence techniques, identifying information for one or more objects detected in image data associated with at least one user query;
• generate at least one updated version of the at least one user query by processing, using a second set of one or more artificial intelligence techniques, at least a portion of the at least one user query in conjunction with at least a portion of the identifying information for the one or more objects, wherein generating the at least one updated version of the at least one user query comprises processing, using at least one topic aware sequence-to-sequence (TA-Seq2Seq) model, the at least a portion of the at least one user query in conjunction with the at least a portion of the identifying information for the one or more objects;
• generate at least one response to the at least one updated version of the at least one user query;
• and
• perform one or more automated actions based at least in part on the at least one response.

A computer-implemented method comprising:

• generating, using a first set of one or more artificial intelligence techniques, identifying information for one or more objects detected in image data associated with at least one user query;
• generating at least one updated version of the at least one user query by processing, using a second set of one or more artificial intelligence techniques, at least a portion of the at least one user query in conjunction with at least a portion of the identifying information for the one or more objects, wherein generating the at least one updated version of the at least one user query comprises processing, using at least one topic aware sequence-to-sequence (TA-Seq2Seq) model, the at least a portion of the at least one user query in conjunction with the at least a portion of the identifying information for the one or more objects;
• generating at least one response to the at least one updated version of the at least one user query;
• and
• performing one or more automated actions based at least in part on the at least one response;
• wherein the method is carried out by at least one computing device.