System and method for dynamic communication experiences

A system for dynamically transitioning between communication modalities during a communication session with an end-user, the system comprising a processor and machine-readable media including instructions which, when executed by the processor, cause the processor to:

• receive, at an artificial intelligence (AI) system and from an interactive voice response (IVR) system, a first input by the end-user from a user computing device during a first interaction of the communication session, the first interaction occurring between the end-user and the IVR system;
• identify, at the AI system and based on the first input, a first context for the first interaction;
• automatically trigger, at the AI system and in response to the identification of the first context, a transition of management of the communication session from the IVR system to a video-based communication interface of the AI system;
• receive, by the AI system, first video data from the user computing device during a second interaction occurring between the end-user and the AI system;
• receive, by the AI system, first sensor data collected via a first onboard sensor of the user computing device during the second interaction, the first onboard sensor including one or more of a gyroscope, accelerometer, capacitive sensor, magnetometer, infrared sensor, microphone, network connectivity sensor, location sensor, Time-of-Flight (TOF) sensor;
• determine, at the AI system, the first video data is unacceptable based on an image quality assessment (IQA) of the first video data performed by the AI system;
• and
• identify and present, by the AI system and based on the first sensor data, a first action that can be taken by the end-user to improve image quality.