Integration of a voice bot with crawler bot to automate and optimize a collections process using integrated programmatic and specialized guided and constrained artificial intelligence

A system for guiding an Artificial Intelligence (AI) engine to process call responses in a collection process comprising:

• one or more processors of a computer system;
• a memory, coupled to the one or more processors, that stores code and execution of the code by the one or more processors causes the computer system to perform operations comprising:
• executing codes using one or more processors of a computer system to cause the computer system to perform operations comprising:
• utilizing a database via a crawler bot to fetch customer details, wherein the database includes contact numbers of customers;
• using a voice module of an accounting system to initiate a call on the contact numbers of customers received from the database and records the call response;
• receiving the call response from the call made by the voice module, wherein the call response are responses from contacted numbers, including human voice, Interactive Voice Response (IVR) system, recorded message, or silence;
• processing the received call response using a voice-to-text converter to convert the call response into a text response;
• utilizing the AI engine to classify the call response based on the text response into categories in the database to recognize specific speech patterns and keywords to identify the nature of the call response, wherein categories include human voices, IVR system, leave a message, press buttons, just wait, call failed, no answer;
• generating a prompt via a prompt generator to guide the AI engine in utilizing the categorized call response to generate appropriate follow-up actions;
• using the voice-to-text converter to convert the follow-up action into a voice script;
• and
• using the voice script by the voice module for a follow-up call for a real-time collection process based on the follow-up actions.