User interface automation using robotic process automations that detect user interface elements not visible on a display and fills a form

A system comprising:

• a memory storing code of an interface engine for detecting and automatically filling one or more user interface (UI) elements of a page that are not visible on a screen;
• and
• at least one processor configured to execute the code to cause within the system:
• analyzing, by the interface engine, document object model (DOM) of the page to extract DOM text of one or more relevant UI elements of the one or more UI elements;
• performing, by the interface engine, computer vision (CV) analysis to determine one or more types the one or more relevant UI elements;
• and
• extrapolating, by the interface engine, one or more target UI elements of an invisible region of the page from the one or more relevant UI elements.