Image based method and system for building object model and application states comparison and graphic-based interoperability with an application

A system for enabling graphic-based interoperability with a computer executed application, the system comprising:

• a computer system operating as a client comprising a memory and a processor, the processor configured to:
• display a graphical user interface (GUI), the GUI comprising control graphic items;
• examine a graphical image of the GUI to determine if there has been a change over time in the GUI as displayed which updates a control graphic item;
• if there has been a change over time in the GUI as displayed which updates a control graphic item, then take an action, the action selected from:
• updating properties of an object construct corresponding to the control graphic item;
• and
• raising an event corresponding to an object construct corresponding to the control graphic item.

A method for communication between a first executing software program and a second executing software program, the method comprising:

• the first executing software program obtaining a graphical image displayed by the second executing software program;
• the first executing software program determining if there has been a change in a visual depiction of a graphical control within the obtained graphical image as compared to a previously cached version of the visual depiction of a graphical control in a graphical image displayed by the second executing software program;
• and
• if there has been a change then notifying a process of the change.