System and method for interface display screen manipulation

A computer-implemented display screen modification method comprising:

• analyzing, by a computer processor, a display screen;
• determining, by the computer processor, one or more user interface objects of the display screen based on the analysis, each of the one or more user interface objects corresponding to an object type;
• determining, by the computer processor, one or more sub-screens of the display screen based on the one or more user interface objects;
• generating, by the computer processor, a new display screen template, the new display screen template comprising a first set of pointers in a first instantiation data structure corresponding to the display screen, the first set of pointers each referencing sub-screen templates corresponding to the one or more sub-screens;
• obtaining, by the computer processor, a user input of an instruction to modify a characteristic of the portion of the display screen;
• and
• responsive to the instruction, modifying, by the computer processor, a modification script associated with the new display screen template, the modification script stored in the first instantiation data structure.

A computer-implemented display screen modification method, comprising:

• capturing, by a computer processor, a display screen;
• determining, by the computer processor, one or more sub-screens of the display screen by setting an object of the one or more user interface objects as a sub-screen;
• generating, by the computer processor, a signature for each of the one or more sub-screens, the signature for each of the one or more sub-screens being representative of a content of the associated sub-screen;
• determining, by the computer processor, that a first sub-screen of the one or more sub-screens is outside of a threshold distance from one or more stored screen templates by comparing the signature for the first sub-screen with signatures associated with the one or more stored screen templates;
• generating, by the computer processor, one or more sub-screen templates based on a generalized version of the first sub-screen responsive to the determination that the first sub-screen is outside of the threshold distance;
• identifying, by the processor, a stored screen template of the one or more stored screen templates that corresponds to the display screen by comparing the signatures of each of the one or more sub-screen templates to the signatures of the one or more stored screen templates, wherein the stored screen template is identified based upon a determination that the signature of the stored screen template is within a threshold distance of at least one of the signatures of the one or more sub-screen templates;
• and
• responsive to a first instruction, modifying, by the computer processor, a first stored screen template of the one or more stored screen templates.