Gui element acquisition using a plurality of alternative representations of the gui element

A computer program product comprising a non-transitory computer readable storage medium retaining program instructions, which program instructions when read by a processor, cause the processor to perform:

• obtaining a selection of a Graphical User Interface (GUI) element;
• obtaining a representation set of the GUI element, wherein the representation set comprises a plurality of alternative representations, wherein each alternative representation of the plurality of alternative representations provides a different manner of identifying the GUI element in GUIs that utilizes a different characterization of the GUI element;
• applying the representation set to identify the GUI element in a GUI of a program, wherein said applying the representation set comprises, for each representation of the plurality of alternative representations, independently applying the each representation to identify one or more GUI elements corresponding the each representation;
• and
• in response to determining that said applying the representation set provides an indefinite result, obtaining a modified representation set.

An apparatus comprising a processor and a coupled memory, the processor being adapted to perform the steps of:

• obtaining a selection of a Graphical User Interface (GUI) element;
• obtaining a representation set of the GUI element, wherein the representation set comprises a plurality of alternative representations, wherein each alternative representation of the plurality of alternative representations provides a different manner of identifying the GUI element in GUIs that utilizes a different characterization of the GUI element;
• applying the representation set to identify the GUI element in a GUI of a program, wherein said applying the representation set comprises, for each representation of the plurality of alternative representations, independently applying the each representation to identify one or more GUI elements corresponding the each representation;
• and
• in response to determining that said applying the representation set provides an indefinite result, obtaining a modified representation set.