System, method, and computer program for testing the accuracy of software that identifies user interface elements on a webpage

A non-transitory computer-readable medium comprising a computer program, that, when executed by a computer system, enables the computer system to perform the following steps for testing the accuracy of software that identifies UI elements on a webpage (“the auto-identifier software”), the steps comprising:

• enabling a user to tag UI elements on a webpage with labels, wherein the UI elements are fields and wherein the auto-identifier software is designed to automatically fill in fields in a webform;
• creating a normalized specification for the webpage, wherein the specification is created by a browser extension automatically tagging fields with a label and a user correcting or adding one or more labels to their corresponding field(s) to create and store a representation of all possible UI elements on the webpage plus relevant metadata in the specification, wherein the relevant metadata does not include metadata related to styling or behavior, and wherein the specification includes a mapping of UI elements to normalized labels;
• using the auto-identifier software to identify UI elements on the webpage;
• evaluating the performance of the auto-identifier software with respect to the webpage using the stored specification, wherein evaluating the performance of the auto-identifier software comprises determining whether the auto-identifier software correctly identified and correctly filled the fields on the webform that the auto-identifier software is tasked with auto-filling and correctly ignored the fields on the webform that the auto-identifier software is not tasked with auto-filling;
• and
• displaying diagnostics related to the performance of the auto-identifier software.

A computer system for testing the accuracy of software that identifies UI elements on a webpage (“the auto-identifier software”), the system comprising:

• one or more processors;
• one or more memory units coupled to the one or more processors, wherein the one or more memory units store instructions that, when executed by the one or more processors, cause the system to perform the operations of:
• enabling a user to tag UI elements on a webpage with labels, wherein the UI elements are fields and wherein the auto-identifier software is designed to automatically fill in fields in a webform;
• creating a normalized specification for the webpage, wherein the specification is created by a browser extension automatically tagging fields with a label and a user correcting or adding one or more labels to their corresponding field(s) to create and store a representation of all possible UI elements on the webpage plus relevant metadata in the specification, wherein the relevant metadata does not include metadata related to styling or behavior, and wherein the specification includes a mapping of UI elements to normalized labels;
• using the auto-identifier software to identify UI elements on the webpage;
• evaluating the performance of the auto-identifier software with respect to the webpage using the stored specification, wherein evaluating the performance of the auto-identifier software comprises determining whether the auto-identifier software correctly identified and correctly filled the fields on the webform that the auto-identifier software is tasked with auto-filling and correctly ignored the fields on the webform that the auto-identifier software is not tasked with auto-filling;
• and
• displaying diagnostics related to the performance of the auto-identifier software.