Computerized systems and methods for predicting a minimum detectable effect

A computer-implemented method, comprising:

• sending a first webpage to a first user device for presenting the first webpage in a first user interface of the first user device;
• sending a second webpage to a second user device for presenting the second webpage in a second user interface of the second user device,
• wherein the second webpage comprises at least one content element not on the first webpage;
• receiving, from the first user device, first user interaction data from indicating interaction with the first webpage via the first user interface by a first user input in real time;
• receiving, from the second user device, second user interaction data indicating interaction with the second webpage via the second user interface by a second user input in real time;
• determining, based on the first user interaction data and the second user interaction data, whether a p-value between a characteristic of the first user interaction data and a corresponding characteristic of the second user interaction data is lower than a first threshold;
• in response to a determination that the p-value is equal to or greater than the first threshold, determining, based on the first user interaction data and the second user interaction data, a current minimum detectable effect of success metrics indicative of a user experience;
• retrieving a set of historic minimum detectable effect values for the success metrics associated with an earlier period of time;
• determining a percentile rank of the current minimum detectable effect based on the retrieved set of historic minimum detectable effect values;
• predicting a first future value of the minimum detectable effect of the user experience;
• predicting a second future value of the minimum detectable effect of the user experience;
• aggregating the first and second future values of the minimum detectable effect of the user experience;
• determining, based on the current minimum detectable effect and the aggregated first and second future values, a termination condition;
• and
• causing the second webpage to become unavailable to the second user device when the termination condition exists.

A computer-implemented system, comprising:

• memory comprising processor instructions;
• and
• at least one processor configured to execute the instructions to perform steps comprising:
• sending a first webpage to a first user device for presenting the first webpage in a first user interface of the first user device;
• sending a second webpage to a second user device for presenting the second webpage in a second user interface of the second user device, wherein the second webpage comprises at least one content element not on the first webpage;
• receiving, from the first user device, first collecting user interaction data indicating interaction with the first webpage via the first user interface by a first user input in real time;
• receiving, from the second user device, second user interaction data indicating interaction with the second webpage via the second user interface by a second user input in real time;
• determining, based on the first user interaction data and the second user interaction data, whether a p-value between a characteristic of the first user interaction data and a corresponding characteristic of the second user interaction data is lower than a first threshold;
• in response to a determination that the p-value is equal to or greater than the first threshold, determining, based on the first user interaction data and the second user interaction data, a current minimum detectable effect of success metrics indicative of a user experience;
• retrieving a set of historic minimum detectable effect values for the success metrics associated with an earlier period of time;
• determining a percentile rank of the current minimum detectable effect based on the retrieved set of historic minimum detectable effect values;
• predicting a first future value of the minimum detectable effect of the user experience;
• predicting a second future value of the minimum detectable effect of the user experience;
• aggregating the first and second future values of the minimum detectable effect of the user experience;
• and
• determining, based on the current minimum detectable effect and the aggregated first and second future values of the minimum detectable effect of the user experience, to continue sending the second webpage to the second user device if the current minimum detectable effect and the aggregated first and second future values are not indicative of a termination condition, and causing the second webpage to become unavailable to the second user device if the current minimum detectable effect and the aggregated first and second future values are indicative of a termination condition.