Techniques to quantify effectiveness of site-wide actions

A computer program product including one or more non-transitory machine readable mediums encoded with instructions that when executed by one or more processors cause a process to be carried out to quantify effectiveness of a site-wide action, the process comprising:

• identifying a treatment group based on a modified treatment period, the modified treatment period encompassing an intervention of a site-wide action, the modified treatment period including a pre-intervention time period and a post-intervention time period;
• selecting a control group from a control period prior to the modified treatment period;
• determining a metric for analyzing effectiveness of the site-wide action;
• and
• performing a modified difference-in-differences (DiD) estimation for the metric based on the modified treatment period, the treatment group, the control period, and the control group.

A system to quantify effectiveness of a site-wide action, the system comprising:

• one or more non-transitory machine readable mediums configured to store instructions;
• and
• one or more processors configured to execute the instructions stored on the one or more non-transitory machine readable mediums, wherein execution of the instructions causes the one or more processors to
• identify a treatment group based on a modified treatment period, the modified treatment period encompassing an intervention of a site-wide action, the modified treatment period including a pre-intervention time period and a post-intervention time period,
• select a control group from a control period prior to the modified treatment period,
• determine a metric for analyzing effectiveness of the site-wide action, and
• perform a modified difference-in-differences (DiD) estimation for the metric based on the modified treatment period, the treatment group, the control period, and the control group.