Method and system for detecting gaps in data buckets for a/b experimentation

A system for detecting data bucket discrepancies associated with online experiments, the system comprising:

• an experimentation system configured to generate a monitoring layer within an online experimentation platform, the experimentation platform comprising at least a first layer, and wherein:
• a first online experiment is associated with the first layer;
• the monitoring layer comprises a monitoring layer data bucket;
• and
• the first layer comprises at least a first data bucket;
• and
• a discrepancy detection system configured to:
• obtain first data representing user activity associated with a first plurality of identifiers, the user activity being associated with the first layer;
• generate, based on the first data, second data representing at least one user engagement parameter;
• and
• determine a first discrepancy between the first data and the second data, wherein the first discrepancy indicates a first amount of identifiers that comprise a first metadata tag associated with the first layer and lack a second metadata tag associated with the monitoring layer.

A non-transitory computer readable medium having instructions recorded thereon for detecting data bucket discrepancies associated with online experiments, wherein the instructions, when read by a computer, cause the computer to:

• generate a monitoring layer within an online experimentation platform, the experimentation platform comprising at least a first layer, wherein:
• a first online experiment is associated with the first layer;
• the monitoring layer comprises a monitoring layer data bucket;
• and
• the first layer comprises at least a first data bucket;
• obtain first data representing user activity associated with a first plurality of identifiers, the user activity being associated with the first layer;
• generate, based on the first data, second data representing at least one user engagement parameter;
• and
• determine a first discrepancy between the first data and the second data, wherein the first discrepancy indicates a first amount of identifiers that comprise a first metadata tag associated with the first layer and lack a second metadata tag associated with the monitoring layer.