Site-wide impact
AssigneeLinkedln Corporation
InventorsYa Xu, Omar Sinno, Adrian Axel Remigo Fernandez, Nanyu Chen, Kylan Matthew Nieh
Life of this patent
Estimating the term…
Abstract
Techniques for conducting A/B experimentation of online content are described. According to various embodiments, a site-wide impact value for an A/B experiment that is associated with a metric is calculated, the site-wide impact value indicating a predicted percentage change in the value of a metric responsive to application of a treatment variant to an entire portion of a targeted segment of members, in comparison to application of a control variant to an entire portion of the targeted segment of members.
Claims18
A method comprising:
- receiving a user specification of an online A/B experiment of online content being targeted at a segment of members of an online social networking service, a treatment variant of the A/B experiment being applied to a subset of the segment of members;
- accessing a value of a metric associated with application of the treatment variant of the A/B experiment to the subset of the segment of members;
- calculating, using one or more hardware processors, a site-wide impact value for the A/B experiment that is associated with the metric, the site-wide impact value indicating a predicted percentage change in the value of the metric responsive to application of the treatment variant to an entire portion of the targeted segment of members, in comparison to application of a control variant to an entire portion of the targeted segment of members;
- and
- displaying, via a user interface displayed on a client device, the site-wide impact value.
A system comprising:
- a processor;
- and
- a memory device holding an instruction set executable on the processor to cause the system to perform operations comprising:
- receiving a user specification of an online A/B experiment of online content being targeted at a segment of members of an online social networking service, a treatment variant of the A/B experiment being applied to a subset of the segment of members;
- accessing a value of a metric associated with application of the treatment variant of the A/B experiment to the subset of the segment of members;
- calculating a site-wide impact value for the A/B experiment that is associated with the metric, the site-wide impact value indicating a predicted percentage change in the value of the metric responsive to application of the treatment variant to an entire portion of the targeted segment of members, in comparison to application of a control variant to an entire portion of the targeted segment of members;
- and
- displaying, via a user interface displayed on a client device, the site-wide impact value.
A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
- receiving a user specification of an online A/B experiment of online content being targeted at a segment of members of an online social networking service, a treatment variant of the A/B experiment being applied to a subset of the segment of members;
- accessing a value of a metric associated with application of the treatment variant of the A/B experiment to the subset of the segment of members;
- calculating a site-wide impact value for the A/B experiment that is associated with the metric, the site-wide impact value indicating a predicted percentage change in the value of the metric responsive to application of the treatment variant to an entire portion of the targeted segment of members, in comparison to application of a control variant to an entire portion of the targeted segment of members;
- and
- displaying, via a user interface displayed on a client device, the site-wide impact value.
Dependencies are inferred from the claim text.