Facilitating consistent a/b testing assignment
AssigneeAdobe Systems Incorporated
InventorJohn Kucera
Life of this patent
Estimating the term…
Abstract
The present disclosure is directed toward systems and methods for providing consistent test versions of an A/B tested web page in an A/B test. For example, one or more embodiments described herein generate an A/B test mapping that associates ranges of identifiers with test versions of an A/B tested web page. Additionally, embodiments described herein generate a web page visitor token based on a random number that corresponds to a single identifier within the mapping. Each time the web page visitor requests the A/B tested web page, systems and methods described herein utilize the visitor token to consistently provide the same test version of the A/B tested web page to the web page visitor.
Claims20
In a digital medium environment for serving web pages over a network, a method of conducting A/B testing comprising:
- receiving, at a web server and from a client computing device, a first request for a web page;
- generating, by the web server and using a random number generator, a token for the client-computing device;
- identifying, based on the generated token for the client-computing device, a first test version of a plurality of test versions of the requested web page;
- providing the first test version of the requested web page and the generated token to the client-computing device;
- receiving, at the web server and from the client-computing device, a second request for the web page, wherein the second request comprises the token;
- identifying the first test version of the requested web page based on the token;
- and
- providing, to the client-computing device, the first test version of the requested web page.
In a digital medium environment for serving web pages over a network, a method of conducting A/B testing comprising:
- receiving, at a first web server, A/B test parameters that indicate an A/B test mapping of one or more ranges of mapping identifiers associated with one or more test versions of a first A/B tested web page or allow the first web server to generate the mapping;
- receiving a first web page request from a client-computing device for the first A/B tested web page, wherein the first web page request is for the first A/B tested web page and comprises a token associated with the client-computing device;
- identifying, within the A/B test mapping and based on the token, one of the one or more test versions of the first A/B tested web page;
- and
- providing the identified test version of the first A/B tested web page to the client-computing device.
A system for conducting A/B testing comprising:
- at least one processor;
- and
- at least one non-transitory computer-readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the system to:
- receive, from a client computing device, a first request for a web page;
- generate, using a random number generator, a token for the client-computing device;
- identify, based on the generated token for the client computing device, a first test version of the requested web page;
- provide the first test version of the requested web page and the generated token to the client-computing device;
- receive, from the client-computing device, a second request for the web page, wherein the second request comprises the token;
- identify the first test version of the requested web page based on the token;
- and
- provide, to the client-computing device, the first test version of the requested web page.
Dependencies are inferred from the claim text.