Experimentation in internet-connected applications and devices
AssigneeOptimizely, Inc.
InventorsVijay Jambu, John Provine, Rama Ranganath, Ali Abbas Rizvi
Life of this patent
Estimating the term…
Abstract
A content variation experiment system for performing variation testing of web pages is disclosed. A content provider receives requests for a web page undergoing an experiment. The content provider determines a variation from a plurality of variations of the web page to provide to the user. The content provider makes the determination without sending a network request to an experiment definition system used to define the experiment thereby reducing network latency.
Claims17
A computer-implemented method for determining a variation of a web page to provide to a client device, the method comprising:
- providing, by a content provider, attributes of a variation experiment to an experiment definition system, the attributes including a definition for each of a plurality of different variations of a web page provided by the content provider;
- storing, by the content provider, an experiment definition file received from the experiment definition system, the experiment definition file describing the attributes of the variation experiment for the web page provided by the content provider;
- receiving, by the content provider, a first code block generated by the experiment definition system that allocates users requesting the web page to one of the plurality of different variations of the web page defined in the attributes of the variation experiment;
- including, by the content provider, the first code block in source code of the web page provided by the content provider;
- receiving, by the content provider, a request for the web page from a client device;
- determining, by the content provider, a variation from the plurality of different variations of the web page to provide to the client device without communicating with the experiment definition system, the determination based on the stored experiment definition file and the first code block;
- and
- providing, by the content provider, the determined variation of the web page to the client device.
A computer program product comprising a non-transitory computer-readable storage medium storing executable code for determining a variation of a web page to provide to a client device, the code when executed causing a computer to perform steps comprising:
- providing, by a content provider, attributes of a variation experiment to an experiment definition system, the attributes including a definition for each of a plurality of different variations of a web page provided by the content provider;
- storing, by the content provider, an experiment definition file received from the experiment definition system, the experiment definition file describing the attributes of the variation experiment for the web page provided by the content provider;
- receiving, by the content provider, a first code block generated by the experiment definition system that allocates users requesting the web page to one of the plurality of different variations of the web page defined in the attributes of the variation experiment;
- including, by the content provider, the first code block in source code of the web page provided by the content provider;
- receiving, by the content provider, a request for the web page from a client device;
- determining, by the content provider, a variation from the plurality of different variations of the web page to provide to the client device without communicating with the experiment definition system, the determination based on the stored experiment definition file and the first code block;
- and
- providing, by the content provider, the determined variation of the web page to the client device.
A content provider computer system for determining a variation of a web page to provide to a client device, the computer system comprising:
- a computer processor;
- a non-transitory computer-readable storage medium storing executable code, the code when executed by the computer processor causes the computer processor to perform steps comprising:
- providing, by the content provider computer system, attributes of a variation experiment to an experiment definition system, the attributes including a definition for each of a plurality of different variations of a web page provided by the content provider computer system;
- storing, by the content provider computer system, an experiment definition file received from the experiment definition system, the experiment definition file describing attributes of the variation experiment for the web page provided by the content provider;
- receiving, by the content provider computer system, a first code block generated by the experiment definition system that allocates users requesting the web page to one of the plurality of different variations of the web page defined in the attributes of the variation experiment;
- including, by the content provider computer system, the first code block in source code of the web page provided by the content provider computer system;
- receiving, by the content provider computer system, a request for the web page from a client device;
- determining, by the content provider computer system, a variation from the plurality of different variations of the web page to provide to the client device without communicating with the experiment definition system, the determination based on the stored experiment definition file and the first code block;
- and
- providing, by the content provider computer system, the determined variation of the web page to the client device.
Dependencies are inferred from the claim text.