Experimentation in internet-connected applications and devices
AssigneeOptimizely, Inc.
InventorsVijay Jambu, John Provine, Rama Ranganath, Ali Abbas Rizvi
Life of this patent
Estimating the term…
Abstract
A content variation experiment system for performing variation testing of web pages is disclosed. A content provider receives requests for a web page undergoing an experiment. The content provider determines a variation from a plurality of variations of the web page to provide to the user. The content provider makes the determination without sending a network request to an experiment definition system used to define the experiment thereby reducing network latency.
Claims20
A method, comprising:
- determining, by a computer processor of a content provider system, a variation of a content item from the plurality of different variations of the content item to provide to a client device without communicating with an experiment definition system, the determination based on a stored experiment definition file and first information;
- and
- providing, by the computer processor of a content provider system, the determined variation of the content item to the client device.
A non-transitory computer-readable storage medium storing executable code that when executed by a computer processor, cause the computer processor to:
- determine, by the computer processor, a variation of a content item from the plurality of different variations of the content item to provide to a client device without communicating with an experiment definition system, the determination based on a stored experiment definition file and first information;
- and
- provide, by the computer processor of a content provider system, the determined variation of the content item to the client device.
The non-transitory computer-readable storage medium of claim 15, wherein the computer processor further to:
- transmit a request for statistics associated with the variation experiment of the content item to the experiment definition system;
- and
- receive the statistics associated with the variation experiment of the content item from the experiment definition system, the statistics calculated based on the tracked events reported to the experiment definition system.
A content provider computer system, comprising:
- a computer processor to:
- determine a variation of a content item from the plurality of different variations of the content item to provide to a client device without communicating with an experiment definition system, the determination based on a stored experiment definition file and first information;
- and
- provide the determined variation of the content item to the client device.
A non-transitory computer-readable storage medium storing executable code that when executed by a computer processor of an experiment definition system, cause the computer processor to:
- receive, from a content provider system by an experiment definition system, attributes of a variation experiment, the attributes including a definition for each of a plurality of different variations of one or more content items provided by the content provider system;
- generate, by the computer processor of the experiment definition system, an experiment definition file that include the attributes of the variation experiment for one or more content items;
- provide, by the experiment definition system to the content provide system, the experiment definition file and first information to determine a variation of a content item from the plurality of different variations of the content item to provide to a client device without communicating with an experiment definition system.
Dependencies are inferred from the claim text.