Shared experiment control

A non-transitory computer readable medium having instructions stored thereon, wherein the instructions, when executed by a processor cause a device to perform operations comprising:

• receiving a request for a page from a plurality of user devices, wherein the page contains one or more elements in a first layer;
• assigning each of the plurality of user devices to one of a shared control pool or one of a plurality of experiments for the first layer within the page, wherein the shared control pool includes a first percentage of the plurality of user devices and each of the plurality of experiments includes an experimental percentage of the plurality of user devices;
• transmitting the one or more elements contained in the page to each of the plurality of user devices, wherein a base version of each of the one or more elements of the first layer is provided to each of the plurality of user devices assigned to the shared control pool, a first variant element associated with the first experiment and a base version for each of a remaining of the one or more elements of the first layer is provided to each of the plurality of user devices assigned to the first experiment, and a second variant element associated with the second experiment and a base version for each of the remaining of the one or more elements of the first layer is provided to each of the plurality of user devices assigned to the second experiment;
• receiving, for each of the plurality of user devices, at least one record indicative of one or more interactions that occur after the transmission;
• comparing the one or more interactions of a first subset of user devices assigned to the shared control pool with the one or more interactions of each user device assigned to the first experiment;
• and
• comparing the one or more interactions of a second subset of user devices assigned to the shared control pool with the one or more interactions of each user device assigned to the second experiment.

A method, comprising:

• receiving a request for a page from a plurality of user devices, wherein the page contains one or more elements in a first layer;
• assigning each of the plurality of user devices to one of a shared control pool or one of a plurality of experiments for the first layer within the page, wherein the shared control pool includes a first percentage of the plurality of user devices and each of the plurality of experiments includes an experimental percentage of the plurality of user devices;
• transmitting the one or more elements contained in the page to each of the plurality of user devices, wherein a base version of each of the one or more elements of the first layer is provided to each of the plurality of user devices assigned to the shared control pool, a first variant element associated with the first experiment and a base version for each of a remaining of the one or more elements of the first layer is provided to each of the plurality of user devices assigned to the first experiment, and a second variant element associated with the second experiment and a base version for each of the remaining of the one or more elements of the first layer is provided to each of the plurality of user devices assigned to the second experiment;
• receiving, for each of the plurality of user devices, at least one record indicative of one or more interactions that occur after the transmission;
• comparing the one or more interactions of a first subset of user devices assigned to the shared control pool with the one or more interactions of each user device assigned to the first experiment;
• and
• comparing the one or more interactions of a second subset of user devices assigned to the shared control pool with the one or more interactions of each user device assigned to the second experiment.