# US 11,909,655 B1 · Systems and methods for selective deployment of experimental configurations to mutually exclusive groups > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,909,655 B1 - Document ID: US11909655B1 - Status: Granted - Kind: B1 - Application number: 17/883,922 - Filed: 2022-08-09 - Published: 2024-02-15 - Granted: 2024-02-20 - Earliest claimed: 2022-08-09 - Assignees: Coupang Corp. - Applicants: Coupang Corp. - Inventors: Aldi Tjahjadi; ZhaoPing Yan; Ngoc-Lan Isabelle Phan; Jean-Baptiste Rieu - Web page: https://patentgrep.com/patent/US11909655B1 ## CPC - H04L 47/2475: for supporting traffic characterised by the type of applications - H04L 47/6215: {Individual queue per QOS, rate or priority} - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Computer-implemented systems and methods for selective deployment of experimental configurations are disclosed The systems and methods may include performing steps of deploying a webpage comprising a plurality of configurations, wherein the plurality of configurations exhibit different behaviors; configuring a traffic container comprising a first bucket and a second bucket based on user input; assigning one or more experiments to the traffic container based on the user input, wherein the one or more experiments determine appropriate configurations for the first bucket and the second bucket; accepting incoming traffic for accessing the webpage; randomly assigning a first subset of the incoming traffic to the first bucket and a second subset of the incoming traffic to the second bucket; transmitting the webpage in appropriate configurations based on the random assignments; and obtaining one or more measurements indicative of relative performances of the appropriate configurations. ## Claims ### Claim 1 A computer-implemented method for selective deployment of experimental configurations, the computer-implemented method comprising: deploying a webpage comprising a plurality of configurations, wherein the plurality of configurations exhibit different behaviors; configuring a traffic container comprising a first bucket and a second bucket based on user input; assigning one or more experiments to the traffic container based on the user input, wherein the one or more experiments determine appropriate configurations among the plurality of configurations for the first bucket and the second bucket, wherein assigning the one or more experiments includes: determining current assignments of the one or more experiments; and generating a message based on the current assignments and an indication that the one or more experiments will be reassigned; accepting incoming traffic for accessing the webpage; randomly assigning a first subset of the incoming traffic to the first bucket and a second subset of the incoming traffic to the second bucket; transmitting the webpage in the appropriate configurations based on the random assignments; and obtaining one or more measurements indicative of relative performances of the appropriate configurations. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the different behaviors comprise any one or combination of: presenting different layouts, using different algorithms, and displaying different contents. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein the plurality of configurations each comprise different combination of independent behaviors. ### Claim 4 (depends on 3) The computer-implemented method of claim 3, wherein the independent behaviors comprise at least one of: page layout, search algorithm, and advertisement suggestion. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein the first subset and the second subset are mutually exclusive. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein a union of the first subset of the incoming traffic and the second subset of the incoming traffic is less than the incoming traffic. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, wherein the user input comprises at least one codeless manipulation of the traffic container. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, further comprising: adding a third bucket to the traffic container, wherein the one or more experiments determine the appropriate configurations for the third bucket; randomly assigning a third subset of the incoming traffic to the third bucket, wherein the first subset, the second subset, and the third subset comprise different proportions of the incoming traffic. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, wherein the one or more experiments comprise at least two experiments that have a parent-child relationship or are synchronized. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, wherein subsequent incoming traffic associated with a first external user device is assigned to a first configuration if a first incoming traffic associated with the first external user device had been randomly assigned to the first configuration. ### Claim 11 A computer-implemented system for selective deployment of experimental configurations, the computer-implemented system comprising: at least one non-transitory computer-readable medium configured to store instructions; and at least one processor configured to execute the instructions to perform operations comprising: deploying a webpage comprising a plurality of configurations, wherein the plurality of configurations exhibit different behaviors; configuring a traffic container comprising a first bucket and a second bucket based on user input; assigning one or more experiments to the traffic container based on the user input, wherein the one or more experiments determine the appropriate configurations among the plurality of configurations for the first bucket and the second bucket, wherein assigning the one or more experiments includes: determining current assignments of the one or more experiments; and generating a message based on the current assignments and an indication that the one or more experiments will be reassigned; accepting incoming traffic for accessing the webpage; randomly assigning a first subset of the incoming traffic to the first bucket and a second subset of the incoming traffic to the second bucket; transmitting the webpage in the appropriate configurations based on the random assignments; and obtaining one or more measurements indicative of relative performances of the appropriate configurations. ### Claim 12 (depends on 11) The computer-implemented system of claim 11, wherein the different behaviors comprise any one or combination of: presenting different layouts, using different algorithms, and displaying different contents. ### Claim 13 (depends on 11) The computer-implemented system of claim 11, wherein the plurality of configurations each comprise different combination of independent behaviors. ### Claim 14 (depends on 11) The computer-implemented system of claim 11, wherein the first subset and the second subset are mutually exclusive. ### Claim 15 (depends on 11) The computer-implemented system of claim 11, wherein a union of the first subset of the incoming traffic and the second subset of the incoming traffic is less than the incoming traffic. ### Claim 16 (depends on 11) The computer-implemented system of claim 11, wherein the user input comprises at least one codeless manipulation of the traffic container. ### Claim 17 (depends on 11) The computer-implemented system of claim 11, further comprising: adding a third bucket to the traffic container, wherein the one or more experiments determine the appropriate configurations for the third bucket; randomly assigning a third subset of the incoming traffic to the third bucket, wherein the first subset, the second subset, and the third subset comprise different proportions of the incoming traffic. ### Claim 18 (depends on 11) The computer-implemented system of claim 11, wherein the one or more experiments comprise at least two experiments that have a parent-child relationship or are synchronized. ### Claim 19 (depends on 11) The computer-implemented system of claim 11, wherein subsequent incoming traffic associated with a first external user device is assigned to a first configuration if a first incoming traffic associated with the first external user device had been randomly assigned to the first configuration. ### Claim 20 A computer-implemented system for selective deployment of experimental configurations, the computer-implemented system comprising: at least one non-transitory computer-readable medium configured to store instructions; and at least one processor configured to execute the instructions to perform operations comprising: deploying a webpage comprising a plurality of configurations, wherein the plurality of configurations exhibit different behaviors; assigning one or more experiments to a traffic container configured to assign the plurality of configurations to incoming traffic, wherein assigning the one or more experiments includes: determining current assignments of the one or more experiments; and generating a message based on the current assignments and an indication that the one or more experiments will be reassigned; accepting the incoming traffic for accessing the webpage; randomly assigning: a first subset of the incoming traffic to a first configuration, a second subset of the incoming traffic to a second configuration, a third subset of the incoming traffic to a third configuration, and a fourth subset of the incoming traffic to a fourth configuration; transmitting the webpage in one of the plurality of configurations based on the random assignments, wherein the first subset is mutually exclusive with the second subset but not with the third subset; and obtaining one or more measurements indicative of relative performances of the plurality of configurations.