# US 12,216,729 B2 · Adaptive data platforms > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,216,729 B2 - Document ID: US12216729B2 - Status: Granted - Kind: B2 - Application number: 18/237,704 - Filed: 2023-08-24 - Published: 2023-12-14 - Granted: 2025-02-04 - Earliest claimed: 2018-12-05 - Assignees: eBay Inc. - Applicants: eBay Inc. - Inventors: Deepak Kumar Vasthimal; Pavan Kumar Srirama; Arun Kumar Akkinapalli - Web page: https://patentgrep.com/patent/US12216729B2 ## CPC - G06F 16/958: Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 9/451: Execution arrangements for user interfaces - G06F 11/3419: {by assessing time} - G06F 11/3438: {monitoring of user actions (tracking the activity of the user H04L67/535)} - G06F 11/3447: {Performance evaluation by modeling} - G06F 11/3452: {Performance evaluation by statistical analysis} - G06N 20/00: Machine learning - G06Q 30/0242: Determining effectiveness of advertisements - G06Q 30/0641: {utilising user interfaces specially adapted for shopping} - G06F 8/38: for implementing user interfaces - G06F 2201/86: Event-based monitoring - G06F 2201/88: Monitoring involving counting - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract An experimentation platform controls testing of features by an application server. Based on a user identifier, the experimentation platform determines which feature should be provided, and the application server provides the corresponding version of a user interface. If the user behavior data shows that using a tested feature results in an improvement, the tested feature will be adopted. To determine whether or not an improvement is observed, a statistically significant amount of data is gathered. The experimentation platform gathers data regarding user behavior for the feature versions and, in response, adjusts the frequency at which each version is served. Providing the proposed version to an increased percentage of users decreases the total number of page serves required to gather statistically significant data. The experimentation platform may provide an updated projected time to completion of testing based on the changed percentage of users receiving the proposed version. ## Claims ### Claim 1 A method for testing a user interface flow, the method comprising: receiving a front page of a user interface that includes an interactive element; by one or more processors, automatically generating a first user interface including a first collection of pages configured for display in a first order following the front page upon user interaction with the interactive element of the front page; by the one or more processors, automatically generating a second user interface including a second collection of pages configured for display in a second order following the front page upon the user interaction with the interactive element of the front page, the second collection of pages including at least one page of the first collection of pages and at least one page that is different from the first collection of pages; providing the first user interface to a first user device; providing the second user interface to a second user device; based on interactions with the first user interface and the second user interface, determining a set of test results; and based on the set of test results, automatically providing a third user interface including the first collection of pages or the second collection of pages following the front page upon the user interaction with the interactive element of the front page. ### Claim 2 (depends on 1) The method of claim 1, wherein the first collection of pages includes a first page following the front page that is different from a first page of the second collection of pages following the front page. ### Claim 3 (depends on 1) The method of claim 1, wherein the third user interface comprises at least one page from the first user interface or the second user interface. ### Claim 4 (depends on 1) The method of claim 1, wherein the user interaction with the interactive element of the front page comprises clicking a button. ### Claim 5 (depends on 1) The method of claim 1, wherein the third user interface is provided to a third user device for display. ### Claim 6 (depends on 1) The method of claim 1, wherein the second collection of pages comprises a different user interface element from the first collection of pages. ### Claim 7 (depends on 1) The method of claim 1, wherein the second collection of pages comprises a user interface element from the first collection of pages. ### Claim 8 (depends on 1) The method of claim 1, further comprising analyzing a first performance of the first user interface and a second performance of the second user interface and presenting the third user interface based on the analyzing. ### Claim 9 (depends on 8) The method of claim 8, wherein the first performance and the second performance indicate a degree of user interaction. ### Claim 10 A system comprising: at least one processor; and memory having stored instructions that are executable by the at least one processor to perform operations including: receiving a front page of a user interface that includes an interactive element; by one or more processors, automatically generating a first user interface including a first collection of pages configured for display in a first order following the front page upon user interaction with the interactive element of the front page; by the one or more processors, automatically generating a second user interface including a second collection of pages configured for display in a second order following the front page upon the user interaction with the interactive element of the front page, the second collection of pages including at least one page of the first collection of pages and at least one page that is different from the first collection of pages; providing the first user interface to a first user device; providing the second user interface to a second user device; based on interactions with the first user interface and the second user interface, determining a set of test results; and based on the set of test results, automatically providing a third user interface including the first collection of pages or the second collection of pages following the front page upon the user interaction with the interactive element of the front page. ### Claim 11 (depends on 10) The system of claim 10, wherein the first collection of pages includes a first page following the front page that is different from a first page of the second collection of pages following the front page. ### Claim 12 (depends on 10) The system of claim 10, wherein the third user interface comprises at least one page from the first user interface or the second user interface. ### Claim 13 (depends on 10) The system of claim 10, wherein the user interaction with the interactive element of the front page comprises clicking a button. ### Claim 14 (depends on 10) The system of claim 10, wherein the third user interface is provided to a third user device for display. ### Claim 15 (depends on 10) The system of claim 10, wherein the second collection of pages comprises a different user interface element from the first collection of pages. ### Claim 16 (depends on 10) The system of claim 10, further comprising analyzing a first performance of the first user interface and a second performance of the second user interface and presenting the third user interface based on the analyzing. ### Claim 17 Non-transitory computer-readable storage media comprising instructions, which when executed by one or more processors of a computing device, cause the computing device to perform operations including: receiving a front page of a user interface that includes an interactive element; by the one or more processors, automatically generating a first user interface including a first collection of pages configured for display in a first order following the front page upon user interaction with the interactive element of the front page; by the one or more processors, automatically generating a second user interface including a second collection of pages configured for display in a second order following the front page upon the user interaction with the interactive element of the front page, the second collection of pages including at least one page of the first collection of pages and at least one page that is different from the first collection of pages; providing the first user interface to a first user device; providing the second user interface to a second user device; based on interactions with the first user interface and the second user interface, determining a set of test results; and based on the set of test results, automatically providing a third user interface including the first collection of pages or the second collection of pages following the front page upon the user interaction with the interactive element of the front page. ### Claim 18 (depends on 17) The non-transitory computer-readable storage media of claim 17, wherein the first collection of pages includes a first page following the front page that is different from a first page of the second collection of pages following the front page. ### Claim 19 (depends on 17) The non-transitory computer-readable storage media of claim 17, wherein the third user interface comprises at least one page from the first user interface or the second user interface. ### Claim 20 (depends on 17) The non-transitory computer-readable storage media of claim 17, wherein the user interaction with the interactive element of the front page comprises clicking a button.