Systems and methods for providing control of application execution

A non-transitory computer readable storage medium including instructions that, when executed by a processor, cause the processor to perform a method comprising:

• receiving, at a server computer system, an identifier of a user system specified by a developer remote to the server computer system, an identifier of a feature of an application running on the user system, and one or more definition values that define a first treatment that configures execution of the feature of the application within the application running on the user system, wherein the identifier of the user system specified by the developer of the user system is received from the developer and is a unique developer defined reference value that provides identification of the user system anonymously to the server computer system;
• storing, in a memory of the server computer system, the identifier of the user system specified by the developer of the user system, the identifier of the feature of the application running on the user system, and the one or more definition values of the first treatment to be applied to the feature of the application;
• and
• configuring, by the server computer system, the application during runtime execution of the application at the user system by applying the definition values of the first treatment to the feature of the application based on the identifier of the user system and the identifier of the feature of the application stored in the memory, wherein the user system is a member of a first subset of a plurality of user systems identified as a first segment of users, wherein each member of the first subset of the plurality of user systems is provided with the one or more definition values of the first treatment for configuring the feature of the application with the first treatment, and wherein each member of a second subset of the plurality of user systems identified as a second segment of users is provided with one or more different definition values for configuring the feature of the application with a second treatment, the method further comprising:
• receiving, at the server computer system, two or more performance reports generated by the first segment of users and the second segment of users, the two or more performance reports comprising data indicative of an interaction of a user of the user system and interactions of members of the first segment with the feature of the application configured by the first treatment and data indicative of interactions of members of the second segment with the feature of the application configured by the second treatment,
• comparing interactions of the user and users from the first segment of users with the feature of the application from one or more performance reports received from the first segment of users having the feature of the application configured with the first treatment, with interactions of users from the second segment of users with the feature of the application from one or more performance reports received from the second segment of users having the feature of the application configured with the second treatment, wherein a result of the comparison determines an impact of the feature of the application configured by the first treatment on users of the first segment with the feature of the application, the application, or a combination thereof satisfying a predetermined condition, and
• determining, based on the result of the comparison, a trend in one or more predetermined operating parameters associated with execution of the application over a period of time experienced by the first segment of users, the second segment of user, or both segments of users, wherein the trend is indicative of a predetermined direction of movement of the one or more predetermined operating parameters and that does not satisfy one or more predetermined thresholds relative to the predetermined direction of movement over the period of time, and
• transmitting a notification to the developer of the application indicating the determined trend and the predetermined direction of movement of the one or more predetermined operating parameters over the period of time.

A server computer system, comprising:

• a memory;
• and
• a processor coupled with the memory, the processor configured to:
• receive an identifier of a user system specified by a developer remote to the server computer system, an identifier of a feature of an application running on the user system, and one or more definition values that define a first treatment that configures execution of the feature of the application within the application running on the user system, wherein the identifier of the user system specified by the developer of the user system is received from the developer and is a unique developer defined reference value that provides identification of the user system anonymously to the server computer system,
• store, in the memory, the identifier of the user system specified by the developer, the identifier of the feature of the application running on the user system, and the one or more definition values of the first treatment to be applied to the feature of the application, and
• configure the application during runtime execution of the application at the user system by applying the definition values of the first treatment to the feature of the application based on the identifier of the user system and the identifier of the feature of the application stored in the memory, wherein the user system is a member of a first subset of a plurality of user systems identified as a first segment of users, wherein each member of the first subset of the plurality of user systems is provided with the one or more definition values of the first treatment for configuring the feature of the application with the first treatment, and wherein each member of a second subset of the plurality of user systems identified as a second segment of users is provided with one or more different definition values for configuring the feature of the application with a second treatment, the processor is further configured to:
• receive, at the server computer system, two or more performance reports generated by the first segment of users and the second segment of users, the two or more performance reports comprising data indicative of an interaction of a user of the user system and interactions of members of the first segment with the feature of the application configured by the first treatment and data indicative of interactions of members of the second segment with the feature of the application configured by the second treatment,
• compare interactions of the user and users from the first segment of users with the feature of the application from one or more performance reports received from the first segment of users having the feature of the application configured with the first treatment, with interactions of users from the second segment of users with the feature of the application from one or more performance reports received from the second segment of users having the feature of the application configured with the second treatment, wherein a result of the comparison determines an impact of the feature of the application configured by the first treatment on users of the first segment with the feature of the application, the application, or a combination thereof satisfying a predetermined condition, and
• determine, based on results of the comparison, a trend in one or more predetermined operating parameters associated with execution of the application over a period of time experienced by the first segment of users, the second segment of user, or both segments of users, wherein the trend is indicative of a predetermined direction of movement of the one or more predetermined operating parameters and that does not satisfy one or more predetermined thresholds relative to the predetermined direction of movement over the period of time, and
• transmit a notification to the developer of the application indicating the determined trend and the predetermined direction of movement of the one or more predetermined operating parameters over the period of time.