# US 2025/0086087 A1 · Application performance evaluation with dual model > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0086087 A1 - Document ID: US20250086087A1 - Status: Published application - Kind: A1 - Application number: 18/462,503 - Filed: 2023-09-07 - Published: 2025-03-13 - Earliest claimed: 2023-09-07 - Assignees: International Business Machines Corporation - Applicants: International Business Machines - Inventors: Ying MO; Wu DI; Xing TIAN; Qing Zhi YU; Nan CHEN; Ju Ling LIU - Web page: https://patentgrep.com/patent/US20250086087A1 ## CPC - G06F 11/3457: {Performance evaluation by simulation} - G06F 11/3409: {for performance assessment} - G06F 11/3688: {for test execution, e.g. scheduling of test suites} - G06F 11/3698: Environments for analysis, debugging or testing of software - G06N 20/00: Machine learning - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Computer implemented methods, systems, and computer program products include program code executing on a processor(s) obtain factor(s) relevant to a given resource. The program code determines relationships between the factor(s). Based on parameters comprising the relationships, the program code identifies, from a search space, configuration(s) for resource(s) and configuration(s) for workload(s) in the computing environment. The program code executes, based on a pre-defined policy, a test: a workload configured according to a configuration in a system under test instance configured according to a configuration. The program code obtains performance measurements for the test in the system under test instance. The program code utilizes the performance measurements to update a known data set. ## Claims ### Claim 1 A computer-implemented method of predicting optimal configurations for deploying a given resource in a computing environment, the method comprising: obtaining, by one or more processors, one or more factors relevant to the given resource; determining, by the one or more processors, relationships between the one or more factors; based on parameters comprising the relationships, identifying, by the one or more processors, from a search space, one or more resources configurations for at least one resource and one or more workload configurations for at least one workload in the computing environment; executing, by the one or more processors, based on a pre-defined policy, a test, wherein the test executes a workload configured according to a workload configuration of the one or more workload configurations for the at least one workload in a system under a test instance configured according to a resource configuration of the one or more resource configurations for the at least one resource; obtaining, by the one or more processors, performance measurements for the test in the system under test instance; and utilizing, by the one or more processors, the performance measurements to update a known data set. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the parameters further comprise the known data set. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein the parameters further comprise hyper-parameters reflecting how the computing environment performs in when the one or more factors comprise specific values. ### Claim 4 (depends on 3) The computer-implemented method of claim 3, further comprising: applying, by the one or more processors, a linear regression on known performance criteria to derive the hyper-parameters. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, further comprising: based on the parameters comprising the relationships and the known data set, identifying, by the one or more processors, from the search space, a first additional one or more resources configurations for the at least one resource and a second additional one or more workload configurations for the at least one workload in the computing environment; executing, by the one or more processors, based on the pre-defined policy, the test; obtaining, by the one or more processors, additional performance measurements for the test in the system under test instance; and determining, by the one or more processors, based on the additional performance measurements, if pre-defined stopping criteria have been reached. ### Claim 6 (depends on 5) The computer-implemented method of claim 5, further comprising: based on determining that the pre-defined stopping criteria have been reached, identifying, by the one or more processors, a given resource configuration of the additional one or more resource configurations for the at least one resource and a given workload configuration of the additional one or more workload configurations for the at least one workload meeting the pre-defined stopping criteria, wherein the given resource configuration of the additional one or more resource configurations for the at least one resource and the given workload configuration of the additional one or more workload configurations for the at least one workload meeting the pre-defined stopping criteria comprise an optimal workload configuration and an optimal resource configuration. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, further comprising: implementing, by the one or more processors, the optimal workload configuration and the optimal resource configuration when deploying the given resource in the computing environment. ### Claim 8 (depends on 5) The computer-implemented method of claim 5, further comprising: based on determining that the pre-defined stopping criteria have not been reached, updating, by the one or more processors, the known data set with the additional performance measurements; and iteratively executing a process until the pre-defined stopping criteria have been reached, the process comprising: based on the parameters comprising the relationships and the known data set, identifying, by the one or more processors, from the search space, another one or more resource configurations for the at least one resource and another one or more workload configurations for the at least one workload in the computing environment; executing, by the one or more processors, based on the pre-defined policy, the test; obtaining, by the one or more processors, other performance measurements for the test in the system under test instance; and determining, by the one or more processors, based on the other performance measurements, if the pre-defined stopping criteria have been reached. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, wherein executing the test further comprises: provisioning, by the one or more processors, one or more system under test instances based on the system under test instance according to the resource configuration of the one or more resource configurations for at the least one resource. ### Claim 10 (depends on 9) The computer-implemented method of claim 9, wherein the provisioning comprises provisioning at least one system under test instance for each resource configuration of the one or more resource configurations for at the least one resource; and scheduling, by the one or more processors, the test in each system under test instance, wherein at least two tests run in parallel. ### Claim 11 (depends on 1) The computer-implemented of claim 1, wherein executing the test based on the pre-defined policy, comprises applying, by the one or more processors, an objective function to predict the performance measurements. ### Claim 12 (depends on 1) The computer-implemented method of claim 1, wherein the one or more factors relevant to the given resource are selected from the group consisting of: resource factors, workload factors, and performance criteria. ### Claim 13 (depends on 12) The computer-implemented method of claim 12, wherein the one or more factors comprise resource factors and the resource factors are selected from the group consisting of: number of nodes, number of pods, computer processing units, and number of memory units. ### Claim 14 (depends on 12) The computer-implemented method of claim 12, wherein the one or more factors comprise workload factors and the workload factors are selected from the group consisting of: number of entities, number of spans, and number of metrics. ### Claim 15 (depends on 12) The computer-implemented method of claim 12, wherein the one or more factors comprise performance criteria and the performance criteria are selected from the group consisting of: response time, throughput, and error rate. ### Claim 16 (depends on 1) The computer-implemented method of claim 1, wherein the given resource is a software application. ### Claim 17 (depends on 1) The computer-implemented method of claim 1, wherein the at least one workload comprises a workload of the given resource and the at least one resource would execute the given resource after deployment of the given resource in the computing environment. ### Claim 18 A computer system for predicting optimal configurations for deploying a given resource in a computing environment, the computer system comprising: a memory; and one or more processors in communication with the memory, wherein the computer system is configured to perform a method, said method comprising: obtaining, by the one or more processors, one or more factors relevant to the given resource; determining, by the one or more processors, relationships between the one or more factors; based on parameters comprising the relationships, identifying, by the one or more processors, from a search space, one or more resources configurations for at least one resource and one or more workload configurations for at least one workload in the computing environment; executing, by the one or more processors, based on a pre-defined policy, a test, wherein the test executes a workload configured according to a workload configuration of the one or more workload configurations for the at least one workload in a system under a test instance configured according to a resource configuration of the one or more resource configurations for the at least one resource; obtaining, by the one or more processors, performance measurements for the test in the system under test instance; and utilizing, by the one or more processors, the performance measurements to update a known data set. ### Claim 19 (depends on 18) The computer system of claim 18, the method further comprising: based on the parameters comprising the relationships and the known data set, identifying, by the one or more processors, from the search space, a first additional one or more resources configurations for the at least one resource and a second additional one or more workload configurations for the at least one workload in the computing environment; executing, by the one or more processors, based on the pre-defined policy, the test; obtaining, by the one or more processors, additional performance measurements for the test in the system under test instance; determining, by the one or more processors, based on the additional performance measurements, if pre-defined stopping criteria have been reached; based on determining that the pre-defined stopping criteria have been reached, identifying, by the one or more processors, a given resource configuration of the additional one or more resource configurations for the at least one resource and a given workload configuration of the additional one or more workload configurations for the at least one workload meeting the pre-defined stopping criteria, wherein the given resource configuration of the additional one or more resource configurations for the at least one resource and the given workload configuration of the additional one or more workload configurations for the at least one workload meeting the pre-defined stopping criteria comprise an optimal workload configuration and an optimal resource configuration. ### Claim 20 A computer program product for predicting optimal configurations for deploying a given resource in a computing environment, the computer program product comprising: one or more computer readable storage media and program instructions collectively stored on the one or more computer readable storage media readable by at least one processing circuit to: obtain, by the one or more processors, one or more factors relevant to the given resource; determine, by the one or more processors, relationships between the one or more factors; based on parameters comprising the relationships, identify, by the one or more processors, from a search space, one or more resources configurations for at least one resource and one or more workload configurations for at least one workload in the computing environment; execute, by the one or more processors, based on a pre-defined policy, a test, wherein the test executes a workload configured according to a workload configuration of the one or more workload configurations for the at least one workload in a system under a test instance configured according to a resource configuration of the one or more resource configurations for the at least one resource; obtain, by the one or more processors, performance measurements for the test in the system under test instance; and utilize, by the one or more processors, the performance measurements to update a known data set.