# US 2025/0094148 A1 · Post-deployment impact detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0094148 A1
- Document ID: US20250094148A1
- Status: Published application
- Kind: A1
- Application number: 18/469,315
- Filed: 2023-09-18
- Published: 2025-03-20
- Earliest claimed: 2023-09-18
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Ljubica Vujovic BOSKOVIC; Maja Stikic MRAZ; Neda Pistinjat NIKOLIC; Veljko Radoljub VASIC
- Web page: https://patentgrep.com/patent/US20250094148A1

## CPC

- G06F 8/60: Software deployment
- G06F 11/3409: {for performance assessment}
- G06F 11/3428: {Benchmarking}
- G06F 11/3466: {Performance evaluation by tracing or monitoring}
- G06F 11/3495: {for systems}
- G06F 2201/81: Threshold
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

System, methods, apparatuses, and computer program products are disclosed for determining post-deployment impact of a deployment based on telemetry information. Telemetry information is analyzed to determine a periodic workload executing on one or more of a plurality of endpoints. Pre-deployment performance metrics and post-deployment performance metrics are then determined based on telemetry information generated before the deployment and after the deployment, respectively. The post-deployment impact of the deployment may then be determined by comparing the pre-deployment performance metrics and the post-deployment performance metrics. Actions may be performed based on the post-deployment impact.

## Claims

### Claim 1

A method comprising:
analyzing telemetry information associated with workloads executing on a plurality of endpoints;
determining, based on the telemetry information, a first endpoint of the plurality of endpoints associated with a first periodic workload;
determining first values of a performance metric for the first endpoint, the first values associated with telemetry information generated prior to deploying a first deployment to the first endpoint;
determining second values of the performance metric for the first endpoint, the second values associated with telemetry information generated after deploying the first deployment to the first endpoint;
determining a first post-deployment impact of deploying the first deployment to the first endpoint by comparing the first values of the performance metric to the second values of the performance metric; and
performing a first action based at least on the first post-deployment impact.

### Claim 2 (depends on 1)

The method of claim 1, wherein said determining, based on the telemetry information, a first endpoint of the plurality of endpoints associated with a first periodic workload comprises:
determining, based on the telemetry information, a plurality of query hashes associated with the first endpoint;
determining that a first query hash of the plurality of query hashes repeats on a periodic basis with a periodicity that satisfies a predetermined relationship with a periodicity threshold;
determining a variation in query data associated with queries associated with the first query hash; and
determining that the variation in query data satisfies a predetermined relationship with a data variation threshold.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining, based on the telemetry information, a second endpoint of the plurality of endpoints associated with a second periodic workload;
determining third values of the performance metric for the second endpoint, the third values associated with telemetry information generated prior to deploying the first deployment to the second endpoint;
determining fourth values of the performance metric for the second endpoint, the fourth values associated with telemetry information generated after deploying the first deployment to the second endpoint;
determining a second post-deployment impact of deploying the first deployment to the second endpoint by comparing the third values of the performance metric to the fourth values of the performance metric; and
determining an overall impact of deploying the first deployment to the plurality of endpoints based at least on the first post-deployment impact and the second post-deployment impact.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining, based on the telemetry information, a second endpoint of the plurality of endpoints associated with a second periodic workload;
determining third values of the performance metric for the second endpoint, the third values associated with telemetry information generated prior to deploying a second deployment to the second endpoint, the second deployment differing from the first deployment in at least one feature;
determining fourth values of the performance metric for the second endpoint, the fourth values associated with telemetry information generated after deploying the second deployment to the second endpoint;
determining a second post-deployment impact of deploying the second deployment to the second endpoint by comparing the third values of the performance metric to the fourth values of the performance metric; and
determining an impact of the at least one feature based at least on the first post-deployment impact and the second post-deployment impact.

### Claim 5 (depends on 1)

The method of claim 1, wherein the performance metric comprises at least one of:
a query duration;
a query success rate;
a login success rate;
a memory utilization of frontend applications associated with the first endpoint;
a memory utilization of backend applications associated with the first endpoint;
a processor utilization of frontend applications associated with the first endpoint; or
a processor utilization of backend applications associated with the first endpoint.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first action comprises at least one of:
undeploying the first deployment from the first endpoint;
modifying the first deployment based at least on the first post-deployment impact;
deploying the first deployment to additional endpoints of the plurality of endpoints; or
generating a user interface element based at least on the first post-deployment impact.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first periodic workload comprises a workload associated with a serverless structured query language (SQL) pool.

### Claim 8

A system, comprising:
a processor; and
a memory device stores program code structured to cause the processor to:
analyze telemetry information associated with workloads executing on a plurality of endpoints;
determine, based on the telemetry information, a first endpoint of the plurality of endpoints associated with a first periodic workload;
determine first values of a performance metric for the first endpoint, the first values associated with telemetry information generated prior to deploying a first deployment to the first endpoint;
determine second values of the performance metric for the first endpoint, the second values associated with telemetry information generated after deploying the first deployment to the first endpoint;
determine a first post-deployment impact of deploying the first deployment to the first endpoint by comparing the first values of the performance metric to the second values of the performance metric; and
perform a first action based at least on the first post-deployment impact.

### Claim 9 (depends on 8)

The system of claim 8, wherein, to determine a first endpoint of the plurality of endpoints associated with a first periodic workload, the program code is further structured to cause the processor to:
determine, based on the telemetry information, a plurality of query hashes associated with the first endpoint;
determine that a first query hash of the plurality of query hashes repeats on a periodic basis with a periodicity that satisfies a predetermined relationship with a periodicity threshold;
determine a variation in query data associated with queries associated with the first query hash; and
determine that the variation in query data satisfies a predetermined relationship with a data variation threshold.

### Claim 10 (depends on 8)

The system of claim 8, wherein the program code is further structured to cause the processor to:
determine, based on the telemetry information, a second endpoint of the plurality of endpoints associated with a second periodic workload;
determine third values of the performance metric for the second endpoint, the third values associated with telemetry information generated prior to deploying the first deployment to the second endpoint;
determine fourth values of the performance metric for the second endpoint, the fourth values associated with telemetry information generated after deploying the first deployment to the second endpoint;
determine a second post-deployment impact of deploying the first deployment to the second endpoint by comparing the third values of the performance metric to the fourth values of the performance metric; and
determine an overall impact of deploying the first deployment to the plurality of endpoints based at least on the first post-deployment impact and the second post-deployment impact.

### Claim 11 (depends on 8)

The system of claim 8, wherein the program code is further structured to cause the processor to:
determine, based on the telemetry information, a second endpoint of the plurality of endpoints associated with a second periodic workload;
determine third values of the performance metric for the second endpoint, the third values associated with telemetry information generated prior to deploying a second deployment to the second endpoint, the second deployment differing from the first deployment in at least one feature;
determine fourth values of the performance metric for the second endpoint, the fourth values associated with telemetry information generated after deploying the second deployment to the second endpoint;
determine a second post-deployment impact of deploying the second deployment to the second endpoint by comparing the third values of the performance metric to the fourth values of the performance metric; and
determine an impact of the at least one feature based at least on the first post-deployment impact and the second post-deployment impact.

### Claim 12 (depends on 8)

The system of claim 8, wherein the performance metric comprises at least one of:
a query duration;
a query success rate;
a login success rate;
a memory utilization of frontend applications associated with the first endpoint;
a memory utilization of backend applications associated with the first endpoint;
a processor utilization of frontend applications associated with the first endpoint; or
a processor utilization of backend applications associated with the first endpoint.

### Claim 13 (depends on 8)

The system of claim 8, wherein the first action comprises at least one of:
undeploying the first deployment from the first endpoint;
modifying the first deployment based at least on the first post-deployment impact;
deploying the first deployment to additional endpoints of the plurality of endpoints; or
generating a user interface element based at least on the first post-deployment impact.

### Claim 14 (depends on 8)

The system of claim 8, wherein the first endpoint comprises at least one of:
a service endpoint; or
a private endpoint.

### Claim 15

A computer-readable storage medium comprising computer-executable instructions that, when executed by a processor, cause the processor to:
analyze telemetry information associated with workloads executing on a plurality of endpoints;
determine, based on the telemetry information, a first endpoint of the plurality of endpoints associated with a first periodic workload;
determine first values of a performance metric for the first endpoint, the first values associated with telemetry information generated prior to deploying a first deployment to the first endpoint;
determine second values of the performance metric for the first endpoint, the second values associated with telemetry information generated after deploying the first deployment to the first endpoint;
determine a first post-deployment impact of deploying the first deployment to the first endpoint by comparing the first values of the performance metric to the second values of the performance metric; and
perform a first action based at least on the first post-deployment impact.

### Claim 16 (depends on 15)

The computer-readable storage medium of claim 15, wherein, to determine a first endpoint of the plurality of endpoints associated with a first periodic workload, the computer-executable instructions, when executed by the processor, further cause the processor to:
determine, based on the telemetry information, a plurality of query hashes associated with the first endpoint;
determine that a first query hash of the plurality of query hashes repeats on a periodic basis with a periodicity that satisfies a predetermined relationship with a periodicity threshold;
determine a variation in query data associated with queries associated with the first query hash; and
determine that the variation in query data satisfies a predetermined relationship with a data variation threshold.

### Claim 17 (depends on 15)

The computer-readable storage medium of claim 15, wherein the computer-executable instructions, when executed by the processor, further cause the processor to:
determine, based on the telemetry information, a second endpoint of the plurality of endpoints associated with a second periodic workload;
determine third values of the performance metric for the second endpoint, the third values associated with telemetry information generated prior to deploying the first deployment to the second endpoint;
determine fourth values of the performance metric for the second endpoint, the fourth values associated with telemetry information generated after deploying the first deployment to the second endpoint;
determine a second post-deployment impact of deploying the first deployment to the second endpoint by comparing the third values of the performance metric to the fourth values of the performance metric; and
determine an overall impact of deploying the first deployment to the plurality of endpoints based at least on the first post-deployment impact and the second post-deployment impact.

### Claim 18 (depends on 15)

The computer-readable storage medium of claim 15, wherein the computer-executable instructions, when executed by the processor, further cause the processor to:
determine, based on the telemetry information, a second endpoint of the plurality of endpoints associated with a second periodic workload;
determine third values of the performance metric for the second endpoint, the third values associated with telemetry information generated prior to deploying a second deployment to the second endpoint, the second deployment differing from the first deployment in at least one feature;
determine fourth values of the performance metric fort the second endpoint, the fourth values associated with telemetry information generated after deploying the second deployment to the second endpoint;
determine a second post-deployment impact of deploying the second deployment to the second endpoint by comparing the third values of the performance metric to the fourth values of the performance metric; and
determine an impact of the at least one feature based at least on the first post-deployment impact and the second post-deployment impact.

### Claim 19 (depends on 15)

The computer-readable storage medium of claim 15, wherein the performance metric comprises at least one of:
a query duration;
a query success rate;
a login success rate;
a memory utilization of frontend applications associated with the first endpoint;
a memory utilization of backend applications associated with the first endpoint;
a processor utilization of frontend applications associated with the first endpoint; or
a processor utilization of backend applications associated with the first endpoint.

### Claim 20 (depends on 15)

The computer-readable storage medium of claim 15, wherein the first action comprises at least one of:
undeploying the first deployment from the first endpoint;
modifying the first deployment based at least on the first post-deployment impact;
deploying the first deployment to additional endpoints of the plurality of endpoints; or
generating a user interface element based at least on the first post-deployment impact.
