# US 2025/0053417 A1 · Determining introduction point of application regressions through screenshot analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0053417 A1
- Document ID: US20250053417A1
- Status: Published application
- Kind: A1
- Application number: 18/447,850
- Filed: 2023-08-10
- Published: 2025-02-13
- Earliest claimed: 2023-08-10
- Assignees: Lenovo (Singapore) Pte. Ltd.
- Applicants: Lenovo (Singapore) Pte. Ltd.
- Inventors: Timothy Robbins; Matthew Fardig; Joshua Smith
- Web page: https://patentgrep.com/patent/US20250053417A1

## CPC

- G06F 8/71: Version control (security arrangements therefor G06F21/57); Configuration management
- G06F 11/3684: {for test design, e.g. generating new test cases}
- G06F 11/3688: {for test execution, e.g. scheduling of test suites}
- G06V 30/41: Analysis of document content (recognition of printed characters based on code marks G06V30/224)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A system for software testing includes a storage device to store screenshots of a user application captured during execution of the user application. The system includes a computer vision device coupled to the storage device. The computer vision device can receive a description of an assertion to be detected within the screenshots. The computer vision device can scan the screenshots to detect presence of the assertion and provide an output indicating presence of the assertion. The screenshot can be stored in a way to associate the screenshot with a software build version or date to indicate a point at which the assertion was introduced into relevant software source code.

## Claims

### Claim 1

A system for software testing, the system comprising:
a storage device configured to store a plurality of screenshots of a user application captured during execution of the user application; and
a computer vision device coupled to the storage device, the computer vision device configured to:
receive a description of an assertion to be detected within the plurality of screenshots;
scan the plurality of screenshots to detect presence of the assertion; and
provide output indicating presence of the assertion.

### Claim 2 (depends on 1)

The system of claim 1, wherein the plurality of screenshots are stored in a relational database, the relational database associating the plurality of screenshots with software version information of the respective user application, and wherein the output indicates a first software version at which the assertion was present.

### Claim 3 (depends on 2)

The system of claim 2, further comprising a user interface component coupled to the computer vision device, wherein the user interface component is configured to display an indication of presence of the assertion and an indication of a software build number.

### Claim 4 (depends on 3)

The system of claim 3, wherein the computer vision device is configured to receive one or more conditional statements from the user interface component, the one or more conditional statements limiting the scan to at least one of a date range, a software build number range, and an user application state.

### Claim 5 (depends on 4)

The system of claim 4, wherein the computer vision device includes machine learning circuitry to predict conditions under which subsequent user application errors will occur.

### Claim 6 (depends on 5)

The system of claim 5, wherein the system is configured to generate additional automated tests based on the predicted conditions.

### Claim 7 (depends on 1)

The system of claim 1, wherein the assertion is defined using computer vision device natural-language based definitions.

### Claim 8 (depends on 1)

The system of claim 1, wherein the plurality of screenshots are generated by automated tests of the user application.

### Claim 9

A method comprising:
receiving an indication of an assertion to be detected within a plurality of screenshots of a user application during execution of the user application, the assertion being defined using computer vision device natural-language based definitions and the plurality of screenshots being generated by previously-executed automated tests of the user application;
scanning the plurality of screenshots to detect a presence of the assertion; and
providing output indicating presence of the assertion.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
accessing plurality of screenshots from a relational database, the relational database associating the plurality of screenshots with software version information of the respective user application, and wherein the output indicates a first software version at which the regression was present.

### Claim 11 (depends on 10)

The method of claim 10, further comprising displaying an indication of presence of the assertion and an indication of a software build number at which a corresponding error or software bug was introduced into the associated user application.

### Claim 12 (depends on 10)

The method of claim 10, further comprising receiving one or more conditional statements limiting the scan to at least one of a date range, a software build number range, and a user application state.

### Claim 13 (depends on 12)

The method of claim 12, further comprising predicting conditions, based on a machine learning model, under which subsequent user application errors will occur.

### Claim 14 (depends on 13)

The method of claim 13, further comprising generating additional automated tests based on the predicted conditions.

### Claim 15

A machine-readable medium including instructions that, when executed on a processor, cause the processor to perform operations including:
receiving an indication of an assertion to be detected within a plurality of screenshots of a user application during execution of the user application, the assertion being defined using computer vision device natural-language based definitions and the plurality of screenshots being generated by previously-executed automated tests of the user application;
scanning the plurality of screenshots to detect a presence of the assertion; and
providing output indicating presence of the assertion.

### Claim 16 (depends on 15)

The machine-readable medium of claim 15, wherein the operations further comprise:
accessing the plurality of screenshots form a relational database, the relational database associating the plurality of screenshots with software version information of the respective user application, and wherein the output indicates a first software version at which the assertion was present.

### Claim 17 (depends on 16)

The machine-readable medium of claim 16, wherein the operations further comprise displaying an indication of presence of the assertion and an indication of a software build number at which a corresponding error or software bug was introduced into the associated user application.

### Claim 18 (depends on 16)

The machine-readable medium of claim 16, wherein the operations further comprise receiving one or more conditional statements limiting the scan to at least one of a date range, a software build number range, and a user application state.

### Claim 19 (depends on 18)

The machine-readable medium of claim 18, wherein the operations further comprise predicting conditions, based on a machine learning model, under which subsequent user application errors will occur.

### Claim 20 (depends on 19)

The machine-readable medium of claim 19 wherein the operations further comprise generating additional automated tests based on the predicted conditions.
