# US 2020/0394577 A1 · Systems and methods for discovery of automation opportunities

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394577 A1
- Document ID: US20200394577A1
- Status: Published application
- Kind: A1
- Application number: 16/440,287
- Filed: 2019-06-13
- Published: 2020-12-17
- Earliest claimed: 2019-06-13
- Assignees: Nice Ltd.
- Applicants: Nice Ltd.
- Inventors: Ariel Smutko; Aviv Yehezkel; Eran Roseberg; Yaron Moshe Bialy
- Web page: https://patentgrep.com/patent/US20200394577A1

## CPC

- G06Q 10/0633: Workflow analysis
- G06Q 10/063114: {Status monitoring or status determination for a person or group}
- G06Q 10/103: {Workflow collaboration or project management}
- H04M 3/5175: {Call or contact centers supervision arrangements}
- H04M 2203/402: Agent or workforce management
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A system and method analyzes computer actions to identify computer-based processes (e.g. computer-user interactions) which are automation candidates. A data gathering process executed by a processor on a computer may collect low-level user action information or items, each low-level user action information or item including for example an input type description, a user name, and screen window information. At a computer sequential pattern mining may be applied to determine a set of subprocesses, each subprocess including a series of low-level user actions, each user action associated with a user action vector, and each subprocess associated with a subprocess vector generated from user action vectors associated with (typically generalized) low-level user actions comprised in the subprocess. The subprocess vectors may be grouped or clustered to create processes. For each process, an automation score may be calculated using the actions in the subprocesses in the process.

## Claims

### Claim 1

A method for analyzing computer actions on a computer desktop system to identify computer-based processes which are automation candidates, the method comprising using one or more computers:
using a data gathering process executed by a processor on a computer of the one or more computers, gathering low-level user action information items, each low-level user action information item comprising an input type description, a user name, and screen window information; and
at a computer of the one or more computers:
applying sequential pattern mining to determine a set of subprocesses, each subprocess comprising a series of low-level user actions, each user action associated with a user action vector, and each subprocess associated with a subprocess vector generated from user action vectors associated with low-level user actions comprised in the subprocess;
clustering the subprocess vectors to create processes; and
for each process, calculating an automation score using the actions comprised in the subprocesses comprised in the process.

### Claim 2 (depends on 1)

The method of claim 1, wherein calculating an automation score for a process is based on the time spent for each subprocess comprised in the process and a quality score for each low-level user action comprised in each subprocess comprised in the process.

### Claim 3 (depends on 1)

The method of claim 1, comprising creating a user action vector by:
creating a text string from at least the input type description, the name of the application executing the screen window, and the screen window information; and
calculating as the user action vector a word embedding of the text string.

### Claim 4 (depends on 1)

The method of claim 1 comprising displaying a visualization for a process including the automation score.

### Claim 5 (depends on 1)

The method of claim 1 comprising grouping low-level user actions into contexts using a TF-IDF (term frequency-inverse document frequency) algorithm.

### Claim 6 (depends on 1)

The method of claim 1 wherein calculating an automation score is performed using a duration for the process.

### Claim 7 (depends on 1)

The method of claim 1 comprising ordering subprocesses using a maximum likelihood estimator.

### Claim 8

A method for identifying automation candidates on a computer desktop system, the method comprising:
receiving low-level user actions each comprising an input type, and window information;
assigning each user action to a context based on window information;
for each context, applying sequential pattern mining to determine a set of subprocesses, each subprocess comprising a sequence of low-level user actions, each user action associated with a user action vector, and each subprocess associated with a subprocess vector generated from user action vectors associated with low-level user actions comprised in the subprocess;
determining a set of processes based on clusters of subprocesses; and
for each process, calculating a score using the actions associated with the subprocesses comprised in the process, the score indicating a return on investment (ROI) for automating the process.

### Claim 9 (depends on 8)

The method of claim 8, wherein calculating an automation score for a process is based on the time spent for each subprocess comprised in the process and a quality score for each low-level user action comprised in each subprocess comprised in the process.

### Claim 10 (depends on 8)

The method of claim 8, comprising creating a user action vector by:
creating a text string from at least the input type description, the name of the application executing the screen window, and the window information; and
calculating as the user action vector a word embedding of the text string.

### Claim 11 (depends on 8)

The method of claim 8 comprising displaying a visualization for a process including the score.

### Claim 12 (depends on 8)

The method of claim 8 wherein assigning low-level user actions into contexts is performed using a TF-IDF (term frequency-inverse document frequency) algorithm.

### Claim 13 (depends on 8)

The method of claim 8 comprising ordering subprocesses using a maximum likelihood estimator.

### Claim 14

A system for analyzing computer actions on a computer desktop system to identify computer-based processes which are automation candidates, the system comprising:
a computer comprising a processor and a memory, wherein the processor is configured to gather low-level user action information items, each low-level user action information item comprising an input type description, a user name, and screen window information; and
a second processor to:
apply sequential pattern mining to determine a set of subprocesses, each subprocess comprising a series of low-level user actions, each user action associated with a user action vector, and each subprocess associated with a subprocess vector generated from user action vectors associated with low-level user actions comprised in the subprocess;
cluster the subprocess vectors to create processes; and
for each process, calculate an automation score using the actions comprised in the subprocesses comprised in the process.

### Claim 15 (depends on 14)

The system of claim 14, wherein the second processor is configured to calculate an automation score for a process is based on the time spent for each subprocess comprised in the process and a quality score for each low-level user action comprised in each subprocess comprised in the process.

### Claim 16 (depends on 14)

The system of claim 14, wherein the second processor is configured to create a user action vector by:
creating a text string from at least the input type description, the name of the application executing the screen window, and the screen window information; and
calculating as the user action vector a word embedding of the text string.

### Claim 17 (depends on 14)

The system of claim 14, wherein the second processor is configured to display a visualization for a process including the automation score.

### Claim 18 (depends on 14)

The system of claim 14, wherein the second processor is configured to group low-level user actions into contexts using a TF-IDF (term frequency-inverse document frequency) algorithm.

### Claim 19 (depends on 14)

The system of claim 14, wherein calculating an automation score is performed using a duration for the process.

### Claim 20 (depends on 14)

The system of claim 14, wherein the second processor is configured to order subprocesses using a maximum likelihood estimator.
