# US 2019/0295105 A1 · Systems and methods for scoring user reactions to a software program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0295105 A1
- Document ID: US20190295105A1
- Status: Published application
- Kind: A1
- Application number: 15/934,445
- Filed: 2018-03-23
- Published: 2019-09-26
- Earliest claimed: 2018-03-23
- Assignees: LexisNexis, a division of Reed Elsevier Inc.
- Applicants: LexisNexis, a division of Reed Elsevier Inc.
- Inventors: Sanjay Sharma; Vaqar Khamisani; Michael Sluterbeck; Gabriel Hughes; Ray Daley; Jamie Buckley
- Web page: https://patentgrep.com/patent/US20190295105A1

## CPC

- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- G06F 8/77: Software metrics
- G06N 20/00: Machine learning
- G06N 20/20: Ensemble learning
- G06Q 30/0203: Market surveys; Market polls
- G06N 5/025: Extracting rules from data
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems, methods, and computer-readable media for scoring an individual interaction session between a user and a software program are disclosed. A method includes recording, by a processing device, one or more actions undertaken by the user with the software program to obtain recorded session data, determining, by the processing device in real-time, one or more metrics that correspond to at least one of the one or more actions undertaken by the user with the software program, measuring, by the processing device, the one or more actions undertaken by the user based on the one or more metrics to obtain metric data, and providing, by the processing device, the recorded session data and the metric data as an input for one or more of a machine learning algorithm and a predictive analytic algorithm. The one or more of the machine learning algorithm and the predictive analytic algorithm scores the individual interaction session.

## Claims

### Claim 1

A method for scoring an individual interaction session between a user and a software program, the method comprising:
recording, by a processing device, one or more actions undertaken by the user with the software program to obtain recorded session data;
determining, by the processing device in real-time, one or more metrics that correspond to at least one of the one or more actions undertaken by the user with the software program;
measuring, by the processing device, the one or more actions undertaken by the user based on the one or more metrics to obtain metric data; and
providing, by the processing device, the recorded session data and the metric data as an input for one or more of a machine learning algorithm and a predictive analytic algorithm, wherein the one or more of the machine learning algorithm and the predictive analytic algorithm scores the individual interaction session.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
combining the scored individual interaction session with a plurality of other scored individual interaction sessions to obtain a combined score;
determining an overall user satisfaction with one or more of the software program and a feature of the software program based on the combined score; and
reporting the overall user satisfaction.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
combining the scored individual interaction session with a plurality of other scored individual interaction sessions to obtain a combined score;
determining a user satisfaction with one or more of the software program and a feature of the software program based on the combined score for a class of users; and
reporting the user satisfaction for the class of users.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
combining the scored individual interaction session with a plurality of other scored individual interaction sessions to obtain a combined score; and
predicting one or more improvements to the software program that results in a maximum improvement in user satisfaction based on the combined score.

### Claim 5 (depends on 1)

The method of claim 1, wherein measuring the one or more actions undertaken by the user comprises one or more of:
weighing one or more user tasks;
determining a user satisfaction with completing one or more user tasks; and
distinguishing effort versus utility for each of the one or more user tasks.

### Claim 6 (depends on 1)

The method of claim 1, wherein the individual interaction session begins when the user logs into the software program and ends when the user logs out of the software program.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining, by the processing device, one or more classes of users in which the user is located based on user related demographic data;
categorizing, by the processing device, the user in one or more categories based on the one or more classes; and
scoring, by the processing device, the one or more categories to obtain one or more scored categories.

### Claim 8 (depends on 6)

The method of claim 6, wherein measuring the one or more actions undertaken by the user is based on the one or more scored categories.

### Claim 9 (depends on 1)

The method of claim 1, wherein the one or more of the machine learning algorithm and the predictive analytic algorithm utilizes a decision tree logic model.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving, by the processing device, a plurality of scores from the one or more of the machine learning algorithm and the predictive analytic algorithm;
determining, by the processing device, a Sigma score from the plurality of scores.

### Claim 11

A system that scores an individual interaction session between a user and a software program, the system comprising:
a processing device; and
a non-transitory, processor-readable storage medium comprising one or more programming instructions stored thereon that, when executed, cause the processing device to:
record one or more actions undertaken by the user with the software program to obtain recorded session data,
determine one or more metrics that correspond to at least one of the one or more actions undertaken by the user with the software program,
measure the one or more actions undertaken by the user based on the one or more metrics to obtain metric data, and
provide the recorded session data and the metric data as an input for one or more of a machine learning algorithm and a predictive analytic algorithm, wherein the one or more of the machine learning algorithm and the predictive analytic algorithm scores the individual interaction session.

### Claim 12 (depends on 11)

The system of claim 11, wherein the non-transitory, processor readable storage medium further comprises one or more programming instructions stored thereon that, when executed, cause the processing device to:
combine the scored individual interaction session with a plurality of other scored individual interaction sessions to obtain a combined score;
determine an overall user satisfaction with one or more of the software program and a feature of the software program based on the combined score; and
report the overall user satisfaction.

### Claim 13 (depends on 11)

The system of claim 11, wherein the one or more programming instructions that, when executed, cause the processing device to measure the one or more actions undertaken by the user further cause the processing device to complete at least one of the following:
weigh one or more user tasks;
determine a user satisfaction with completing one or more user tasks; and
distinguish effort versus utility for each of one or more user tasks.

### Claim 14 (depends on 11)

The system of claim 11, wherein the individual interaction session begins when the user logs into the software program and ends when the user logs out of the software program.

### Claim 15 (depends on 11)

The system of claim 11, further comprising one or more programming instructions that, when executed, cause the processing device to:
determine one or more classes of users in which the user is located based on user related demographic data;
categorize the user in one or more categories based on the one or more classes; and
score the one or more categories to obtain one or more scored categories.

### Claim 16 (depends on 15)

The system of claim 15, wherein measuring the one or more actions undertaken by the user is based on the one or more scored categories.

### Claim 17 (depends on 11)

The system of claim 11, wherein the one or more of the machine learning algorithm and the predictive analytic algorithm utilizes a decision tree logic model or a supervised learning based predictive model.

### Claim 18 (depends on 11)

The system of claim 11, further comprising one or more programming instructions that, when executed, cause the processing device to:
receive a plurality of scores from the one or more of the machine learning algorithm and the predictive analytic algorithm;
determine a Sigma score from the plurality of scores.

### Claim 19

A non-transitory, computer-readable storage medium that is operable by a computer to score an individual interaction session between a user and a software program, the non-transitory, computer-readable storage medium comprising one or more programming instructions stored thereon for causing a processing device to:
record one or more actions undertaken by the user with the software program to obtain recorded session data,
determine one or more metrics that correspond to at least one of the one or more actions undertaken by the user with the software program,
measure the one or more actions undertaken by the user based on the one or more metrics to obtain metric data, and
provide the recorded session data and the metric data as an input for one or more of a machine learning algorithm and a predictive analytic algorithm, wherein the one or more of the machine learning algorithm and the predictive analytic algorithm scores the individual interaction session.

### Claim 20 (depends on 19)

The non-transitory, computer-readable storage medium of claim 19 further comprising one or more programming instructions stored thereon for causing the processing device to:
determine one or more classes of users in which the user is located based on user related demographic data;
categorize the user in one or more categories based on the one or more classes;
score the one or more categories to obtain one or more scored categories;
receive a plurality of scores from the one or more of the machine learning algorithm and the predictive analytic algorithm; and
determine a Sigma score from the plurality of scores
