# US 2026/0019504 A1 · System and method for automatically evaluating data items using a machine learning model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0019504 A1
- Document ID: US20260019504A1
- Status: Published application
- Kind: A1
- Application number: 18/772,497
- Filed: 2024-07-15
- Published: 2026-01-15
- Earliest claimed: 2024-07-15
- Assignees: Nice Ltd.
- Applicants: Nice Ltd.
- Inventors: Shashikant NIPANIKAR; Salil DHAWAN; Rujuta CHITNIS; Revati JADHAV; Ashish POWAR; Abhijit MOKASHI
- Web page: https://patentgrep.com/patent/US20260019504A1

## CPC

- H04M 3/523: with call distribution or queueing
- H04M 3/2218: {Call detail recording}
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A system and method are provided for evaluating data items using a machine learning model, including: producing, by a machine learning model, answers to questions applied to an input data item, where the questions and data item are input to the machine learning model; calculating a score for the input data item based on the produced answers; and transmitting one or more output data items to a remote computer over a communication network based on the calculated score. Some nonlimiting embodiments of the invention may relate to analyzing text data such as interaction transcripts in a contact center environment. In some embodiments questions may be included in a form and/or evaluation plan, and questions may include critical questions which are to be answered in the data item is to be assigned a non-zero scores. Questions may be organized in levels, and scores may be calculated based on the levels.

## Claims

### Claim 1

A method of evaluating data items using a machine learning model, the method comprising, using one or more computer processors:
producing, by a machine learning (ML) model, one or more answers to one or more questions, wherein the one or more questions are applied to an input data item, and wherein the one or more questions and the input data item are input to the machine learning model;
calculating a score for the input data item based on one or more of the produced answers; and
transmitting one or more output data items to a remote computer over a communication network based on the calculated score.

### Claim 2 (depends on 1)

The method of claim 1, wherein the input data item comprises a transcript of a call, and wherein the method comprises routing, by an automatic call dialer (ACD) the call to an agent computing device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the questions are sorted in a plurality of levels, and wherein the calculating of a score is performed based on one or more of the answers corresponding to one or more of the levels.

### Claim 4 (depends on 1)

The method of claim 1, wherein one or more of the questions are included in a form, the form generated using a graphical user interface (GUI), wherein the form is stored in a structured query language (SQL) database.

### Claim 5 (depends on 4)

The method of claim 4, wherein the producing of one or more of the answers is performed based on an automatic evaluation plan, wherein the evaluation plan comprises the form and one or more filtering conditions, and wherein the producing of one or more answers is triggered based on a predefined time interval.

### Claim 6 (depends on 1)

The method of claim 1, comprising producing, by the ML model, a justification to one or more of the answers.

### Claim 7 (depends on 3)

The method of claim 3, wherein the plurality of levels comprise a level of critical questions, wherein the calculating of a score comprises: if one or more critical questions are unanswered, assigning a score of zero to the data item.

### Claim 8

A computerized system for evaluating data items using a machine learning model, the system comprising:
a memory; and
one or more computer processors configured to:
produce, by a machine learning (ML) model, one or more answers to one or more questions, wherein the one or more questions are applied to an input data item, and wherein the one or more questions and the input data item are input to the machine learning model;
calculate a score for the input data item based on one or more of the produced answers; and
transmit one or more output data items to a remote computer over a communication network based on the calculated score.

### Claim 9 (depends on 8)

The system of claim 8, wherein the input data item comprises a transcript of a call, and wherein one or more of the processors are configured to route, by an automatic call dialer (ACD) the call to an agent computing device.

### Claim 10 (depends on 8)

The system of claim 8, wherein the questions are sorted in a plurality of levels, and wherein the calculating of a score is performed based on one or more of the answers corresponding to one or more of the levels.

### Claim 11 (depends on 8)

The system of claim 8, wherein one or more of the questions are included in a form, the form generated using a graphical user interface (GUI), wherein the form is stored in a structured query language (SQL) database.

### Claim 12 (depends on 11)

The system of claim 11, wherein the producing of one or more of the answers is performed based on an automatic evaluation plan, wherein the evaluation plan comprises the form and one or more filtering conditions, and wherein the producing of one or more answers is triggered based on a predefined time interval.

### Claim 13 (depends on 8)

The system of claim 8, wherein one or more of the processors are to produce, by the ML model, a justification to one or more of the answers.

### Claim 14 (depends on 10)

The system of claim 10, wherein the plurality of levels comprise a level of critical questions, wherein the calculating of a score comprises: if one or more critical questions are unanswered, assigning a score of zero to the data item.

### Claim 15

A method of assessing data elements using a large language model (LLM), the method comprising, using one or more computer processors:
generating, by an LLM, one or more replies to one or more questions, wherein the one or more questions are applied to an input data element, and wherein the one or more questions and the input data element are input to the LLM;
computing a quality metric for the input data element based on one or more of the generated replies; and
sending one or more output data element to a remote computer over a data network based on the computed metric.

### Claim 16 (depends on 1)

The method of claim 1, wherein the input data element comprises a transcript of an interaction, and wherein the method comprises routing, by an automatic call dialer (ACD) the interaction to an agent device.

### Claim 17 (depends on 1)

The method of claim 1, wherein the questions are classified into a plurality of tiers, and wherein the computing of a quality metric is performed based on one or more of the replies corresponding to one or more of the tiers.

### Claim 18 (depends on 1)

The method of claim 1, wherein one or more of the questions are included in a form, the form generated using a user interface, wherein the form is stored in a structured query language (SQL) database.

### Claim 19 (depends on 4)

The method of claim 4, wherein the generating of one or more of the replies is performed based on an evaluation plan, wherein the plan comprises the form and one or more filtering criteria, and wherein the generating of one or more replies is initiated based on a predefined time period.

### Claim 20 (depends on 1)

The method of claim 1, comprising generating, by the LLM, an explanation to one or more of the replies.
