# US 2024/0203427 A1 · Employee experience score

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203427 A1
- Document ID: US20240203427A1
- Status: Published application
- Kind: A1
- Application number: 18/538,803
- Filed: 2023-12-13
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: Verint Americas Inc.
- Applicants: Cogito Corp
- Inventors: Joshua Feast; Ali Azarbayejani; John Kane; Jorge Calzada; Richard Brutti; Kye Taylor; Assaf Pines; Cristina Gorrostieta; Matt Roddy; Reza Lotfian
- Web page: https://patentgrep.com/patent/US20240203427A1

## CPC

- G10L 17/06: Decision making techniques; Pattern matching strategies
- G06F 40/216: using statistical methods
- G06F 40/30: Semantic analysis
- G06F 40/35: Discourse or dialogue representation
- G06Q 10/0639: Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q 10/06393: {Score-carding, benchmarking or key performance indicator [KPI] analysis}
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 25/30: using neural networks
- G10L 25/63: for estimating an emotional state
- H04M 3/5175: {Call or contact centers supervision arrangements}
- G10L 25/90: Pitch determination of speech signals
- H04M 2201/40: using speech recognition
- H04M 2203/401: Performance feedback
- H04M 2203/403: Agent or workforce training
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

Techniques for monitoring and improving emotional well-being of an employee are described. Stream of audio data corresponding to a call between an employee and a customer may be received. One or more acoustic features and/or audio feature data may be generated from the audio data. Word embedding data corresponding to the audio data may be generated. An employee experience score may be generated using a machine learning (ML) model, word embedding data, and the one or more acoustic features, where the score corresponds to an experience level of the first speaker during the call with the second speaker. Based on the score, an action may be caused to be performed. In some embodiments, one or more notifications may be generated based on data related to the audio data, where at least notification is configured to improve an experience level for the first speaker.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving first audio data corresponding to a call between first speaker using a first device and a second speaker using a second device, wherein the first speaker is communicating with the second speaker as part of employment of the first speaker, wherein the first audio data is received during the call;
generating, using a first machine learning (ML) model and based on first data related to the first audio data, one or more notifications, wherein at least one notification of the one or more notifications is configured to improve an experience level for the first speaker; and
causing the one or more notifications to be displayed in a graphical user interface (GUI) of a computing device.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the experience level for the first speaker corresponds to an experience of the first speaker over an entirety of the call.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, further comprising:
determining, based on at least a first call score, an aggregated call score for the first speaker, wherein the aggregated call score representing a cumulative experience level of the first speaker corresponding to multiple calls with multiple customers.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein:
the first data related to the first audio data indicates a difference between the first call score and the aggregated call score satisfies a threshold difference; and
the at least one notification indicates data representing the first call score and a follow-up discussion with the first speaker.

### Claim 5 (depends on 3)

The computer-implemented method of claim 3, wherein:
the first call score is generated using a second ML model and the first audio data; and
the first call score corresponds to an experience level of the first speaker during the call with the second speaker.

### Claim 6 (depends on 3)

The computer-implemented method of claim 3, further comprising:
determining whether the aggregated call score satisfies a threshold aggregated call score; and
in response to the aggregated call score satisfying the threshold aggregated call score, modifying a call schedule for the first speaker.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein modifying the call schedule for the first speaker comprises:
removing the first speaker from a call queue.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining, based in part on the first audio data, one or more topics discussed during the call; and
identifying one or more portions of the first audio data corresponding to the one or more topics,
wherein the one or more notifications may indicate the one or more portions of the first audio data.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein the computing device is associated with a supervisor of the first speaker.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the at least one notification is generated during the call.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, wherein the first data comprises a first call score corresponding to an experience level of the first speaker during the call, and wherein the at least one notification indicates that the first speaker requires assistance of a supervisor of the first speaker during the call.

### Claim 12 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining a call type corresponding to the call,
wherein a first notification of the one or more notifications indicates the call type.

### Claim 13 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining, based on the first audio data, a first intent of the second speaker;
determining, based on the first audio data, a first call score representing an experience level of the first speaker during the call;
determining an average call score representing an average experience of an employee during a call related to the first intent;
determining the first call score is below the average call score; and
in response to determining that the first call score is below the average call score, determining one or more topics associated with the first intent, wherein a first notification of the one or more notifications indicates additional training in the one or more topics.

### Claim 14 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining a group associated with the first speaker;
determining, based on a plurality of call scores corresponding to a plurality of calls over a first time period, an average call score for the group;
determining a call score representing an experience level of the first speaker during the call; and
determining the call score is below the average call score, wherein a first notification of the one or more notifications indicates that the experience level of the first speaker is worse than an average experience level of the group.

### Claim 15

A system comprising:
at least one processor; and
at least one memory including instructions that, when executed by the at least one processor, cause the system to:
receive first audio data corresponding to a call between first speaker using a first device and a second speaker using a second device, wherein the first speaker is communicating with the second speaker as part of employment of the first speaker, wherein the first audio data is received during the call;
generate, using a first machine learning (ML) model and based on first data related to the first audio data, one or more notifications, wherein at least one notification of the one or more notifications is configured to improve an experience level for the first speaker; and
cause the one or more notifications to be displayed in a graphical user interface (GUI) of a computing device.

### Claim 16 (depends on 15)

The system of claim 15, wherein the experience level for the first speaker corresponds to an experience of the first speaker over an entirety of the call.

### Claim 17 (depends on 16)

The system of claim 16, wherein the at least one memory includes further instructions that, when executed by the at least one processor, further cause the system to:
determine, based on at least a first call score, an aggregated call score for the first speaker, wherein the aggregated call score representing a cumulative experience level of the first speaker corresponding to multiple calls with multiple customers.

### Claim 18 (depends on 15)

The system of claim 15, wherein the at least one memory includes further instructions that, when executed by the at least one processor, further cause the system to:
determine, based in part on the first audio data, one or more topics discussed during the call; and
identify one or more portions of the first audio data corresponding to the one or more topics,
wherein the one or more notifications may indicate the one or more portions of the first audio data.

### Claim 19 (depends on 15)

The system of claim 15, wherein the computing device is associated with a supervisor of the first speaker.

### Claim 20 (depends on 15)

The system of claim 15, wherein the at least one notification is generated during the call.
