# US 2023/0055948 A1 · Automatic classification of phone calls using representation learning based on the hierarchical pitman-yor process

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0055948 A1
- Document ID: US20230055948A1
- Status: Published application
- Kind: A1
- Application number: 17/397,709
- Filed: 2021-08-09
- Published: 2023-02-23
- Earliest claimed: 2021-08-09
- Assignees: Invoca, Inc.
- Applicants: Invoca, Inc.
- Inventors: Michael McCourt
- Web page: https://patentgrep.com/patent/US20230055948A1

## CPC

- G06F 40/35: Discourse or dialogue representation
- G10L 15/14: using statistical models, e.g. Hidden Markov Models [HMMs] (G10L15/18 takes precedence)
- G06F 16/906: Clustering; Classification
- G06F 40/289: Phrasal analysis, e.g. finite state techniques or chunking
- G06N 20/00: Machine learning
- G10L 15/063: {Training}
- G10L 2015/0631: {Creating reference templates; Clustering}
- G10L 2015/088: {Word spotting}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Embodiments of the disclosed technology include a representation learning model for classification of natural language text. In embodiments, a classification model comprises a feature model and a classifier. The feature model may be hierarchical in nature: data may pass through a series of representations, decreasing in specificity and increasing in generality. Intermediate levels of representation may then be used as automatically learned features to train a statistical classifier. Specifically, the feature model may be based on a hierarchical Pitman-Yor process. In embodiments, once the feature model has been expressed as a Bayesian Belief Network and some aspect of the feature model has been selected for prediction, the feature model may be attached to the classifier. In embodiments, after training, potentially using a mix of labeled and unlabeled data, the classification model can be used to classify documents such as call transcripts based on topics of conversation represented in the transcripts.

## Claims

### Claim 1

A computer-implemented method, comprising:
digitally storing first call transcript data that is associated with an observed label of a set of observed labels, the first call transcript data comprising an electronic digital representation of a verbal transcription of a call between a first person of a first person type and a second person of a second person type, the first call transcript data having been created based on speech-to-text recognition of an audio recording of the call, the first call transcript data being divided into first person type data comprising words spoken by the first person in the call and second person type data comprising words spoken by the second person in the call;
digitally generating and storing a machine learning statistical topic model in computer memory, the topic model comprising a word branch, a topic branch, and a classifier that defines a joint probability distribution over topic vectors and observed labels, the classifier being conjoined to the topic branch, the topic model simultaneously modeling the first person type data as a function of a first probability distribution of words used by the first person type for one or more topics and the second person type data as a function of a second probability distribution of words used by the second person type for the one or more topics, both the first probability distribution of words and the second probability distribution of words being modeled as a function of a third probability distribution of words for the one or more topics;
programmatically training, using a set of call transcript data that includes the first call transcript data, the topic model using the classifier, the set of call transcript data comprising at least one call transcript data not associated with an observed label;
receiving target call transcript data comprising an electronic digital representation of a verbal transcription of a target call;
programmatically determining, using the topic model, at least one of one or more topics of the target call or a classification of the target call; and
digitally storing the target call transcript data with additional data indicating at least one of the one or more topics of the target call or the classification of the target call.

### Claim 2 (depends on 1)

The method of claim 1, the word branch of the topic model being configured to model words as parts of phrases and the topic branch of the topic model being configured to model transition probabilities among topics.

### Claim 3 (depends on 1)

The method of claim 1, the topic model additionally modeling the call transcript data as a function of a plurality of topics which are modeled as a function of a probability distribution of topics.

### Claim 4 (depends on 3)

The method of claim 3, the probability distribution of topics being modeled as a function of an inferred prior probability distribution which is modeled as a function of a flat prior distribution.

### Claim 5 (depends on 4)

The method of claim 4, the probability distribution of topics being modeled as a function of the inferred prior probability distribution using a Pitman-Yor Process and the inferred prior probability distribution being modeled as a function of the flat prior distribution using a Pitman-Yor Process.

### Claim 6 (depends on 1)

The method of claim 1, the third probability distribution of words for each topic being modeled as a function of an inferred prior probability distribution which is modeled as a function of a flat prior distribution.

### Claim 7 (depends on 6)

The method of claim 6, the third probability distribution of words for each topic being modeled as a function of the inferred prior probability distribution using a Pitman-Yor Process and the inferred prior probability distribution being modeled as a function of the flat prior distribution using a Pitman-Yor Process.

### Claim 8 (depends on 1)

The method of claim 1, determining the one or more topics of the call using the topic model by inverting a Bayesian Belief Network using Bayes' theorem.

### Claim 9 (depends on 1)

The method of claim 1, the classifier being a linear classifier comprising one of a Finnish Horseshoe Model, an L2 Logistic Regression, or a Logistic Regression using the Horseshoe Potential.

### Claim 10 (depends on 9)

The method of claim 9, the classifier being a Finnish Horseshoe Model and the r parameter of the Finnish Horseshoe Model being inferred.

### Claim 11 (depends on 1)

The method of claim 1, training the topic model involving a Rao-Blackwellization process and using a Hamiltonian Monte Carlo algorithm to update the classifier.

### Claim 12 (depends on 1)

The method of claim 1, the first person type being a caller type and the second person type being an agent type.

### Claim 13 (depends on 1)

The method of claim 1, further comprising providing, to a client computing device, topic information indicating, for each of a plurality of topics, a number or percentage of calls received for that topic over a particular period of time.

### Claim 14

One or more non-transitory storage media storing instructions which, when executed by one or more processors, cause performance of a method comprising:
digitally storing first call transcript data that is associated with an observed label of a set of observed labels, the first call transcript data comprising an electronic digital representation of a verbal transcription of a call between a first person of a first person type and a second person of a second person type, the first call transcript data having been created based on speech-to-text recognition of an audio recording of the call, the first call transcript data being divided into first person type data comprising words spoken by the first person in the call and second person type data comprising words spoken by the second person in the call;
digitally generating and storing a machine learning statistical topic model in computer memory, the topic model comprising a word branch, a topic branch, and a classifier that defines a joint probability distribution over topic vectors and observed labels, the classifier being conjoined to the topic branch, the topic model simultaneously modeling the first person type data as a function of a first probability distribution of words used by the first person type for one or more topics and the second person type data as a function of a second probability distribution of words used by the second person type for the one or more topics, both the first probability distribution of words and the second probability distribution of words being modeled as a function of a third probability distribution of words for the one or more topics;
programmatically training, using a set of call transcript data that includes the first call transcript data, the topic model using the classifier, the set of call transcript data comprising at least one call transcript data not associated with an observed label;
receiving target call transcript data comprising an electronic digital representation of a verbal transcription of a target call;
programmatically determining, using the topic model, at least one of one or more topics of the target call or a classification of the target call; and
digitally storing the target call transcript data with additional data indicating at least one of the one or more topics of the target call or the classification of the target call.

### Claim 15 (depends on 14)

The media of claim 14, the method further comprising determining the one or more topics of the call using the topic model by inverting the topic model using a Bayesian Belief Network.

### Claim 16 (depends on 14)

The media of claim 14, the classifier being a linear classifier comprising one of a Finnish Horseshoe Model, an L2 Logistic Regression, or a Logistic Regression using the Horseshoe Potential.

### Claim 17 (depends on 14)

The media of claim 14, the method further comprising training the topic model using a Rao-Blackwellization process and a Hamiltonian Monte Carlo algorithm to update the classifier.

### Claim 18 (depends on 14)

The media of claim 14, the first person type being a caller type and the second person type being an agent type.

### Claim 19 (depends on 14)

The media of claim 14, the method further comprising providing, to a client computing device, topic information indicating, for each of a plurality of topics, a number or percentage of calls received for that topic over a particular period of time.

### Claim 20

A system comprising:
one or more processors;
a memory storing instructions which, when executed by the one or more processors, causes performance of:
digitally storing first call transcript data that is associated with an observed label of a set of observed labels, the first call transcript data comprising an electronic digital representation of a verbal transcription of a call between a first person of a first person type and a second person of a second person type, the first call transcript data having been created based on speech-to-text recognition of an audio recording of the call, the first call transcript data being divided into first person type data comprising words spoken by the first person in the call and second person type data comprising words spoken by the second person in the call;
digitally generating and storing a machine learning statistical topic model in computer memory, the topic model comprising a word branch, a topic branch, and a classifier that defines a joint probability distribution over topic vectors and observed labels, the classifier being conjoined to the topic branch, the topic model simultaneously modeling the first person type data as a function of a first probability distribution of words used by the first person type for one or more topics and the second person type data as a function of a second probability distribution of words used by the second person type for the one or more topics, both the first probability distribution of words and the second probability distribution of words being modeled as a function of a third probability distribution of words for the one or more topics;
programmatically training, using a set of call transcript data that includes the first call transcript data, the topic model using the classifier, the set of call transcript data comprising at least one call transcript data not associated with an observed label;
receiving target call transcript data comprising an electronic digital representation of a verbal transcription of a target call;
programmatically determining, using the topic model, at least one of one or more topics of the target call or a classification of the target call; and
digitally storing the target call transcript data with additional data indicating at least one of the one or more topics of the target call or the classification of the target call.
