# US 2021/0174798 A1 · Learning dialogue state tracking with limited labeled data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174798 A1
- Document ID: US20210174798A1
- Status: Published application
- Kind: A1
- Application number: 16/870,571
- Filed: 2020-05-08
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: salesforce.com, inc.
- Applicants: salesforce.com, inc.
- Inventors: Chien-Sheng Wu; Chu Hong Hoi; Caiming Xiong
- Web page: https://patentgrep.com/patent/US20210174798A1

## CPC

- G06F 40/35: Discourse or dialogue representation
- G06F 18/2148: {characterised by the process organisation or structure, e.g. boosting cascade}
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0475: Generative networks
- G06N 3/08: Learning methods
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- G06N 5/04: Inference or reasoning models
- G10L 15/16: using artificial neural networks
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Embodiments described in this disclosure illustrate the use of self-/semi supervised approaches for label-efficient DST in task-oriented dialogue systems. Conversational behavior is modeled by next response generation and turn utterance generation tasks. Prediction consistency is strengthened by augmenting data with stochastic word dropout and label guessing. Experimental results show that by exploiting self-supervision the joint goal accuracy can be boosted with limited labeled data.

## Claims

### Claim 1

A method for boosting prediction consistency in a dialogue state tracking (DST) module, the method comprising:
receiving, from a database, a first dataset of dialogue data;
generating, via the DST module, a first predicted attention distribution and a first predicted slot gate distribution from the first dataset of dialogue data;
generating multiple datasets of masked dialogue data by masking one or more words in the first dataset of dialogue data over multiple iterations;
generating, via the DST module, a set of predicted attention distributions and predicted slot gate distributions from the masked dialogue data;
computing an average predicted attention distribution and an average predicted slot gate distribution from the first dataset of dialogue data and the multiple datasets of masked dialogue data;
computing a consistency loss metric based on a first error metric between the average predicted attention distribution and the first predicted attention distribution obtained from unmasked dialogue data, and a second error metric between the average predicted slot gate distribution and the first predicted slot gate distribution obtained from unmasked dialogue data; and
incorporating the consistency loss metric into a loss metric for updating the DST module.

### Claim 2 (depends on 1)

The method of claim 1, wherein the one or more words are randomly selected from the first dataset of dialogue data.

### Claim 3 (depends on 1)

The method of claim 1, wherein the multiple datasets of masked dialogue data are generated by masking different words from the first dataset of dialogue data at different iterations.

### Claim 4 (depends on 1)

The method of claim 1, wherein the multiple datasets of masked dialogue data are generated by masking a same word from different places in the first dataset of dialogue data at different iterations.

### Claim 5 (depends on 1)

The method of claim 1, wherein the average predicted attention distribution is generated for each domain-slot pair by:
generating, using the DST module, a respective conditional attention distribution conditioned on DST module parameters and each of the multiple datasets of masked dialogue data or the first dataset of dialogue data; and
computing the average predicted attention distribution for each domain-slot pair by taking an average of the generated conditional attention distributions.

### Claim 6 (depends on 5)

The method of claim 5, wherein the average predicted slot gate distribution is generated for each domain-slot pair by:
generating, using the DST module, a respective conditional slot gate distribution conditioned on DST module parameters and each of the multiple datasets of masked dialogue data or the first dataset of dialogue data; and
computing the average predicted slot gate distribution for each domain-slot pair by taking an average of the generated conditional slot gate distributions.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
adjusting the average predicted slot gate distribution by applying a sharpening function that reduces an entropy corresponding to the average predicted slot gate distribution.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first error metric or the second error metric is obtained by a mean-squared operation.

### Claim 9 (depends on 1)

The method of claim 1, wherein the consistency loss metric is computed by summing all error metrics corresponding to all domain-slot pairs.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first dataset of dialogue data includes unlabeled dialogue data, and the method further comprises:
generating an unsupervised loss metric for the DST module using the unlabeled dialogue data; and
using a weighted sum of the unsupervised loss metric and the consistency loss metric for updating the DST module.

### Claim 11

A system for boosting prediction consistency in a dialogue state tracking (DST) module, the system comprising:
a memory storing instructions for boosting prediction consistency in the DST module; and
a processor configured to read and execute the instructions from the memory to:
receive, from a database, a first dataset of dialogue data;
generate, via the DST module, a first predicted attention distribution and a first predicted slot gate distribution from the first dataset of dialogue data;
generate multiple datasets of masked dialogue data by masking one or more words in the first dataset of dialogue data over multiple iterations;
generate, via the DST module, a set of predicted attention distributions and predicted slot gate distributions from the masked dialogue data;
compute an average predicted attention distribution and an average predicted slot gate distribution from the first dataset of dialogue data and the multiple datasets of masked dialogue data;
compute a consistency loss metric based on a first error metric between the average predicted attention distribution and the first predicted attention distribution obtained from unmasked dialogue data, and a second error metric between the average predicted slot gate distribution and the first predicted slot gate distribution obtained from unmasked dialogue data; and
incorporate the consistency loss metric into a loss metric for updating the DST module.

### Claim 12 (depends on 11)

The system of claim 11, wherein the one or more words are randomly selected from the first dataset of dialogue data.

### Claim 13 (depends on 11)

The system of claim 11, wherein the multiple datasets of masked dialogue data are generated by masking different words from the first dataset of dialogue data at different iterations.

### Claim 14 (depends on 11)

The system of claim 11, wherein the multiple datasets of masked dialogue data are generated by masking a same word from different places in the first dataset of dialogue data at different iterations.

### Claim 15 (depends on 11)

The system of claim 11, wherein the average predicted attention distribution is generated for each domain-slot pair by:
generating, using the DST module, a respective conditional attention distribution conditioned on DST module parameters and each of the multiple datasets of masked dialogue data or the first dataset of dialogue data; and
computing the average predicted attention distribution for each domain-slot pair by taking an average of the generated conditional attention distributions.

### Claim 16 (depends on 15)

The system of claim 15, wherein the average predicted slot gate distribution is generated for each domain-slot pair by:
generating, using the DST module, a respective conditional slot gate distribution conditioned on DST module parameters and each of the multiple datasets of masked dialogue data or the first dataset of dialogue data; and
computing the average predicted slot gate distribution for each domain-slot pair by taking an average of the generated conditional slot gate distributions.

### Claim 17 (depends on 16)

The system of claim 16, wherein the processor is further configured to execute instructions from the memory to:
adjust the average predicted slot gate distribution by applying a sharpening function that reduces an entropy corresponding to the average predicted slot gate distribution.

### Claim 18 (depends on 11)

The system of claim 11, wherein the first error metric or the second error metric is obtained by a mean-squared operation.

### Claim 19 (depends on 11)

The system of claim 11, wherein the consistency loss metric is computed by summing all error metrics corresponding to all domain-slot pairs.

### Claim 20

A non-transitory processor-readable storage medium storing processor-executable instructions for boosting prediction consistency in a dialogue state tracking (DST) module, the instructions being executed by a processor to:
receive, from a database, a first dataset of dialogue data;
generate, via the DST module, a first predicted attention distribution and a first predicted slot gate distribution from the first dataset of dialogue data;
generate multiple datasets of masked dialogue data by masking one or more words in the first dataset of dialogue data over multiple iterations;
generate, via the DST module, a set of predicted attention distributions and predicted slot gate distributions from the masked dialogue data;
compute an average predicted attention distribution and an average predicted slot gate distribution from the first dataset of dialogue data and the multiple datasets of masked dialogue data;
compute a consistency loss metric based on a first error metric between the average predicted attention distribution and the first predicted attention distribution obtained from unmasked dialogue data, and a second error metric between the average predicted slot gate distribution and the first predicted slot gate distribution obtained from unmasked dialogue data; and
incorporate the consistency loss metric into a loss metric for updating the DST module.
