# US 2017/0255612 A1 · Building conversational understanding systems using a toolset

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255612 A1
- Document ID: US20170255612A1
- Status: Published application
- Kind: A1
- Application number: 15/600,995
- Filed: 2017-05-22
- Published: 2017-09-07
- Earliest claimed: 2013-06-21
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Ruhi Sarikaya; Daniel Boies; Larry Heck; Tasos Anastasakos
- Web page: https://patentgrep.com/patent/US20170255612A1

## CPC

- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06F 40/35: Discourse or dialogue representation
- G10L 15/18: using natural language modelling
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Tools are provided to allow developers to enable applications for Conversational Understanding (CU) using assets from a CU service. The tools may be used to select functionality from existing domains, extend the coverage of one or more domains, as well as to create new domains in the CU service. A developer may provide example Natural Language (NL) sentences that are analyzed by the tools to assist the developer in labeling data that is used to update the models in the CU service. For example, the tools may assist a developer in identifying domains, determining intent actions, determining intent objects and determining slots from example NL sentences. After the developer tags all or a portion of the example NL sentences, the models in the CU service are automatically updated and validated. For example, validation tools may be used to determine an accuracy of the model against test data.

## Claims

### Claim 1

A method for enabling an application for Conversational Understanding (CU) using assets in a CU service, comprising:
receiving a natural language sentence;
processing the natural language sentence to determine one or more domains in a domain model that are associated with the natural language sentence;
determining one or more actions that are associated with each of the one or more domains;
determining, whether an additional domain should be added to the domain model based, at least in part, on the determined actions;
when it is determined that an additional domain should be added to the domain model, automatically updating the domain model with the additional domain and the determined actions; and
providing the domain model to the CU service.

### Claim 2 (depends on 1)

The method of claim 1, further comprising automatically rephrasing the natural language sentence to generate additional sentences that contain different ways of expressing a meaning of the natural language sentence.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining one or more domains comprises:
utilizing a domain detector to determine domains that exist in the CU service: and
receiving a selection of one or more of the domains.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
displaying the determined one or more actions; and
receiving a selection of at least one of the one or more actions.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
automatically detecting intent objects associated with the one or more actions; and
displaying the detected intent objects.

### Claim 6 (depends on 5)

The method of claim 5, further comprising performing slot tagging based on the one or more actions and the detected intent objects.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
updating the domain model; and
validating the domain model.

### Claim 8 (depends on 1)

The method of claim 1, further comprising incorporating the domain model into the CU service.

### Claim 9

A computer-readable storage medium storing computer-executable instructions for updating a domain model in a Conversational Understanding (CU) service, comprising:
displaying tools used to create an application that interacts with the CU service;
receiving examples of natural language sentences used to interact with the application;
receiving one or more additional sentences associated with the natural language sentences, wherein the one or more additional sentences are generated by automatically rephrasing the natural language sentences;
detecting a domain, an intent action, and an intent object;
displaying the detected domain, the intent action and the intent object;
receiving input that labels the examples; and
automatically updating models for the CU service based on the received input.

### Claim 10 (depends on 9)

The computer-readable medium of claim 9, wherein detecting the domain comprises applying a domain detector to the natural language sentences.

### Claim 11 (depends on 9)

The computer-readable storage medium of claim 9, wherein detecting the intent action comprises:
detecting intent actions from the natural language sentences; and
displaying a confidence for each of the detected intent actions.

### Claim 12 (depends on 9)

The computer-readable storage medium of claim 9, wherein detecting the intent objects comprises:
detecting intent objects from the natural language sentences: and
displaying a confidence for each of the detected intent objects.

### Claim 13 (depends on 9)

The computer-readable storage medium of claim 9, further comprising performing slot tagging on the natural language sentences.

### Claim 14 (depends on 9)

The computer-readable storage medium of claim 9, wherein automatically updating models for the CU service based on the received input comprises updating a domain model, an intent action model, an intent object model and a slot model.

### Claim 15

A system for updating a domain in a Conversational Understanding (CU) service, comprising:
a processor; and
a memory for storing instructions which, when executed by the processor, performs a method comprising;
displaying a set of tools used to generate an application that utilizes the CU service;
detecting a domain, an intent action, and an intent object from examples of natural language sentences used to interact with the application;
displaying the detected domain, the intent action and the intent object;
determining whether the detected domain should be updated based, at least in part, on the intent action and the intent object;
when it is determined that the detected domain should be updated, automatically updating the detected domain using one or more of an additional intent action and an additional intent object.

### Claim 16 (depends on 15)

The system of claim 15, wherein detecting the domain comprises:
utilizing a domain detector determine domains that currently exist in the CU service; and
displaying a confidence for each of the domains.

### Claim 17 (depends on 15)

The system of claim 15, wherein detecting the intent action comprises:
detecting intent actions from the natural language sentences;
displaying a confidence for each of the detected intent actions; and
receiving a selection of one of the intent actions or receiving a selection to add a new intent action.

### Claim 18 (depends on 15)

The system of claim 15, wherein detecting the intent objects comprises:
detecting intent objects from the natural language sentences;
displaying a confidence for each of the detected intent objects; and
receiving a selection of one of the intent objects or receiving a selection to add a new intent object.

### Claim 19 (depends on 1)

The method of claim 1, further comprising updating a slot model associated with the domain model.

### Claim 20 (depends on 1)

The method of claim 1, wherein the additional domain is associated the one or more actions.
