# US 2012/0253788 A1 · Augmented Conversational Understanding Agent

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0253788 A1
- Document ID: US20120253788A1
- Status: Published application
- Kind: A1
- Application number: 13/076,862
- Filed: 2011-03-31
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: Microsoft Corporation
- Inventors: LARRY PAUL HECK; MADHUSUDAN CHINTHAKUNTA; DAVID MITBY; LISA STIFELMAN
- Web page: https://patentgrep.com/patent/US20120253788A1

## CPC

- G06F 40/35: Discourse or dialogue representation
- G06F 40/30: Semantic analysis
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G06N 20/00: Machine learning
- H04M 1/724: User interfaces specially adapted for cordless or mobile telephones
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

An augmented conversational understanding agent may be provided. Upon receiving, by an agent, at least one natural language phrase from a user, a context associated with the at least one natural language phrase may be identified. The natural language phrase may be associated, for example, with a conversation between the user and a second user. An agent action associated with the identified context may be performed according to the at least one natural language phrase and a result associated with performing the action may be displayed.

## Claims

### Claim 1

A method for providing an augmented conversational understanding agent, the method comprising:
receiving, by an agent, at least one natural language phrase from a user, wherein the at least one natural language phrase is associated with a conversation between the user and at least one second user;
identifying a context associated with the at least one natural language phrase; and
performing an agent action associated with the identified context according to the at least one natural language phrase; and
displaying a result associated with performing the agent action.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least one phrase is received from the user in response to an explicit invocation of the agent.

### Claim 3 (depends on 1)

The method of claim 1, wherein the at least one phrase is received from the user in response to an implicit invocation of the agent.

### Claim 4 (depends on 3)

The method of claim 3, wherein the implicit invocation of the agent occurs in response to a request to begin the conversation with the at least one second user.

### Claim 5 (depends on 4)

The method of claim 4, wherein the conversation occurs via an instant message session.

### Claim 6 (depends on 5)

The method of claim 5, wherein the conversation occurs via a telephone call.

### Claim 7 (depends on 1)

The method of claim 1, wherein identifying the context of the natural language phrase comprises identifying at least one domain associated with at least one word of the natural language phrase.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
receiving at least one second natural language phrase;
determining whether the at least one second natural language phrase is associated with the identified context; and
in response to determining that the at least one second natural language phrase is associated with the identified context:
performing a second agent action associated with the identified context according to the at least one second natural language phrase, and
updating the display according to a second result associated with the second agent action.

### Claim 9 (depends on 8)

The method of claim 8, further comprising, in response to determining that the at least one second natural language phrase is not associated with the identified context:
identifying a second context associated with the at least one second natural language phrase;
performing a third agent action associated with the second identified context according to the at least one second natural language phrase, and
replacing the display of the result with a second result associated with the third agent action.

### Claim 10

A computer-readable medium which stores a set of instructions which when executed performs a method for providing an augmented conversational understanding agent, the method executed by the set of instructions comprising:
receiving a first natural language phrase from a user, wherein the at least one natural language phrase is associated with a conversation between the user and at least one second user;
determining whether the first natural language phrase comprises enough data to identify a context; and
in response to determining that the first natural language phrase comprises enough data to identify the context:
performing an agent action associated with the identified context according to the at least one natural language phrase, and
displaying a result associated with performing the agent action.

### Claim 11 (depends on 10)

The computer-readable medium of claim 10, further comprising:
in response to determining that the first natural language phrase does not comprise enough data to identify a context, waiting to receive at least one second natural language phrase.

### Claim 12 (depends on 10)

The computer-readable medium of claim 10, wherein the identified context comprises a merger of a first ontology associated with the user and a second ontology associated with the at least one second user.

### Claim 13 (depends on 10)

The computer-readable medium of claim 10, further comprising:
determining whether the result is to be shared with the at least one second user; and
in response to determining that the result is to be shared with the at least one second user, displaying the result associated with performing the agent action to the at least one second user.

### Claim 14 (depends on 13)

The computer-readable medium of claim 13, wherein determining whether the result is to be shared with the at least one second user comprises determining whether the agent action comprises retrieving a personal note created by the user.

### Claim 15 (depends on 13)

The computer-readable medium of claim 13, wherein determining whether the result is to be shared with the at least one second user comprises requesting authorization from the user to share the result with the at least one second user.

### Claim 16 (depends on 13)

The computer-readable medium of claim 13, wherein determining whether the result is to be shared with the at least one second user comprises determining whether a prior result associated with performing the agent action has been previously shared with the at least one second user.

### Claim 17 (depends on 13)

The computer-readable medium of claim 13, wherein determining whether the result is to be shared with the at least one second user comprises determining whether the result is associated with scheduling an event.

### Claim 18 (depends on 13)

The computer-readable medium of claim 13, wherein determining whether the result is to be shared with the at least one second user comprises determining whether at least one second natural language phrase received from the user refers to the result.

### Claim 19 (depends on 10)

The computer-readable medium of claim 10, wherein performing the action comprises retrieving data from at least one network data source.

### Claim 20

A system for providing a context-aware environment, the system comprising:
a memory storage; and
a processing unit coupled to the memory storage, wherein the processing unit is operative to:
invoke an agent application, wherein invoking the agent application occurs in response to a request from a first user and wherein the request comprises at least one of the following: an explicit invocation request by the first user and a request to begin a conversation between the first user and at least one second user,
receive a first natural language phrase,
determine whether the first natural language phrase comprises enough data to identify a context,
in response to determining that the first natural language phrase does not comprise enough data to identify a context, wait to receive at least one second natural language phrase, and
in response to determining that the first natural language phrase comprises enough data to identify a context:
perform an agent action associated with the first natural language phrase,
display a result according to the performed action,
receive at least one second natural language phrase,
determine whether the at least one second natural language phrase is associated with the identified context,
in response to determining that the at least one second natural language phrase is associated with the identified context:
update the identified context according to the at least one second natural language phrase,
perform a second agent action associated with the updated context; and
update the display according to a second result associated with the second action.
