# US 2016/0253312 A1 · Topically aware word suggestions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253312 A1
- Document ID: US20160253312A1
- Status: Published application
- Kind: A1
- Application number: 15/040,947
- Filed: 2016-02-10
- Published: 2016-09-01
- Earliest claimed: 2015-02-27
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Alexander C. Rhodes
- Web page: https://patentgrep.com/patent/US20160253312A1

## CPC

- G06F 40/274: Converting codes to words; Guess-ahead of partial word inputs
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Concepts and technologies are described herein for providing topically aware word suggestions. Using a text input, the system determines a conditional count and an unconditional count. The system then determines an adjustment factor for a pair of words of the plurality of words based on the unconditional count and the conditional count. The system then generates a data structure defining a plurality of word clusters. The system then reconstructs the adjustment factor of the pair of words based on a number of common clusters between individual words of the pair of words. The adjustment factor is combined with other data, such as data from a language model dictionary and a freshness factor from an average cluster activation state table to determine a probability associated with a word candidate, which is displayed to a user.

## Claims

### Claim 1

A method, comprising:
receiving an input containing a plurality of words;
determining a conditional count;
determining an unconditional count;
determining an adjustment factor for a pair of words of the plurality of words based on the unconditional count and the conditional count;
generating a data structure defining a plurality of word clusters, individual word clusters of the plurality of word clusters include at least one word of the plurality of words; and
reconstructing the adjustment factor of the pair of words based on a number of common clusters between individual words of the pair of words.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
obtaining an input indicating word; and
reconstructing the freshness value associated with one or more word clusters containing the word, the modification to the freshness value indicating that the one or more word clusters containing the word are more recent than other word clusters of the plurality of word clusters.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving a text entry;
determining one or more word clusters of the plurality of word clusters associated with the text entry;
obtaining a freshness factor associated with the one or more word clusters of the plurality of word clusters associated with the text entry;
obtaining a related adjustment factor associated with the one or more word clusters;
obtaining a language model value;
determining a candidate probability associated with a word candidate based, at least in part, on the language model value and the related adjustment factor, wherein the word candidate is selected from individual words associated with the plurality of word clusters; and
generating an output containing the word candidate based, at least in part, on the candidate probability.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
determining a plurality of word candidates, wherein individual words of the plurality of word candidates comprise an individual candidate probability based, at least in part, on the language model value and the related adjustment factor;
generating data indicating a ranking of the word candidate and the individual words of the plurality of word candidates based, at least in part, on the individual candidate probabilities and the candidate probability; and
generating an output indicating the ranking.

### Claim 5 (depends on 4)

The method of claim 4, wherein the language model value comprises a probability in which a word associated with the text entry is universally used in a null context.

### Claim 6 (depends on 1)

The method of claim 1, wherein reconstructing the adjustment factor of the pair of words is also based on a ranking of at least one correlation between the words.

### Claim 7 (depends on 1)

The method of claim 1, wherein reconstructing the adjustment factor of the pair of words comprises:
determining a cluster density for individual clusters of the plurality of clusters;
determining an ordering of the plurality of clusters based on the cluster density for the individual clusters; and
reconstructing the adjustment factor based on the ordering of the plurality of clusters and the number of common clusters between individual words of the pair of words.

### Claim 8

A computing device, comprising:
a processor; and
a memory having a set of computer-executable instructions stored thereupon which, when executed by the processor, cause the computing device to
receive an input containing a plurality of words;
determine a conditional count;
determine an unconditional count;
determine an adjustment factor for a pair of words of the plurality of words based on the unconditional count and the conditional count;
generate a data structure defining a plurality of word clusters, individual word clusters of the plurality of word clusters include at least one word of the plurality of words; and
reconstruct the adjustment factor of the pair of words based on a number of common clusters between individual words of the pair of words.

### Claim 9 (depends on 8)

The computing device of claim 8, wherein the computer-executable instructions cause the computing device to:
obtain an input indicating word; and
reconstruct the freshness value associated with one or more word clusters containing the word, the modification to the freshness value indicating that the one or more word clusters containing the word are more recent than other word clusters of the plurality of word clusters.

### Claim 10 (depends on 8)

The computing device of claim 8, wherein the computer-executable instructions cause the computing device to:
receive a text entry;
determine one or more word clusters of the plurality of word clusters associated with the text entry;
obtain a freshness factor associated with the one or more word clusters of the plurality of word clusters associated with the text entry;
obtain a related adjustment factor associated with the one or more word clusters;
obtain a language model value;
determine a candidate probability associated with a word candidate based, at least in part, on the language model value and the related adjustment factor, wherein the word candidate is selected from individual words associated with the plurality of word clusters; and
generate an output containing the word candidate based, at least in part, on the candidate probability.

### Claim 11 (depends on 10)

The computing device of claim 10, wherein the computer-executable instructions cause the computing device to:
determine a plurality of word candidates, wherein individual words of the plurality of word candidates comprise an individual candidate probability based, at least in part, on the language model value and the related adjustment factor;
generate data indicating a rank of the word candidate and the individual words of the plurality of word candidates based, at least in part, on the individual candidate probabilities and the candidate probability; and
display data indicating the rank of the word candidate and the individual words.

### Claim 12 (depends on 11)

The computing device of claim 11, wherein the language model value comprises a probability in which a word associated with the text entry is universally used in a null context.

### Claim 13 (depends on 8)

The computing device of claim 8, wherein reconstructing the adjustment factor of the pair of words is also based on a ranking of at least one correlation between the words.

### Claim 14 (depends on 8)

The computing device of claim 8, wherein reconstructing the adjustment factor of the pair of words comprises:
determining a cluster density for individual clusters of the plurality of clusters;
determining an ordering of the plurality of clusters based on the cluster density for the individual clusters; and
reconstructing the adjustment factor based on the ordering of the plurality of clusters and the number of common clusters between individual words of the pair of words.

### Claim 15

A computer-readable storage medium having computer-executable instructions stored thereupon which, when executed by a computing device, cause the computing device to:
receive an input containing a plurality of words;
determine a conditional count;
determine an unconditional count;
determine an adjustment factor for a pair of words of the plurality of words based on the unconditional count and the conditional count;
generate a data structure defining a plurality of word clusters, individual word clusters of the plurality of word clusters include at least one word of the plurality of words; and
reconstruct the adjustment factor of the pair of words based on a number of common clusters between individual words of the pair of words.

### Claim 16 (depends on 15)

The computer-readable storage medium of claim 15, wherein the computer-executable instructions cause the computing device to:
obtain an input indicating word; and
reconstruct the freshness value associated with one or more word clusters containing the word, the modification to the freshness value indicating that the one or more word clusters containing the word are more recent than other word clusters of the plurality of word clusters.

### Claim 17 (depends on 15)

The computer-readable storage medium of claim 15, wherein the computer-executable instructions cause the computing device to:
receive a text entry;
determine one or more word clusters of the plurality of word clusters associated with the text entry;
obtain a freshness factor associated with the one or more word clusters of the plurality of word clusters associated with the text entry;
obtain a related adjustment factor associated with the one or more word clusters;
obtain a language model value;
determine a candidate probability associated with a word candidate based, at least in part, on the language model value and the related adjustment factor, wherein the word candidate is selected from individual words associated with the plurality of word clusters; and
generate an output containing the word candidate based, at least in part, on the candidate probability.

### Claim 18 (depends on 17)

The computer-readable storage medium of claim 17, wherein the computer-executable instructions cause the computing device to:
determine a plurality of word candidates, wherein individual words of the plurality of word candidates comprise an individual candidate probability based, at least in part, on the language model value and the related adjustment factor;
generate data indicating a rank of the word candidate and the individual words of the plurality of word candidates based, at least in part, on the individual candidate probabilities and the candidate probability; and
display data indicating the rank of the word candidate and the individual words.

### Claim 19 (depends on 15)

The computer-readable storage medium of claim 15, wherein reconstructing the adjustment factor of the pair of words is also based on a ranking of at least one correlation between the words.

### Claim 20 (depends on 15)

The computer-readable storage medium of claim 15, wherein reconstructing the adjustment factor of the pair of words comprises:
determining a cluster density for individual clusters of the plurality of clusters;
determining an ordering of the plurality of clusters based on the cluster density for the individual clusters; and
reconstructing the adjustment factor based on the ordering of the plurality of clusters and the number of common clusters between individual words of the pair of words.
