# US 2025/0094867 A1 · Using Machine Learning to Predict Outcomes for Documents

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0094867 A1
- Document ID: US20250094867A1
- Status: Published application
- Kind: A1
- Application number: 18/797,795
- Filed: 2024-08-08
- Published: 2025-03-20
- Earliest claimed: 2015-05-26
- Assignees: Textio, Inc.
- Applicants: Textio, Inc.
- Inventors: Kieran Snyder; Robert E. Kolba, JR.; Jensen Harris
- Web page: https://patentgrep.com/patent/US20250094867A1

## CPC

- G06N 20/00: Machine learning
- G06F 16/313: {Selection or weighting of terms for indexing}
- G06F 40/253: Grammatical analysis; Style critique
- H04L 51/52: for supporting social networking services
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Evaluations of a document are generated that indicate likelihoods of the document achieving its objectives. The evaluations are based on predictive characteristics of one or more outcomes of the client document that are indicative of whether the document will achieve its objectives. Specifically, a server receives the document from a client device. The server extracts a set of features from the document. The evaluations of the document are generated based on the predictive characteristics for the one or more outcomes of the document. The generated evaluations are provided to the client device such that the document can be optimized to achieve its desired objectives. The optimized document may also be sent to a posting server for posting to a computer network. The known outcomes of the optimized document are collected through reader responses to the document and analyzed to improve evaluations for other documents.

## Claims

### Claim 1

(canceled)

### Claim 2

A method, comprising:
receiving an electronic document from a user interface generated on a client device via a computer network, the electronic document having content directed toward achieving an objective, and the user interface configured to allow a user of the client device to edit the electronic document;
extracting a set of features from the content of the electronic document, the extracted features including at least a set of phrase-related features for a set of distinctive phrases present in the content of the electronic document and categories corresponding to the set of distinctive phrases;
evaluating the set of features extracted from the content of the electronic document and the objective to which the content of the document is directed toward to predict an outcome of the electronic document with respect to the objective, evaluating the set of features comprising:
assigning weights to each features in the set of features, and combining the weights of the set of features to generate the predicted outcome of the electronic document; and
presenting evaluation results for display on the user interface of the client device, wherein presenting the evaluation results comprises:
providing the predicted outcome for display at a region of the user interface adjacent to the electronic document,
for each distinctive phrase in the set of distinctive phrases, highlighting the distinctive phrase in the content of the electronic document within the user interface to generate a phrase highlight for the distinctive phrase, wherein the phrase highlight is generated to graphically distinguish the category associated with the distinctive phrase, and
displaying at least one phrase-related feature for at least one distinctive phrase adjacent to the content of the electronic document.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
receiving an indication from the user interface that the electronic document is revised to update the at least one distinctive phrase;
generating updated evaluation results based on the revised electronic document; and
displaying the updated evaluation results on the user interface.

### Claim 4 (depends on 2)

The method of claim 2, wherein the phrase highlights for the set of distinctive phrases include at least two phrase highlights graphically presented with two different colors or patterns corresponding to at least two different categories.

### Claim 5 (depends on 2)

The method of claim 2, wherein providing the predicted outcome for display further comprises providing a favorability score indicating a quality of the electronic document.

### Claim 6 (depends on 2)

The method of claim 2, wherein presenting the evaluation results for display on the user interface further comprises:
displaying labels for the categories associated with the set of distinctive phrases within the user interface of the client device, wherein for each category, the label for the category is displayed with a respective color or pattern for the category.

### Claim 7 (depends on 2)

The method of claim 2, wherein evaluating the set of features further comprises:
applying one or more trained machine-learned models to the set of features extracted from the content of the electronic document to generate the predicted outcome for the electronic document.

### Claim 8 (depends on 7)

The method of claim 7, wherein applying the one or more trained machine-learned models further comprises assigning the weights to each feature in the set of features, wherein a sign of a weight assigned to a feature indicates a direction of correlation between the feature and the predicted outcome of the electronic document, and an absolute value of the weight assigned to the feature indicates a degree of correlation between the feature and the predicted outcome.

### Claim 9 (depends on 2)

The method of claim 2, further comprising:
establishing a training corpus of electronic documents and associated known outcome data describing known outcomes resulting from postings of the electronic documents on the computer network;
extracting a set of training features from contents of the electronic documents in the training corpus; and
training one or more machine-learned models by correlating the sets of training features extracted from the contents of the electronic documents in the training corpus and the associated known outcome data.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
posting the electronic document on the computer network;
receiving outcome data describing responses to the posting of the electronic document on the computer network; and
selectively re-training the one or more machine-learned models based on the outcome data.

### Claim 11 (depends on 2)

The method of claim 2, wherein extracting the set of features from the content of the electronic document further comprises:
extracting syntactic factors describing a structure of sentences in the content of the electronic document;
extracting structural factors relating to structure and layout of the content of the electronic document; and
extracting semantic factors relating to meaning of the content in the electronic document.

### Claim 12 (depends on 2)

The method of claim 2, wherein the electronic document is a recruiting document, the objective relates to demographic information of people responding to the recruiting document, the predicted outcome predicting characteristics of desired reader responses to the electronic document.

### Claim 13 (depends on 2)

The method of claim 2, wherein the at least one phrase-related feature is displayed with revisions to the at least one distinctive phrase to improve the predicted outcome of the electronic document.

### Claim 14

A non-transitory computer-readable storage medium comprising stored instructions executable by a processor system, the instructions when executed causing the processor system to:
receive an electronic document from a user interface generated on a client device via a computer network, the electronic document having content directed toward achieving an objective, and the user interface configured to allow a user of the client device to edit the electronic document;
extract a set of features from the content of the electronic document, the extracted features including at least a set of phrase-related features for a set of distinctive phrases present in the content of the electronic document and categories corresponding to the set of distinctive phrases;
evaluate the set of features extracted from the content of the electronic document and the objective to which the content of the document is directed toward to predict an outcome of the electronic document with respect to the objective, wherein the instructions further cause the processor system to:
assign weights to each features in the set of features, and
combine the weights of the set of features to generate the predicted outcome of the electronic document; and
present evaluation results for display on the user interface of the client device, wherein the instructions further cause the processor system to:
provide the predicted outcome for display at a region of the user interface adjacent to the electronic document,
for each distinctive phrase in the set of distinctive phrases, highlight the distinctive phrase in the content of the electronic document within the user interface to generate a phrase highlight for the distinctive phrase, wherein the phrase highlight is generated to graphically distinguish the category associated with the distinctive phrase, and
display at least one phrase-related feature for at least one distinctive phrase adjacent to the content of the electronic document.

### Claim 15 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, the instructions further causing the processor system to:
receive an indication from the user interface that the electronic document is revised to update the at least one distinctive phrase;
generate updated evaluation results based on the revised electronic document; and
display the updated evaluation results on the user interface. 16 (New) The non-transitory computer-readable storage medium of claim 14, wherein the phrase highlights for the set of distinctive phrases include at least two phrase highlights graphically presented with two different colors or patterns corresponding to at least two different categories.

### Claim 17 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein the instructions further cause the processor system to provide a favorability score indicating a quality of the electronic document.

### Claim 18 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein the instructions further cause the processor system to:
display labels for the categories associated with the set of distinctive phrases within the user interface of the client device, wherein for each category, the label for the category is displayed with a respective color or pattern for the category.

### Claim 19 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein the instructions further cause the processor system to:
apply one or more trained machine-learned models to the set of features extracted from the content of the electronic document to generate the predicted outcome for the electronic document.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the instructions further cause the processor system to assign the weights to each feature in the set of features, wherein a sign of a weight assigned to a feature indicates a direction of correlation between the feature and the predicted outcome of the electronic document, and an absolute value of the weight assigned to the feature indicates a degree of correlation between the feature and the predicted outcome.

### Claim 21 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, the instructions further causing the processor system to:
establish a training corpus of electronic documents and associated known outcome data describing known outcomes resulting from postings of the electronic documents on the computer network;
extract a set of training features from contents of the electronic documents in the training corpus; and
train one or more machine-learned models by correlating the sets of training features extracted from the contents of the electronic documents in the training corpus and the associated known outcome data.

### Claim 22 (depends on 21)

The non-transitory computer-readable storage medium of claim 21, the instructions further causing the processor system to:
post the electronic document on the computer network;
receive outcome data describing responses to the posting of the electronic document on the computer network; and
selectively re-train the one or more machine-learned models based on the outcome data.

### Claim 23 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein the instructions further cause the processor system to:
extract syntactic factors describing a structure of sentences in the content of the electronic document;
extract structural factors relating to structure and layout of the content of the electronic document; and
extract semantic factors relating to meaning of the content in the electronic document.

### Claim 24 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein the electronic document is a recruiting document, the objective relates to demographic information of people responding to the recruiting document, the predicted outcome predicting characteristics of desired reader responses to the electronic document.

### Claim 25 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein the at least one phrase-related feature is displayed with revisions to the at least one distinctive phrase to improve the predicted outcome of the electronic document.
