# US 2026/0099669 A1 · Document summarization comparison

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099669 A1
- Document ID: US20260099669A1
- Status: Published application
- Kind: A1
- Application number: 18/910,076
- Filed: 2024-10-09
- Published: 2026-04-09
- Earliest claimed: 2024-10-09
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Joseph Kozhaya; Andrew R. Freed; Charles E. Beller; Donna K. Byron
- Web page: https://patentgrep.com/patent/US20260099669A1

## CPC

- G06F 40/194: Calculation of difference between files
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and techniques that facilitate comparisons of machine learning model generated summaries are provided. For example, one or more embodiments described herein can comprise a system, which can comprise a memory that can store computer executable components. The system can also comprise a processor, operably coupled to the memory that can execute the computer executable components stored in memory. The computer executable components can comprise an answer component that generates a first answer to a question of a set of questions based on a document, wherein the document is associated with the set of questions and generates a second answer to the question based on a summary document; and a similarity component that updates a similarity score of the document and the summary document, based on a comparison of the first answer to the second answer and a similarity threshold.

## Claims

### Claim 1

A system comprising: a memory that stores computer executable components; and a processor that executes the computer executable components stored in the memory, wherein the computer executable components comprise:
an answer component that generates a first answer to a question of a set of questions based on a document, wherein the document is associated with the set of questions and generates a second answer to the question based on a summary document; and
a similarity component that updates a similarity score of the document and the summary document, based on a comparison of the first answer to the second answer and a similarity threshold.

### Claim 2 (depends on 1)

The system of claim 1, wherein the updating the similarity score comprises:
adding to the similarity score based on a determination that similarity of the first answer and the second answer exceeds the similarity threshold; and
adding the question to a list of unanswered questions based on a determination that the similarity of the first answer and the second answer does not exceed the similarity threshold.

### Claim 3 (depends on 2)

The system of claim 2, wherein the computer executable components further comprise:
a comparison component that compares the similarity score to an overall score threshold; and
a machine learning model that, in response to a determination that the similarity score is below the overall score threshold, generates an updated document summary from the document, wherein the list of unanswered questions serves as an input instruction for the machine learning model.

### Claim 4 (depends on 3)

The system of claim 3, wherein the summary document is generated by the machine learning model.

### Claim 5 (depends on 1)

The system of claim 1, wherein the answer component further generates a third answer to a question of a second set of questions based on the document, wherein the document is associated with the second set of questions and wherein the set of questions and the second set of questions are related to different summarization objectives and generates a fourth answer to the question based on the summary document; and wherein the similarity component updates a second similarity score of the document and the summary document based on a comparison of the third answer to the fourth answer and the similarity threshold.

### Claim 6 (depends on 1)

The system of claim 1, wherein the computer executable components further comprise a proofing component that checks if an answer to the question of the set of questions exists within the document and in response to a determination that the answer to the question does not exist within the document, removes the question from the set of questions.

### Claim 7

A computer implemented method comprising:
generating, by a device operatively couple to a processor, a first answer to a question of a set of questions based on a document, wherein the document is associated with the set of questions;
generating, by the device, a second answer to the question based on a summary document; and
updating, by the device, a similarity score of the document and the summary document based on a comparison of the first answer to the second answer and a similarity threshold.

### Claim 8 (depends on 7)

The computer implemented method of claim 7, wherein the updating the similarity score comprises:
adding, by the device, to the similarity score based on a determination that similarity of the first answer and the second answer exceeds the similarity threshold; and
adding, by the device, the question to a list of unanswered questions based on a determination that the similarity of the first answer and the second answer does not exceed the similarity threshold.

### Claim 9 (depends on 8)

The computer implemented method of claim 8, further comprising:
comparing, by the device, the similarity score to an overall score threshold; and
in response to a determination that the similarity score is below the overall score threshold, generating, by a machine learning model, an updated document summary from the document, wherein the list of unanswered questions serves as an input instruction of a one or more of input instructions for the machine learning model.

### Claim 10 (depends on 7)

The computer implemented method of claim 7, wherein the summary document is generated by a machine learning model.

### Claim 11 (depends on 7)

The computer implemented method of claim 7, further comprising:
generating, by the device, a third answer to a question of a second set of questions based on the document, wherein the document is associated with the second set of questions and wherein the set of questions and the second set of questions are related to different summarization objectives;
generating, by the device, a fourth answer to the question based on the summary document; and
updating, by the device, a second similarity score of the document and the summary document based on a comparison of the third answer to the fourth answer and the similarity threshold.

### Claim 12 (depends on 7)

The computer implemented method of claim 7, further comprising:
checking, by the device, if an answer to the question of the set of questions exists within the document; and
in response to a determination that the answer to the question does not exist within the document, removing, by the device, the question from the set of questions.

### Claim 13 (depends on 7)

The computer implemented method of claim 7, further comprising:
generating, by the device, an additional answer to the question based on a second summary document;
updating, by the device, an additional similarity score of the document and the second summary document based on a comparison of the first answer to the additional answer and the similarity threshold; and
selecting, by the device, one of the summary document or the second summary document based on a comparison of the similarity score and the additional similarity score.

### Claim 14

A computer program product comprising a non-transitory computer-readable memory having program instruction embodied therewith, the program instructions executable by a processor to cause the processor to:
generate, by the processor, a first answer to a question of a set of questions based on a document, wherein the document is associated with the set of questions;
generate, by the processor, a second answer to the question based on a summary document; and
update, by the processor, a similarity score of the document and the summary document based on a comparison of the first answer to the second answer and a similarity threshold.

### Claim 15 (depends on 14)

The computer program product of claim 14, wherein the updating the similarity score comprises:
adding, by the processor, to the similarity score based on a determination that similarity of the first answer and the second answer exceeds the similarity threshold; and
adding, by the processor, the question to a list of unanswered questions based on a determination that the similarity of the first answer and the second answer does not exceed the similarity threshold.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein the program instructions are further executable by the processor to cause the processor to:
compare, by the processor, the similarity score to an overall score threshold; and
in response to a determination that the similarity score is below the overall score threshold, generate, by a machine learning model, an updated document summary from the document, wherein the list of unanswered questions serves as an input instruction for the machine learning model.

### Claim 17 (depends on 14)

The computer program product of claim 14, wherein the summary document is generated by a machine learning model.

### Claim 18 (depends on 14)

The computer program product of claim 14, wherein the program instructions are further executable by the processor to cause the processor to:
generate, by the processor, a third answer to a question of a second set of questions based on the document, wherein the document is associated with the second set of questions and wherein the set of questions and the second set of questions are related to different summarization objectives;
generate, by the processor, a fourth answer to the question based on the summary document; and
update, by the processor, a second similarity score of the document and the summary document based on a comparison of the third answer to the fourth answer and the similarity threshold.

### Claim 19 (depends on 14)

The computer program product of claim 14, wherein the program instructions are further executable by the processor to cause the processor to:
check, by the processor, if an answer to the question of the set of questions exists within the document; and
in response to a determination that the answer to the question does not exist within the document, remove, by the processor, the question from the set of questions.

### Claim 20 (depends on 14)

The computer program product of claim 14, wherein the program instructions are further executable by the processor to cause the processor to:
generate, by the processor, an additional answer to the question based on a second summary document;
update, by the processor, an additional similarity score of the document and the second summary document based on a comparison of the first answer to the additional answer and the similarity threshold; and
select, by the processor, one of the summary document or the second summary document based on a comparison of the similarity score and the additional similarity score.
