Systems and methods for query-focused summarization
AssigneeSalesforce, Inc.
InventorsWojciech Kryscinski, Alexander R. Fabbri, Jesse Vig
Life of this patent
Estimating the term…
Abstract
Embodiments described herein provide a query-focused summarization model that employs a single or dual encoder model. A two-step approach may be adopted that first extracts parts of the source document and then synthesizes the extracted segments into a final summary. In another embodiment, an end-to-end approach may be adopted that splits the source document into overlapping segments, and then concatenates encodings into a single embedding sequence for the decoder to output a summary.
Claims19
A method for query-focused summarization, the method comprising:
- receiving, via a communication interface, a source document, an input query posing a question on a content of the source document and a reference summary of the source document;
- dividing the source document into a plurality of source passages;
- encoding, via an encoder model, a source passage from the plurality of source passages and the input query separated by a delimiter;
- generating, by a final layer of the encoder model, a predicted relevance between the source passage and the reference summary based on the encoding;
- computing a loss function based on the predicted relevance;
- and
- updating the encoder model based on the computed loss function.
A system for query-focused summarization, the system comprising:
- a communication interface that receives a source document, an input query posing a question on a content of the source document and a reference summary of the source document;
- a memory storing a plurality of processor-executable instructions;
- and
- a processor executing the instructions to perform operations comprising:
- dividing the source document into a plurality of source passages;
- encoding, via an encoder model, a source passage from the plurality of source passages and the input query separated by a delimiter;
- generating, by a final layer of the encoder model, a predicted relevance between the source passage and the reference summary based on the encoding;
- computing a loss function based on the predicted relevance;
- and
- updating the encoder model based on the computed loss function.
A system for query-focused summarization, the system comprising:
- a communication interface that receives a source document, an input query posing a question on a content of the source document and a reference summary of the source document;
- a memory storing a plurality of processor-executable instructions;
- and
- a processor executing the instructions to perform operations comprising:
- splitting the source document into a plurality of overlapping segments;
- encoding, via an encoder, each overlapping segment separately appended with the input query into a respective encoding;
- concatenating encoded segments from the plurality of overlapping segments into an embedding sequence;
- and
- generating, via a decoder, an output summary from the embedding sequence.
Dependencies are inferred from the claim text.