Back to results
US 10,762,283 B2Granted
Multimedia document summarization
AssigneeAdobe Inc.
InventorsNatwar Modani, Vaishnavi Subramanian, . Utpal, Shivani Gupta, Pranav R. Maneriker, Gaurush Hiranandani, Atanu R. Sinha
Life of this patent
Estimating the term…
Abstract
Multimedia document summarization techniques are described. That is, given a document that includes text and a set of images, various implementations generate a summary by extracting relevant text segments in the document and relevant segments of images with constraints on the amount of text and number/size of images in the summary.
Claims20
In a digital medium environment including one or more computing devices configured to perform document summarization, a method comprising:
- receiving a multimedia document to be processed to generate a summary;
- receiving a set of parameters associated with a budget for processing the multimedia document, the set of parameters associated with the budget placing a constraint on a size of the summary and defining how many of a first content type and a second content type the summary is permitted to contain, wherein the first content type and the second content type are two different content types;
- responsive to a determination of the constraint on the size of the summary specified by the budget having not been met, generating the summary for the multimedia document by:
- determining that individual elements of the first content type and the second content type in the multimedia document are available within the budget to be added to the summary;
- executing an objective function for each available element that can be added to the summary within the budget, the objective function providing a measure of a contribution of each available element to coverage of information content relative to content of the multimedia document, diversity of information content relative to content of the multimedia document, and cohesion of information content relative to content of the summary;
- selecting an available element which maximizes a ratio of increase in the objective function to a cost of the element, wherein the cost of the element is a measure of the size of the element;
- and
- adding the selected element to the summary.
5 more elements
In a digital medium environment including one or more computing devices to perform document summarization, a method comprising:
- receiving a multimedia document to be processed to generate a summary;
- ascertaining whether a budget is available for processing the multimedia document, the budget placing a constraint on the size of the summary and serving as a constraint on an amount of text content and image content that the summary is permitted to contain;
- ascertaining whether a particular element of text content or image content in the multimedia document exists within the budget available such that the constraint on the amount of text content and image content that the summary is permitted to contain has not been met;
- responsive to the particular element existing within the budget available, computing a value of an objective function for each available element in the multimedia document within the budget, the objective function providing a measure of a contribution of the particular element to coverage of information content relative to content of the multimedia document, diversity of information content relative to content of the multimedia document, and cohesion of information content relative to content of the summary, and being configured to compute a value for at least one text element and at least one image element in the multimedia document;
- responsive to said computing, selecting an element in the multimedia document whose computed value maximizes a ratio of increase in the objective function to a cost associated with the selected element in the multimedia document wherein the cost of the element is a measure of the size of the element;
- and
- adding the selected element to the summary.
4 more elements
In a digital medium environment having one or more computing devices to perform document summarization, a system comprising:
- a processor;
- a computer-readable storage media storing computer-readable instructions which, when executed by the processor, perform operations comprising:
- receiving a multimedia document to be processed to generate a summary;
- ascertaining whether a budget is available for processing the multimedia document, the budget placing a constraint on the size of the summary and serving as a constraint on an amount of text content and image content that the summary is permitted to contain;
- processing the multimedia document by:
- ascertaining whether a particular element of text content or image content in the multimedia document exists within the budget available such that the constraint on the amount of text content and image content that the summary may contain has not been met;
- responsive to the particular element existing within the budget, for each available element in the multimedia document that can be added to the summary, computing a ratio of gain of the available element to cost of the available element, wherein gain is a function of coverage that available elements have regarding information content of the multimedia document and diversity of information that available elements have with respect to a current summary, and wherein the cost of the element is a measure of the size of the element;
- selecting an available element in the multimedia document which provides a maximum ratio of gain to cost;
- and
- adding the selected element to the summary.
7 more elements
Dependencies are inferred from the claim text.