Automatic generation of presentations from documents

An apparatus comprising:

• at least one processor;
• at least one memory including instructions executable by the at least one processor;
• an extraction component comprising parameters stored in the at least one memory and configured to extract structured text from a source document, wherein the structured text comprises a plurality of source sections;
• a language generation model comprising a transformer model and including parameters stored in the at least one memory, wherein the language generation model is configured to generate a semantic outline based on the structured text by performing a self-attention mechanism that combines information from the structured text with an input prompt, wherein the input prompt comprises instructions to select a plurality of output headings for the semantic outline from the plurality of source sections, wherein the self-attention mechanism is performed by an encoder or a decoder of the transformer model, and wherein the language generation model is configured to generate text content corresponding to each of the plurality of output headings;
• an image selection component configured to select an image from the source document for each of the plurality of output headings by computing a similarity score between the image and the generated text content of a respective output heading of the plurality of output headings;
• and
• a document generator comprising parameters stored in the at least one memory and configured to generate an output document based on the semantic outline, wherein the output document comprises the text content and a plurality of output sections corresponding to the plurality of output headings, respectively.

A non-transitory computer readable medium storing code for natural language processing, the code comprising instructions executable by at least one processor to:

• extracting structured text from a source document, wherein the structured text comprises a plurality of source sections;
• generating, using a language generation model comprising a transformer model, a semantic outline based on the structured text by performing a self-attention mechanism that combines information from the structured text with an input prompt, wherein the input prompt comprises instructions to select a plurality of output headings for the semantic outline from the plurality of source sections, and wherein the self-attention mechanism is performed by an encoder or a decoder of the transformer model;
• generating, using the language generation model, text content corresponding to each of the plurality of output headings;
• selecting an image from the source document for each of the plurality of output headings by computing a similarity score between the image and the generated text content of a respective output heading of the plurality of output headings;
• and
• generating an output document based on the semantic outline, wherein the output document comprises the selected image, the text content, and a plurality of output sections corresponding to the plurality of output headings, respectively.