System And Method For Multi-Modal Podcast Summarization

A non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by a processor, cause performance of a set of operations comprising:

• receiving podcast content;
• generating a transcript of at least a portion of the podcast content;
• parsing the podcast content to (i) identify audio segments within the podcast content, (ii) determine classifications for the audio segments, (iii) identify audio segment offsets, each audio segment offset corresponding to a respective time offset at which a respective audio segment begins relative to a start time of the podcast content, and (iv) identify sentence offsets, each sentence offset corresponding to a respective time offset at which a respective pause occurs relative to the start time of the podcast content;
• based on the identified audio segments, the determined classifications, the identified audio segment offsets, and the identified sentence offsets, dividing the generated transcript into text sentences;
• from among the text sentences of the divided transcript, selecting a group of text sentences for use in generating an audio summary of the podcast content;
• and
• based on timestamps at which the group of text sentences begin in the podcast content, combining portions of audio in the podcast content that correspond to the group of text sentences to generate an audio file representing the audio summary of the podcast content.

A computing system comprising:

• a processor;
• and
• a non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by the processor, cause performance of a set of operations comprising:
• receiving podcast content;
• generating a transcript of at least a portion of the podcast content;
• parsing the podcast content to (i) identify audio segments within the podcast content, (ii) determine classifications for the audio segments, (iii) identify audio segment offsets, each audio segment offset corresponding to a respective time offset at which a respective audio segment begins relative to a start time of the podcast content, and (iv) identify sentence offsets, each sentence offset corresponding to a respective time offset at which a respective pause occurs relative to the start time of the podcast content;
• based on the identified audio segments, the determined classifications, the identified audio segment offsets, and the identified sentence offsets, dividing the generated transcript into text sentences;
• from among the text sentences of the divided transcript, selecting a group of text sentences for use in generating an audio summary of the podcast content;
• and
• based on timestamps at which the group of text sentences begin in the podcast content, combining portions of audio in the podcast content that correspond to the group of text sentences to generate an audio file representing the audio summary of the podcast content.