Back to results
US 12,008,038 B2Granted
Summarization of video artificial intelligence method, system, and apparatus
AssigneePictory, Corp
InventorsVikram Chalana, Vishal Chalana, Shailendra Singh, Abid Ali Mohammed
Life of this patent
Estimating the term…
Abstract
Methods, apparatus, and system to summarize an audio-visual media with a neural network machine learning architecture.
Claims18
An apparatus for summarizing an audio-visual media, comprising:
- a computer processor and a memory;
- and
- an audio-visual media synopsis module in the memory to summarize the audio-visual media, wherein to summarize the audio-visual media, the computer processor is to perform the audio-visual media synopsis module and is to thereby obtain the audio-visual media, perform a transcription neural network to prepare a transcript of the audio-visual media, perform a summarization neural network to prepare a transcript summary of the transcript of the audio-visual media, and wherein the audio-visual media synopsis module is to output the transcript summary, wherein the audio-visual media synopsis module is further to prepare and output a video summary of the audio-visual media, wherein the video summary of the audio-visual media comprises portions of the audio-visual media corresponding to the transcript summary;
- wherein the audio-visual media synopsis module is further to provide the summarization neural network with the transcript and the audio-visual media and wherein to prepare the transcript summary, the summarization neural network is to identify a plurality of sentence meaning clusters in the transcript based on the transcript and the audio-visual media and wherein to prepare the transcript summary further comprises to select a number of sentences from the plurality of sentence meaning clusters.
1 more element
An apparatus for summarizing an audio-visual media, comprising:
- a computer processor and a memory;
- and
- an audio-visual media synopsis module in the memory to summarize the audio-visual media, wherein to summarize the audio-visual media, the computer processor is to perform the audio-visual media synopsis module and is to thereby obtain the audio-visual media, perform a transcription neural network to prepare a transcript of the audio-visual media, perform a summarization neural network to prepare a transcript summary of the transcript of the audio-visual media, and wherein the audio-visual media synopsis module is to output the transcript summary, wherein the audio-visual media synopsis module is further to prepare and output a video summary of the audio-visual media, wherein the video summary of the audio-visual media comprises portions of the audio-visual media corresponding to the transcript summary;
- wherein the audio-visual media synopsis module is further to remove filler words from at least one of the transcript, the transcript summary, or the video summary.
1 more element
A computer implemented method for summarizing an audio-visual media, comprising:
- obtaining the audio-visual media, performing a transcription neural network to prepare a transcript of the audio-visual media, performing a summarization neural network to prepare a transcript summary of the transcript of the audio-visual media, and outputting the transcript summary, and preparing and outputting a video summary of the audio-visual media, wherein the video summary of the audio-visual media comprises portions of the audio-visual media corresponding to the transcript summary, wherein
- performing the summarization neural network to prepare the transcript summary comprises providing the summarization neural network with the transcript and the audio-visual media and, with the summarization neural network, identifying a plurality of sentence meaning clusters in the transcript based on the transcript and the audio-visual media and wherein to prepare the transcript summary further comprises selecting a number of sentences from the plurality of sentence meaning clusters.
A computer apparatus for summarizing an audio-visual media, comprising:
- means to obtain the audio-visual media, means to perform a transcription neural network to prepare a transcript of the audio-visual media, means to perform a summarization neural network to prepare a transcript of the audio-visual media, means to perform a summarization neural network to prepare a transcript summary of the transcript of the audio-visual media, means to output the transcript summary, and means to prepare and output a video summary of the audio-visual media, wherein the video summary of the audio-visual media comprises portions of the audio-visual media corresponding to the transcript summary;
- wherein means to perform the summarization neural network to prepare the transcript summary comprises means to provide the summarization neural network with the transcript and the audio-visual media, with the summarization neural network, means to identify a plurality of sentence meaning clusters in the transcript based on the transcript and the audio-visual media and wherein to prepare the transcript summary further comprises means to select a number of sentences from the plurality of sentence meaning clusters.
Dependencies are inferred from the claim text.