Summarizing videos via side information
AssigneeInternational Business Machines Corporation
InventorsRameswar Panda, Chuang Gan, Pin-Yu Chen, Bo Wu
Life of this patent
Estimating the term…
Abstract
Machine learning-based techniques for summarizing collections of data such as image and video data leveraging side information obtained from related (e.g., video) data are provided. In one aspect, a method for video summarization includes: obtaining related videos having content related to a target video; and creating a summary of the target video using information provided by the target video and side information provided by the related videos to select portions of the target video to include in the summary. The side information can include video data, still image data, text, comments, natural language descriptions, and combinations thereof.
Claims18
A method for video summarization, comprising:
- obtaining related videos which, while being different videos from a target video, have content related to the target video;
- and
- creating a summary of the target video using information provided by the target video and side information provided by the related videos to select which portions of the target video to use in creating the summary of the target video, wherein only the portions of the target video are included in the summary of the target video, and wherein the information provided by the target video and the side information provided by the related videos are used to create the summary of the target video by performing a consensus estimation on scored segments of the target video and the related videos such that, based on the consensus estimation, irrelevant segments of the target video are excluded from the summary of the target video.
A non-transitory computer program product for video summarization, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:
- obtain related videos which, while being different videos from a target video, have content related to the target video;
- and
- create a summary of the target video using information provided by the target video and side information provided by the related videos to select which portions of the target video to use in creating the summary of the target video, wherein only the portions of the target video are included in the summary of the target video, and wherein the information provided by the target video and the side information provided by the related videos are used to create the summary of the target video by performing a consensus estimation on scored segments of the target video and the related videos such that, based on the consensus estimation, irrelevant segments of the target video are excluded from the summary of the target video.
Dependencies are inferred from the claim text.