Video summarization using semantic information
AssigneeIntel Corporation
InventorsMyung Hwangbo, Krishna Kumar Singh, Teahyung Lee, Omesh Tickoo
Life of this patent
Estimating the term…
Abstract
An apparatus for video summarization using sematic information is described herein. The apparatus includes a controller, a scoring mechanism, and a summarizer. The controller is to segment an incoming video stream into a plurality of activity segments, wherein each frame is associated with an activity. The scoring mechanism is to calculate a score for each frame of each activity, wherein the score is based on a plurality of objects in each frame. The summarizer is to summarize the activity segments based on the score for each frame.
Claims25
An electronic device comprising:
- an image capture sensor;
- memory to store video segments;
- wireless communication circuitry to transmit data;
- and
- processor circuitry to:
- process a first image of a first video segment from the image capture sensor with a neural network to determine a first score for the first image, the neural network to detect actions associated with images, the actions associated with labels;
- determine a second score for the first video segment based on first scores for corresponding images in the first video segment;
- and
- determine, based on the second score, whether to retain the first video segment in the memory.
At least one memory device comprising computer readable instructions that, when executed, cause at least one processor of an electronic device to at least:
- process a first image of a first video segment from an image capture sensor of the electronic device with a neural network to determine a first score for the first image, the neural network to detect an action associated with at least one image, the action associated with a label;
- determine a second score for the first video segment based on first scores for corresponding images in the first video segment;
- and
- determine, based on the second score, whether to retain the first video segment in the electronic device.
An electronic device comprising:
- means for capturing images;
- means for storing video segments;
- means for transmitting data;
- and
- means for determining whether to retain a first video segment, the means for determining to:
- process a first image of the first video segment with a neural network to determine a first score for the first image, the neural network to detect actions associated with images, the actions associated with labels;
- determine a second score for the first video segment based on first scores for corresponding images in the first video segment;
- and
- determine, based on the second score, whether to retain the first video segment.
A method comprising:
- processing, by executing an instruction with at least one processor of an electronic device, a first image of a first video segment with a neural network to determine a first score for the first image, the neural network to detect actions associated with images, the actions associated with labels, the first video segment from an image capture sensor of the electronic device;
- determining, by executing an instruction with the at least one processor, a second score for the first video segment based on first scores for corresponding images in the first video segment;
- and
- determining, by executing an instruction with the at least one processor, whether to retain the first video segment in the electronic device based on the second score.
Dependencies are inferred from the claim text.