Electronic device, contents searching system and searching method thereof
AssigneeSamsung Electronics Co., Ltd.
InventorsJingjun Jiao, Chengwei Zhou, Yanlong Sun, Wei Li, Zhezhu Jin, Yingying Jiang, Lanlan Zhang
Life of this patent
Estimating the term…
Abstract
Optical flow information is determined and used to identify a video clip from among a sequence of frames. The video clip may be identified based on motion features derived in part from the optical flow information. In some embodiments, semantic information is concatenated with the motion features derived from the optical flow information.
Claims19
A video processing method, comprising:
- acquiring first optical flow information of at least one object, surface or edge in a video, wherein the video comprises a sequence of frame images;
- extracting motion features of the at least one object, surface or edge based on the sequence of frame images and the first optical flow information;
- extracting semantic features of at least one level of any first frame image of the sequence of frame images via first cascaded feature extraction layers, wherein the sequence of frame images comprises the first frame image;
- determining a first video clip in which an event occurs, based on the extracted semantic features;
- and
- generating, based on the motion features of the at least one object, surface or edge, a second video clip based on the first video clip,
- wherein the second video clip is a reduced video clip of the determined first video clip such that the second video clip has a shorter length than the first video clip, and
- wherein the second video clip comprises the occurred event.
A video processing device, comprising:
- one or more processors configured to:
- acquire optical flow information of at least one object, surface or edge in a video, wherein the video comprises a sequence of frame images;
- extract motion features of the at least one object, surface or edge based on the sequence of frame images and the optical flow information;
- extract semantic features of at least one level of any first frame image of the sequence of frame images via first cascaded feature extraction layers, wherein the sequence of frame images comprises the first frame image;
- determine a first video clip in which an event occurs, based on the extracted semantic features;
- and
- generate, based on the motion features of the at least one object, surface or edge, a second video clip based on the first video clip,
- wherein the second video clip is a reduced video clip of the determined first video clip such that the second video clip has a shorter length than the first video clip, and
- wherein the second video clip comprises the occurred event.
A non-transitory computer readable medium having instructions stored therein, which when executed by one or more processors of a computing device cause the computing device to:
- acquire optical flow information of at least one object, surface or edge in a video, wherein the video comprises a sequence of frame images;
- extract motion features of the at least one object, surface, or edge based on the sequence of frame images and the optical flow information;
- extract semantic features of at least one level of any first frame image of the sequence of frame images via first cascaded feature extraction layers, wherein the sequence of frame images comprises the first frame image;
- determine a first video clip in which an event occurs, based on the extracted semantic features;
- and
- generate, based on the motion features of the at least one object, surface or edge, a second video clip based on the first video clip,
- wherein the second video clip is a reduced video clip of the determined first video clip such that the second video clip has a shorter length than the first video clip, and
- wherein the second video clip comprises the occurred event.
Dependencies are inferred from the claim text.