System and method for extracting text captions from video and generating video summaries
AssigneeThe Trustees of Columbia University
InventorsChang Shih-Fu, Dongqing Zhang
Life of this patent
Estimating the term…
Loading patent…
AssigneeThe Trustees of Columbia University
InventorsChang Shih-Fu, Dongqing Zhang
Estimating the term…
Caption boxes which are embedded in video content can be located and the text within the caption boxes decoded. Real time processing is enhanced by locating caption box regions in the compressed video domain and performing pixel based processing operations within the region of the video frame in which a caption box is located. The captions boxes are further refined by identifying word regions within the caption boxes and then applying character and word recognition processing to the identified word regions. Domain based models are used to improve text recognition results. The extracted caption box text can be used to detect events of interest in the video content and a semantic model applied to extract a segment of video of the event of interest.
A system for generating an event based summary of one or more fields or frames of video content including caption boxes embedded therein, comprising:
A non-transitory computer-readable storage medium storing a program for causing a computer to implement a method for generating an event based summary of one or more fields or frames of video content including caption boxes embedded therein, comprising:
A system for generating an event based summary of one or more fields or frames of video content including caption boxes embedded therein, comprising:
Dependencies are inferred from the claim text.