Frame Level And Video Level Text Detection In Video

A non-transitory computer-readable storage medium containing instructions, that when executed, control a computer system to be operable for:

• detecting a first set of frames in a video that include lines of text, the detecting performed at a frame level on each individual frame;
• generating a first representation from at least a first portion of the first set of frames and a second representation from at least a second portion of the first set of frames, the first representation generated based on a space dimension and the second representation generated based on a time dimension;
• filtering the first representation based on a number of lines of text within a space in the space dimension to select a second set of frames;
• filtering the second representation based on a number of frames within one or more time intervals in a plurality of time intervals in the time dimension to select a third set of frames;
• and
• analyzing frames in both the second set of frames and the third set of frames to determine whether the lines of text in both the second set of frames and the third set of frames are burned-in subtitles.

An apparatus comprising:

• one or more computer processors;
• and
• a non-transitory computer-readable storage medium comprising instructions, that when executed, control the one or more computer processors to be operable for:
• detecting a first set of frames in a video that include lines of text, the detecting performed at a frame level on each individual frame;
• generating a first representation from at least a first portion of the first set of frames and a second representation from at least a second portion of the first set of frames, the first representation generated based on a space dimension and the second representation generated based on a time dimension;
• filtering the first representation based on a number of lines of text within a space in the space dimension to select a second set of frames;
• filtering the second representation based on a number of frames within one or more time intervals in a plurality of time intervals in the time dimension to select a third set of frames;
• and
• analyzing frames in both the second set of frames and the third set of frames to determine whether the lines of text in both the second set of frames and the third set of frames are burned-in subtitles.