Method for video searching
AssigneeO Sparks Affiliate Media Group Holdings Limited
InventorShr Jin Christopher WEI
Life of this patent
Estimating the term…
Abstract
A method for video searching is implemented using a server having access to a plurality of video files. For each video file, the server constructs a hierarchical content index including at least a first index level and a second index level. A user search query is converted to a searching word embedding and matched against word embeddings of tag words associated with content objects at a designated level of a hierarchy, and a video segment delimited by a matched content object's timestamp dataset is returned to the user without any separate timestamp lookup operation or post-retrieval segment assembly, regardless of whether the video file is stored locally or hosted remotely.
Claims11
A method for video searching, the method being implemented using a server having access to a plurality of video files, the plurality of video files being stored locally on the server or hosted on one or more remote video servers accessible to the server via a network or a combination thereof, the server storing, for each of the plurality of video files, a hierarchical content index, the hierarchical content index including at least a first index level and a second index level,
- the first index level including a plurality of first-level content objects, each of the plurality of first-level content objects storing a first-level timestamp dataset as a structural field of a content object record, the first-level timestamp dataset including a starting timestamp and an ending timestamp demarcating temporal boundaries of a corresponding video segment, the first-level timestamp dataset having been committed to storage during construction of the hierarchical content index,
- the second index level including a plurality of second-level content objects, each of the plurality of second-level content objects being derived from content of one or more of the plurality of first-level content objects by a language processing module and storing a second-level timestamp dataset as a structural field of the content object record, the second-level timestamp dataset having been computed during the construction of the hierarchical content index by setting a starting timestamp and an ending timestamp of the second-level timestamp dataset to an earliest starting timestamp and a latest ending timestamp of the one or more of the plurality of first-level content objects from which the second-level content object was derived, the second-level timestamp dataset having been committed to storage during the construction of the hierarchical content index,
- the hierarchical content index being structured such that, upon matching a search query to a content object at any level of a hierarchy, the video segment delimited by the starting timestamp and the ending timestamp stored in a matched content object's timestamp dataset is identifiable by reading the matched content object's timestamp dataset without performing any separate timestamp lookup operation on a distinct data structure or any post-retrieval segment assembly based on constituent lower-level content objects,
- the method comprising:
- a) in response to receipt of a search query from a user device, selecting a search level within the hierarchical content index to conduct a search, the search level being at least the second index level;
- b) matching the search query against the content objects at the search level to identify a matched content object;
- and
- c) identifying at least one target video segment from one of the plurality of video files by reading the starting timestamp and the ending timestamp stored in the matched content object's timestamp dataset, and presenting the at least one target video segment to the user device.
A method for video searching, the method being implemented using a server having access to a plurality of video files, the plurality of video files being stored locally on the server or hosted on one or more remote video servers accessible to the server via a network or a combination thereof, the method comprising:
- constructing, for each of the plurality of video files, a hierarchical content index by:
- i) obtaining a subtitle file associated with the video file, the subtitle file including a plurality of subtitle segments each having verbatim transcript text and an associated per-segment timestamp, each of the plurality of subtitle segments together with the associated per-segment timestamp constituting a first-level content object in the hierarchical content index, the plurality of subtitle segments constituting a first index level of the hierarchical content index;
- and
- ii) processing the subtitle file using a language processing module to generate a plurality of highlight summaries, each of the plurality of highlight summaries indicating semantic content of a corresponding highlighted portion of the subtitle file, the corresponding highlighted portion comprising one or more contiguous subtitle segments, and computing and storing a highlight timestamp dataset, the highlight timestamp dataset including a starting timestamp derived from an earliest starting timestamp of the constituent subtitle segments and an ending timestamp derived from a latest ending timestamp of the constituent subtitle segments, each of the plurality of highlight summaries together with its stored highlight timestamp dataset constituting a second-level content object in the hierarchical content index, the plurality of highlight summaries and their associated stored highlight timestamp datasets constituting a second index level of the hierarchical content index;
- receiving a search query from a user device;
- selecting a search level within the hierarchical content index, the search level being at least the second index level;
- matching the search query against the content objects at the search level to identify a matched content object;
- and
- presenting, to the user device, a target video segment delimited by the starting timestamp and the ending timestamp stored in a timestamp dataset of the matched content object, whereby the target video segment is identified and returned by reading a pre-computed timestamp dataset from a matched content object's record without any separate timestamp lookup operation or post-retrieval segment assembly.
Dependencies are inferred from the claim text.