US 2017/0287346 A1Published application

System and methods to create multi-faceted index for instructional videos

AssigneeYen4Ken Inc.

InventorsKuldeep Yadav, Arijit Biswas, Ankit Gandhi, Sumit Negi, Om D. Deshmukh

Life of this patent

Estimating the term…

Loading patent…

Abstract

Features are extracted from visual and audio modalities of a video to infer the location of figures/tables/equations/graphs/flow-charts determined as video anchor points which are highlighted on the video timeline to enable quick navigation and provide a quick summary of the video. A voice-based mechanism navigates to a point-of-interest in the video. In case of bandwidth-constrained settings, videos are often played at a very low resolution (quality), and often users need to increase video resolution manually to understand content presented in the figures. Using the automatic identification of these aforementioned anchored points, the resolution can be changed dynamically during streaming a video, which will provide a better viewing experience.

Claims13

Dependent claims

An indexing system for video content including a plurality of anchor points of selected interest to a user of the video content, comprising:

an anchor point identifying processor configured to identify occurrence of selected ones of the anchor points based on high-level visual elements, the high-level visual elements are identified from multi-modal inputs, such as audio and visual data from a video and textual data obtained from the audio and visual data;
a label assignation processor configured to assign labels to the identified anchor points;
and
an index generator configured to form and display in association with the video content a multi-faceted index, comprising a relative representation of position of a selected one of this anchor points within the video content, and a 2-dimensional timeline identifying a plurality of categories of the anchor points.

1 more element

Dependencies are inferred from the claim text.

Facts

Application: 15/088,508Filed 1 Apr 2016
Published: 5 Oct 2017
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

G09B 5/065
With both visual and audible presentation of the material to be studied: combinations of audio and video presentations, e.g. videotapes,…
G06F 18/21
Analysing: design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
G06V 10/40
Arrangements for image or video recognition or understanding: extraction of image or video features
G06V 10/70
Arrangements for image or video recognition or understanding: using pattern recognition or machine learning

Family

US 10,127,824 B2Related patent
US 2017/0287346 A1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key