Loading patent…
AssigneeTata Consultancy Services Limited
InventorsChitralekha Bhat, Sunil Kumar Kopparapu, Ashish Panda
Estimating the term…
A system and method to insert visual subtitles in videos is described. The method comprises segmenting an input video signal to extract the speech segments and music segments. Next, a speaker representation is associated for each speech segment corresponding to a speaker visible in the frame. Further, speech segments are analysed to compute the phones and the duration of each phone. The phones are mapped to a corresponding viseme and a viseme based language model is created with a corresponding score. Most relevant viseme is selected for the speech segments by computing a total viseme score. Further, a speaker representation sequence is created such that phones and emotions in the speech segments are represented as reconstructed lip movements and eyebrow movements. The speaker representation sequence is then integrated with the music segments and super imposed on the input video signal to create subtitles.
A computer implemented system for creation of visually subtitled videos, wherein said system comprises:
A computer implemented method for creation of visually subtitled videos, wherein the method comprises:
The method as claimed in 17 wherein the eyebrow movement and the lip movement corresponds to emotion detected in the speech segment of the segmented audio.
One or more non-transitory machine readable information storage mediums comprising one or more instructions which when executed by one or more hardware processors causes:
Dependencies are inferred from the claim text.