Script based video effects for live video
AssigneeAdobe Inc.
InventorsDeepali Aneja, Kazi Rubaiat Habib, Li-Yi Wei, Wilmot Wei-Mau Li, Stephen Joseph Diverdi
Life of this patent
Estimating the term…
Abstract
In various examples, a video effect is displayed in a live video stream in response to determining a portion of an audio stream of the live video stream that corresponds to a text segment of a script associated with the video effect. For example, during presentation of the script, the audio stream is obtained to determine if a portion of the audio stream corresponds to the text segment.
Claims20
A method comprising:
- obtaining a script and a video effect associated with a text segment of the script;
- obtaining an audio stream corresponding to a live video stream, the live video stream capturing a live performance of the script by a user using a user device;
- determining a portion of the audio stream corresponds to the text segment by at least matching a set of words spoken by the user in the portion of the audio stream to a portion of the text segment of the script;
- responsive to determining the portion of the audio stream corresponds to the text segment, causing the video effect to be displayed in the live video stream;
- and
- causing the live video stream including the video effect to be presented to at least one other user device during a real-time presentation.
A non-transitory computer-readable medium storing executable instructions embodied thereon, which, when executed by a processing device, cause the processing device to perform operations comprising:
- obtaining a script index corresponding to a script and a video effect to be applied to a video stream in response to a text segment included in the script, the script index including words in the script and location information corresponding to the words in the script, where the video stream captures a user presenting the script;
- obtaining an audio stream associated with the video stream;
- determining a location within the script based on the script index and a portion of the audio stream by at least matching a first plurality of words within the script to a second plurality of words obtained from the portion of the audio stream;
- and
- applying the video effect to the video stream as a result of the location corresponding to the text segment included in the script.
A system comprising:
- a memory component;
- and
- a processing device coupled to the memory component, the processing device to perform operations comprising:
- obtaining a script index including a set of words in a script and a set of locations corresponding to words of the set of words in the script;
- obtaining a video stream and an audio stream, the video stream and the audio stream are captured by a user device and include a live performance of the script by the user;
- determining a location of the set of locations included in the script index based on a portion of the audio stream by at least matching a first subset of words of the set of words in the script to a second set of words extracted from the portion of the audio stream;
- and
- as a result of determining the location corresponds to a text segment, applying a video effect to the video stream.
Dependencies are inferred from the claim text.