Mitigating drift in audiovisual assets
AssigneeNetflix, Inc.
InventorsSreeram Chakrovorthy, Shinjan Tiwary, Harold Sutherland, Rohit Puri
Life of this patent
Estimating the term…
Abstract
One embodiment of the present invention sets forth a technique for mitigating drift in audiovisual assets. The technique includes determining that an edit associated with a presentation timeline is within boundaries of a video frame. The technique further includes calculating a temporal drift associated with the edit, where the temporal drift comprises a duration of time between the edit and a boundary of the video frame. The technique further includes determining whether to include the video frame in the presentation timeline based on the temporal drift and an accumulated temporal drift associated with the presentation timeline.
Claims19
A method, comprising:
- determining that an edit associated with a presentation timeline falls within boundaries of a video frame included in a video track corresponding to the presentation timeline;
- calculating a temporal drift associated with the edit, wherein the temporal drift comprises a duration of time between the edit and a boundary of the video frame;
- determining whether to include the video frame in the presentation timeline based on the temporal drift and an accumulated temporal drift associated with a location within the presentation timeline corresponding to the edit;
- computing an updated accumulated temporal drift based on whether the video frame is to be included in the presentation timeline;
- and
- generating metadata based on the updated accumulated temporal drift;
- and
- transmitting the metadata to a client device for enabling the client device to adjust for the updated accumulated temporal drift during playback associated with the presentation timeline.
A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to perform the steps of:
- determining that an edit associated with a presentation timeline falls within boundaries of a video frame included in a video track corresponding to the presentation timeline;
- calculating a temporal drift associated with the edit, wherein the temporal drift comprises a duration of time between the edit and a boundary of the video frame;
- determining whether to include the video frame in the presentation timeline based on the temporal drift and an accumulated temporal drift associated with a location within the presentation timeline corresponding to the edit;
- computing an updated accumulated temporal drift based on whether the video frame is to be included in the presentation timeline;
- and
- generating metadata based on the updated accumulated temporal drift;
- and
- transmitting the metadata to a client device for enabling the client device to adjust for the updated accumulated temporal drift during playback associated with the presentation timeline.
A control server, comprising:
- a memory storing a media processing application;
- and
- a processor coupled to the memory, wherein, when executed by the processor, the media processing application configures the processor to:
- determine that an edit associated with a presentation timeline falls within boundaries of a video frame included in a video track corresponding to the presentation timeline;
- calculate a temporal drift associated with the edit, wherein the temporal drift comprises a duration of time between the edit and a boundary of the video frame;
- determine whether to include the video frame in the presentation timeline based on the temporal drift and an accumulated temporal drift associated with a location within the presentation timeline corresponding to the edit;
- compute an updated accumulated temporal drift based on whether the video frame is to be included in the presentation timeline;
- and
- generate metadata based on the updated accumulated temporal drift;
- and
- transmit the metadata to a client device for enabling the client device to adjust for the updated accumulated temporal drift during playback associated with the presentation timeline.
A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to perform the steps of, comprising:
- transmitting a request for a portion of the media file associated with an audio track and a video track having a plurality of frames;
- in response, receiving the portion of the media file and metadata that indicates an accumulated temporal drift associated with the portion of a media file, wherein the received portion of the media file includes a second video track having a subset of the plurality of frames, wherein the accumulated temporal drift corresponds to a temporal drift between the second video track and the audio track, and wherein the temporal drift is associated with a difference in the plurality of frames and the subset of the plurality of frames and an edit made to a presentation timeline associated with the video track;
- and
- playing back the portion of the media file based on the accumulated temporal drift.
Dependencies are inferred from the claim text.