Temporal alignment of MPEG and GLTF media
AssigneeNokia Technologies Oy
InventorsLukasz Kondrad, Lauri Ilola
Life of this patent
Estimating the term…
Abstract
An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide an animation timing extension; wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata; wherein the metadata track of the timed metadata is listed with an object associated with moving picture media; and align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation; wherein a sample of the metadata track is used to manipulate an animation event.
Claims34
An apparatus comprising:
- at least one processor;
- and
- at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
- provide an animation timing extension;
- wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata;
- wherein the animation timing extension references an accessor, the accessor describing a buffer where animation timing data is available, and wherein sample data from an animation timing track is provided to the buffer, and a change in the buffer triggers a change of state of the graphics library transmission format animation;
- wherein the metadata track of the timed metadata is listed with an object associated with moving picture media;
- and
- align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation;
- wherein a sample of the metadata track is used to manipulate an animation event.
An apparatus comprising:
- at least one processor;
- and
- at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
- provide a utility to align:
- graphics library transmission format temporal media information that describes an animation timeline;
- moving picture temporal media information that describes a moving picture timeline;
- and
- global runtime temporal information that describes a global application timeline;
- wherein the alignment utilizes at least one graphics library transmission format file, a base media file format, or a sample to synchronize the graphics library transmission format temporal media information and the moving picture temporal media information with the global runtime temporal information;
- and
- manipulate a plurality of animations within a graphics library transmission format animation array simultaneously;
- wherein the graphics library transmission format animation array is associated with the at least one base media file format item or at least one base media file format track containing at least one other sample.
An apparatus comprising:
- at least one processor;
- and
- at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
- provide an animation timing extension;
- wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata;
- wherein the metadata track of the timed metadata is listed with an object associated with moving picture media;
- align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation;
- wherein a sample of the metadata track is used to manipulate an animation event;
- and
- provide a sample format that defines a graphics library transmission format animation sample, wherein the sample format comprises at least one controlling parameter for animations defined in a graphics library transmission format animations array.
An apparatus comprising:
- at least one processor;
- and
- at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
- provide an animation timing extension;
- wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata;
- wherein the metadata track of the timed metadata is listed with an object associated with moving picture media;
- align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation;
- wherein a sample of the metadata track is used to manipulate an animation event;
- and
- provide at least one state value in an animation sample format;
- wherein the at least one state value indicates at least one of:
- playing the graphics library transmission format animation;
- stopping the graphics library transmission format animation and returning to an initial state;
- stopping the graphics library transmission format animation and maintaining a final state;
- pausing the graphics library transmission format animation;
- restarting the graphics library transmission format animation, where restarting the graphics library transmission format animation is stopping the graphics library transmission format animation and playing the graphics library transmission format animation from a beginning of the graphics library transmission format animation;
- updating a characteristic of the graphics library transmission format animation;
- setting the graphics library transmission format animation to be applied repeatedly in a loop;
- or
- setting the graphics library transmission format animation to be applied repeatedly in a loop with an initial object position of a current loop being a final object position of a previous loop.
An apparatus comprising:
- at least one processor;
- and
- at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
- provide a utility to align:
- graphics library transmission format temporal media information that describes an animation timeline;
- moving picture temporal media information that describes a moving picture timeline;
- and
- global runtime temporal information that describes a global application timeline;
- wherein the alignment utilizes at least one graphics library transmission format file, a base media file format, or a sample to synchronize the graphics library transmission format temporal media information and the moving picture temporal media information with the global runtime temporal information;
- and
- provide a moving picture buffer extension to link from the graphics library transmission format file to an item and respective track listed by a media object;
- wherein the graphics library transmission format file references the base media file format and track or an item within the base media file format.
An apparatus comprising:
- at least one processor;
- and
- at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
- provide a utility to align:
- graphics library transmission format temporal media information that describes an animation timeline;
- moving picture temporal media information that describes a moving picture timeline;
- and
- global runtime temporal information that describes a global application timeline;
- wherein the alignment utilizes at least one graphics library transmission format file, a base media file format, or a sample to synchronize the graphics library transmission format temporal media information and the moving picture temporal media information with the global runtime temporal information;
- provide a sample entry that identifies a graphics library transmission format file track comprising the sample;
- provide the at least one graphics library transmission format item to update a scene synchronized with moving picture media;
- and
- provide one or more patch updates as samples of a patch update graphics library transmission format track.
Dependencies are inferred from the claim text.