Method and apparatus for representing dynamic neural radiance fields from unsynchronized videos

An apparatus of acquiring a video at an arbitrary viewpoint based on a dynamic neural radiance fields model, the apparatus comprising:

• at least one processor and at least one memory,
• wherein the at least one processor is configured to:
• input one or more videos acquired from one or more views for one scene into the dynamic neural radiance fields model;
• input a time embedding for the one or more videos into the dynamic neural radiance fields model;
• and
• render the one or more videos at the arbitrary viewpoint based on color information and density information output by the dynamic neural radiance fields model,
• wherein time synchronization related to the time embedding is performed by applying an individual time offset learned for each view, for the one or more views.

One or more non-transitory computer readable medium storing one or more instructions,

• wherein the one or more instructions are executed by one or more processors and control an apparatus for acquiring a video at an arbitrary viewpoint based on a dynamic neural radiance fields model to:
• input one or more videos acquired from one or more views for one scene into the dynamic neural radiance fields model;
• input a time embedding for the one or more videos into the dynamic neural radiance fields model;
• and
• render the one or more videos at the arbitrary viewpoint based on color information and density information output by the dynamic neural radiance fields model,
• wherein time synchronization related to the time embedding is performed by applying an individual time offset learned for each view, for the one or more views.