Generating artificial video with changed domain
AssigneeFord Global Technologies, LLC
InventorsAkhil Perincherry, Arpita Chand
Life of this patent
Estimating the term…
Abstract
A computer includes a processor and a memory, and the memory stores instructions executable by the processor to receive an input video of a scene and audio data associated with the input video, the input video being in a first domain; execute an encoder to map the input video and the audio data to a latent vector in a lower-dimensional latent space; and execute a generator to generate an output video of the scene from the latent vector, the output video being in a second domain. The encoder and the generator are trained to maintain temporal consistency between the input video and the output video by using the audio data.
Claims20
A computer comprising a processor and a memory, the memory storing instructions executable by the processor to:
- receive an input video of a scene and audio data associated with the input video, the input video being in a first domain;
- execute an encoder to map the input video and the audio data to a latent vector in a lower-dimensional latent space;
- and
- execute a generator to generate an output video of the scene from the latent vector, the output video being in a second domain;
- wherein the encoder and the generator are trained to maintain temporal consistency between the input video and the output video by using the audio data.
A method comprising:
- receiving an input video of a scene and audio data associated with the input video, the input video being in a first domain;
- executing an encoder to map the input video and the audio data to a latent vector in a lower-dimensional latent space;
- and
- executing a generator to generate an output video of the scene from the latent vector, the output video being in a second domain;
- wherein the encoder and the generator are trained to maintain temporal consistency between the input video and the output video by using the audio data.
Dependencies are inferred from the claim text.