Cinematic space-time view synthesis for enhanced viewing experiences in computing environments
AssigneeIntel Corporation
InventorsGowri Somanath, Oscar Nestares
Life of this patent
Estimating the term…
Abstract
A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.
Claims22
1-20. (canceled)
An apparatus comprising:
- at least one memory;
- instructions in the apparatus;
- and
- processor circuitry to execute the instructions to:
- access input images of an object or scene captured by one or more cameras, different ones of the input images associated with at least one of different times of capture or different perspectives of the object or scene to define a space-time volume of images;
- synthesize pairs of the input images along a cinematic path to generate intermediate images corresponding to respective ones of the pairs, the cinematic path associated with a subset of the input images within the space-time volume of images;
- and
- generate a series of frames for a video based on the intermediate images.
At least one storage device comprising instructions that, when executed, cause processor circuitry to at least:
- access input images of an object or scene captured by one or more cameras, different ones of the input images associated with at least one of different times of capture or different perspectives of the object or scene to define a space-time volume of images;
- synthesize successive pairs of the input images along a cinematic path to generate intermediate images corresponding to respective ones of the successive pairs, the cinematic path passing through a subset of input images within the space-time volume of images;
- and
- generate a series of frames for a video based on the subset of input images and the intermediate images.
An apparatus comprising:
- means for storing instructions;
- and
- means for executing the instructions, the executing means to:
- access input images of an object or scene captured by one or more cameras, different ones of the input images associated with at least one of different times of capture or different perspectives of the object or scene, the different ones of the input images to collectively define a space-time volume of images;
- synthesize pairs of a subset of the input images identified by a cinematic path extending through the space-time volume of images, the synthesis of the pairs to generate intermediate images for respective ones of the pairs;
- and
- generating a series of frames for a video that includes the intermediate images.
Dependencies are inferred from the claim text.