Cinematic space-time view synthesis for enhanced viewing experiences in computing environments
AssigneeIntel Corporation
InventorsGowri Somanath, Oscar Nestares
Life of this patent
Estimating the term…
Abstract
A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.
Claims17
An apparatus comprising:
- one or more processors coupled to one or more cameras, the one or more processors to:
- facilitate the one or more cameras to capture multiple images at multiple positions or multiple points in times, wherein the multiple images represent multiple views of an object or a scene;
- generate a displacement map of the multiple images based on movement of pixels from a first image of the multiple images to a second image of the multiple images, wherein the displacement map represents a flow to a target view of the multiple views such that to track one or more pixels from the first image moving into the second image, wherein the first and second images are warped up to half-way to generate a middle image, wherein warping of the first and second images include warping of pixels of the first and second images based on the displacement map;
- and
- synthesize the multiple images into a single image based on the displacement map, wherein the single image includes a final middle image representing an intermediary view of the multiple views, wherein the final middle image represents a final output view of the multiple views.
A method comprising:
- capturing, by one or more cameras coupled to one or more processors, multiple images at multiple positions or multiple points in times, wherein the multiple images represent multiple views of an object or a scene;
- generating a displacement map of the multiple images based on movement of pixels from a first image of the multiple images to a second image of the multiple images, wherein the displacement map represents a flow to a target view of the multiple views such that to track one or more pixels from the first image moving into the second image, wherein the first and second images are warped up to half-way to generate a middle image, wherein warping of the first and second images include warping of pixels of the first and second images based on the displacement map;
- and
- synthesizing, by a neural network, the multiple images into a single image based on the displacement map, wherein the single image includes a final middle image representing an intermediary view of the multiple views, wherein the final middle image represents a final output view of the multiple views.
At least one non-transitory machine-readable medium comprising instructions which, when executed by a computing device, cause the computing device to perform operations comprising:
- capturing, by one or more cameras coupled to one or more processors, multiple images at multiple positions or multiple points in times, wherein the multiple images represent multiple views of an object or a scene;
- and
- generating a displacement map of the multiple images based on movement of pixels from a first image of the multiple images to a second image of the multiple images, wherein the displacement map represents a flow to a target view of the multiple views such that to track one or more pixels from the first image moving into the second image, wherein the first and second images are warped up to half-way to generate a middle image, wherein warping of the first and second images include warping of pixels of the first and second images based on the displacement map;
- and
- synthesizing, by a neural network, the multiple images into a single image based on the displacement map, wherein the single image includes a final middle image representing an intermediary view of the multiple views, wherein the final middle image represents a final output view of the multiple views.
Dependencies are inferred from the claim text.