Image decomposition and path-space motion estimation
AssigneeDisney Enterprises, Inc.
InventorsHenning Zimmer, Olga Sorkine Hornung, Oliver Wang, Alexander Sorkine Hornung, Wenzel Jakob, Fabrice Pierre Armand Rousselle, Wojciech Krzysztof Jarosz, David M. Adler
Life of this patent
Estimating the term…
Abstract
Particular embodiments decompose an image comprising a scene into a diffuse component and a specular component. Each of the components represent a contribution to lighting in the scene. A set of motion vectors may be extracted in order to capture motion in the scene. Finally, a final contribution of each of the components to the image may be computed based on the motion vectors.
Claims19
A method comprising, by one or more computing systems:
- for each of a plurality of pixels in an image comprising a scene:
- decomposing a color of the pixel into a diffuse component and a specular component, each of the components representing a contribution to lighting in the scene;
- extracting a set of motion vectors for the pixel in order to capture motion in the scene by performing temporal manifold exploration of light paths in the specular component, wherein one of the motion vectors in the set corresponds to the diffuse component and one of the motion vectors in the set corresponds to the specular component, wherein the temporal manifold exploration is performed only up to a first non-specular interaction or light source, and wherein endpoints of the light paths remain attached to their underlying objects in the scene;
- and
- computing, based on the motion vectors, a final contribution of each of the components to the color of the pixel.
One or more computer-readable non-transitory storage media embodying software comprising instructions operable when executed to:
- for each of a plurality of pixels in an image comprising a scene:
- decompose a color of the pixel into a diffuse component and a specular component, each of the components representing a contribution to lighting in the scene;
- extract a set of motion vectors for the pixel in order to capture motion in the scene by performing temporal manifold exploration of light paths in the specular component, wherein one of the motion vectors in the set corresponds to the diffuse component and one of the motion vectors in the set corresponds to the specular component, wherein the temporal manifold exploration is performed only up to a first non-specular interaction or light source, and wherein endpoints of the light paths remain attached to their underlying objects in the scene;
- and
- compute, based on the motion vectors, a final contribution of each of the components to the color of the pixel.
A system comprising one or more processors and a memory coupled to the processors comprising instructions executable by the processors, the processors being operable when executing the instructions to:
- for each of a plurality of pixels in an image comprising a scene:
- decompose a color of the pixel into a diffuse component and a specular component, each of the components representing a contribution to lighting in the scene;
- extract a set of motion vectors for the pixel in order to capture motion in the scene by performing temporal manifold exploration of light paths in the specular component, wherein one of the motion vectors in the set corresponds to the diffuse component and one of the motion vectors in the set corresponds to the specular component, wherein the temporal manifold exploration is performed only up to a first non-specular interaction or light source, and wherein endpoints of the light paths remain attached to their underlying objects in the scene;
- and
- compute, based on the motion vectors, a final contribution of each of the components to the color of the pixel.
Dependencies are inferred from the claim text.