Image relighting
AssigneeFord Global Technologies, LLC
InventorsXianling Zhang, Nathan Tseng, Nikita Jaipuria, Rohan Bhasin
Life of this patent
Estimating the term…
Abstract
A computer includes a processor and a memory storing instructions executable by the processor to receive a plurality of first images of an environment in a first lighting condition, classify pixels of the first images into categories, mask the pixels belonging to at least one of the categories from the first images, generate a three-dimensional representation of the environment based on the masked first images, and generate a second image of the environment in a second lighting condition based on the three-dimensional representation and on a first one of the first images.
Claims16
A computer comprising a processor and a memory storing instructions executable by the processor to:
- receive a plurality of first images of an environment in a first lighting condition;
- classify pixels of the first images into categories;
- mask the pixels belonging to at least one of the categories from the first images;
- generate a three-dimensional representation of the environment based on the masked first images;
- generate a first shadow mask of the first one of the first images, wherein generating the first shadow mask includes executing a second machine-learning algorithm, and the first images are inputs to the second machine-learning algorithm;
- generate a second shadow mask of the environment in the second lighting condition from a perspective of the first one of the first images, wherein generating the second shadow mask includes executing a third machine-learning algorithm, and the first images are inputs to the third machine-learning algorithm;
- and
- generate a second image of the environment in a second lighting condition based on the three-dimensional representation, on a first one of the first images, on the first shadow mask, and on the second shadow mask, wherein generating the second image includes executing a first machine-learning algorithm;
- and the first one of the first images, the first shadow mask, and the second shadow mask are inputs to the first machine-learning algorithm.
A method comprising:
- receiving a plurality of first images of an environment in a first lighting condition;
- classifying pixels of the first images into categories;
- masking the pixels belonging to at least one of the categories from the first images;
- generating a three-dimensional representation of the environment based on the masked first images;
- generating a first shadow mask of the first one of the first images, wherein generating the first shadow mask includes executing a second machine-learning algorithm, and the first images are inputs to the second machine-learning algorithm;
- generating a second shadow mask of the environment in the second lighting condition from a perspective of the first one of the first images, wherein generating the second shadow mask includes executing a third machine-learning algorithm, and the first images are inputs to the third machine-learning algorithm;
- and
- generating a second image of the environment in a second lighting condition based on the three-dimensional representation, on a first one of the first images, on the first shadow mask, and on the second shadow mask, wherein generating the second image includes executing a first machine-learning algorithm;
- and the first one of the first images, the first shadow mask, and the second shadow mask are inputs to the first machine-learning algorithm.
Dependencies are inferred from the claim text.