Facial reconstruction network
AssigneeAdobe Inc.
InventorsSAIKAT CHAKRABARTY, SUNIL KUMAR
Life of this patent
Estimating the term…
Abstract
Systems and methods for digital image processing are described. Embodiments of the systems and methods includes identifying a digital image that includes an obscured region; generating a predicted image using a neural network comprising an encoder, a feature transfer network, and a decoder, wherein the feature transfer network is trained to predict features corresponding to the obscured region based on an output of the decoder; and combining the digital image and the predicted image to produce a reconstructed version of the digital image including details corresponding to the obscured region that are not present in the digital image.
Claims20
A method for image processing, the method comprising:
- identifying a digital image that includes an obscured region;
- generating a predicted image using a neural network comprising an encoder, a feature transfer network, and a decoder, wherein the feature transfer network is trained to predict features corresponding to the obscured region based on an output of the decoder;
- and
- combining the digital image and the predicted image to produce a reconstructed version of the digital image including details corresponding to the obscured region that are not present in the digital image.
A method of training a network for image processing, the method comprising:
- training a decoder to generate images based on input vectors;
- training an encoder to generate feature vectors based on input images, wherein the encoder is trained based at least in part on the trained decoder;
- and
- training a feature transfer network to generate reconstructed feature vectors based on the feature vectors, wherein the reconstructed feature vectors comprise details corresponding to obscured regions of the feature vectors, and wherein the feature transfer network is trained based at least in part on the trained encoder.
An apparatus for image processing, comprising:
- an encoder configured to generate feature vectors based on input images that include obscured regions;
- a feature transfer network configured to generate reconstructed feature vectors based on the feature vectors, wherein the reconstructed feature vectors include reconstructed features corresponding to the obscured regions of the input images;
- and
- a decoder configured to generate reconstructed images based on the reconstructed feature vectors, wherein the reconstructed images include details corresponding to the obscured regions of the input images based on the reconstructed features.
Dependencies are inferred from the claim text.