Method and an apparatus for performing object illumination manipulation on an image

A device for performing an object illumination manipulation operation on a first image, the device comprising:

• an input interface configured to receive the first image and an input of a predetermined light direction, the predetermined light direction comprising one of a default light direction or a user-defined light direction;
• and
• a processor configured to:
• generate a second image with a first object detected from the first image,
• fit a generic three dimensional (3D) mesh to a second object in the second image,
• apply illumination defined by the predetermined light direction to the generic 3D mesh fitted to the second object,
• determine a second object illumination of the second image based on the predetermined light direction and the generic 3D mesh fitted to the second object, and
• replace a first object illumination of the first image with the second object illumination.

A non-transitory computer-readable recording medium configured to store one or more computer programs including instructions which, when executed by at least one processor, cause the at least one processor to control to:

• receive a first image and an input of a predetermined light direction, the predetermined light direction comprising one of a default light direction or a user-defined light direction;
• generate a second image with a first object detected from the first image;
• fit a generic three dimensional (3D) mesh to a second object in the second image;
• apply illumination defined by the predetermined light direction to the generic 3D mesh fitted to the second object;
• determine a second object illumination of the second image based on the predetermined light direction and the 3D generic mesh fitted to the second object;
• and
• replace a first object illumination of the first image with the second object illumination.