Image processing apparatus and image processing method, and image capturing apparatus

An image processing apparatus comprising:

• an acquisition unit that acquires (a) a first image obtained through shooting and (b) distance information of the first image, wherein the distance information includes information on a distance to a subject in the first image in a depth direction;
• a detection unit that detects a main subject from the first image;
• an extraction unit that extracts another subject that exists in a predetermined region of the first image, the predetermined region being within a predetermined distance from the main subject, based on the distance information of the main subject;
• a setting unit that sets parameters of one or more virtual light sources that emit virtual light to the main subject and the another subject;
• and
• a processing unit that generates, from the first image, a second image in which the main subject and the another subject are illuminated with the virtual light using the parameters set by the setting unit,
• wherein each unit is implemented by one or more processors, circuitry, or a combination thereof.

An image processing method comprising:

• acquiring (a) a first image obtained through shooting and (b) distance information of the first image, wherein the distance information includes information on a distance to a subject in the first image in a depth direction;
• detecting a main subject from the first image;
• extracting another subject that exists in a predetermined region of the first image, the predetermined region being within a predetermined distance from the main subject, based on the distance information of the main subject;
• setting parameters of one or more virtual light sources that emit virtual light to the main subject and the another subject;
• and
• generating, from the first image, a second image in which the main subject and the another subject are illuminated with the virtual light using the parameters set by the setting.

A non-transitory computer-readable storage medium, the storage medium storing a program that is executable by a computer, wherein the program includes program code for causing the computer to function as an image processing apparatus comprising:

• an acquisition unit that acquires (a) a first image obtained through shooting and (b) distance information of the first image, wherein the distance information includes information on a distance to a subject in the first image in a depth direction;
• a detection unit that detects a main subject from the first image;
• an extraction unit that extracts another subject that exists in a predetermined region of the first image, the predetermined region being within a predetermined distance from the main subject, based on the distance information of the main subject;
• a setting unit that sets parameters of one or more virtual light sources that emit virtual light to the main subject and the another subject;
• and
• a processing unit that generates, from the first image, a second image in which the main subject and the another subject are illuminated with the virtual light using the parameters set by the setting unit.