Imaging device, information processing device, imaging method, and information processing method

An imaging method, comprising:

• by a central processing unit (CPU):
• capturing, by a polarization sensor, a first image of a subject that is simultaneously irradiated with light from a plurality of lights, wherein a polarization direction of the light emitted by the plurality of lights is different;
• separating a pixel signal corresponding to each of the polarization directions from the captured first image,
• generating a second image for each of the polarization directions;
• calculating a normal line on a surface of the subject from the second image for each of the polarization directions by photometric stereo;
• and
• estimating a shape of the subject based on the normal line;
• storing correspondence information that associates each of the plurality of lights, the polarization directions, and directions of the plurality of lights with respect to the subject;
• estimating a polarization model that indicates a correspondence relationship between the polarization directions and luminance of each pixel in the first image of the subject,
• wherein the first image of the subject is irradiated with the light having the polarization direction based on luminance of each pixel in the second image for each of the polarization directions;
• and
• calculating the luminance of each pixel in the second image for each of the plurality of lights based on the polarization model and the correspondence information.

An information processing device, comprising:

• a central processing unit (CPU) configured to:
• store correspondence information that associates
• a plurality of lights having light emitted to a subject, wherein a polarization direction of the light emitted by each of the plurality of lights is different,
• the polarization directions of the light emitted by each of the plurality of lights, and
• directions of the plurality of lights with respect to the subject;
• separate a pixel signal corresponding to each of the polarization directions from a first image, in which the subject simultaneously irradiated with light from the plurality of lights, wherein the first image is captured by a polarization sensor, and
• generate a second image for each of the plurality of lights based on the correspondence information;
• calculate a normal line on a surface of the subject from the second image for each of the lights by photometric stereo;
• and
• estimate a shape of the subject based on the normal line;
• estimate a polarization model that indicates a correspondence relationship between the polarization directions and luminance of each pixel in the first image of the subject,
• wherein the first image of the subject is irradiated with the light having the polarization direction based on luminance of each pixel in the second image for each of the polarization directions;
• and
• calculate the luminance of each pixel in the second image for each of the plurality of lights based on the polarization model and the correspondence information.

An information processing method, comprising:

• by a central processing unit (CPU):
• storing correspondence information that associates
• a plurality of lights having light emitted to a subject, wherein a polarization direction of the light emitted by each of the plurality of lights is different,
• the polarization directions of the light emitted by each of the plurality of lights, and
• directions of the plurality of lights with respect to the subject, separating a pixel signal corresponding to each of the polarization directions from a first image, in which the subject simultaneously irradiated with light from the plurality of lights, wherein the first image is captured by a polarization sensor;
• generating a second image for each of the plurality of lights based on the correspondence information;
• calculating a normal line on a surface of the subject from the second image for each of the plurality of lights by photometric stereo;
• estimating a shape of the subject based on the normal line;
• estimating a polarization model that indicates a correspondence relationship between the polarization directions and luminance of each pixel in the first image of the subject,
• wherein the first image of the subject is irradiated with the light having the polarization direction based on luminance of each pixel in the second image for each of the polarization directions;
• and
• calculating the luminance of each pixel in the second image for each of the plurality of lights based on the polarization model and the correspondence information.