Image processing apparatus

An image processing apparatus comprising:

• a depth map acquisition section configured to acquire a depth map that includes information that indicates a distance up to a subject in an actual space, the depth map including, for each of one or a plurality of areas in the depth map, information regarding the distance up to a subject portion that appears in the area;
• and
• a composite image generation section configured to generate a composite image in which a virtual object is arranged in a scene image that represents a scene of the actual space, wherein
• the composite image generation section calculates a variation of a color of the subject portion caused by light from the virtual object on a basis of a position in the actual space of the subject portion and a display color of the virtual object and changes a color of a pixel in the scene image corresponding to the subject portion in accordance with the calculated variation;
• and wherein
• a plurality of images, of the actual space, each obtained under respective conditions different than conditions under which the scene image is obtained, are used to generate the depth map, such different conditions being conditions in which the distance up to the subject portion that appears in the depth map is more easily indicated than in the conditions under which the scene image is obtained;
• the plurality of images are obtained using a stereoscopic camera;
• and
• the respective conditions differ from one another, and from the conditions under which the scene image is obtained, with regard to photographing direction, photographing position, and photographing range of the camera.

An image processing method comprising:

• acquiring a depth map that includes information that indicates a distance up to a subject, the depth map including, for each of one or a plurality of areas in the depth map, information regarding the distance up to a subject portion that appears in the area and regarding a color component of the subject portion;
• and
• generating a composite image in which a virtual object is arranged in a scene image that represents a scene of an actual space, wherein
• in the composite image generating, a display color of the virtual object is determined on a basis of the distance up to the subject portion that appears in the depth map and the color component thereof;
• and wherein
• a plurality of images, of the actual space, each obtained under respective conditions different than conditions under which the scene image is obtained, are used to generate the depth map, such different conditions being conditions in which the distance up to the subject portion that appears in the depth map is more easily indicated than in the conditions under which the scene image is obtained;
• the plurality of images are obtained using a stereoscopic camera;
• and
• the respective conditions differ from one another, and from the conditions under which the scene image is obtained, with regard to photographing direction, photographing position, and photographing range of the camera.

A non-transitory, computer readable information storage medium in which a computer program is stored, which when the computer program is executed by a computer, causes the computer to carry out actions, comprising:

• acquiring a depth map that includes information that indicates a distance up to a subject, the depth map including, for each of one or a plurality of areas in the depth map, information regarding the distance up to a subject portion that appears in the area and regarding a color component of the subject portion;
• and
• generating a composite image in which a virtual object is arranged in a scene image that represents a scene of an actual space, wherein
• in the composite image generating, a display color of the virtual object is determined on a basis of the distance up to the subject portion that appears in the depth map and the color component thereof;
• and wherein
• a plurality of images, of the actual space, each obtained under respective conditions different than conditions under which the scene image is obtained, are used to generate the depth map, such different conditions being conditions in which the distance up to the subject portion that appears in the depth map is more easily indicated than in the conditions under which the scene image is obtained;
• the plurality of images are obtained using a stereoscopic camera;
• and
• the respective conditions differ from one another, and from the conditions under which the scene image is obtained, with regard to photographing direction, photographing position, and photographing range of the camera.