Image processing apparatus, image processing method, and computer program product

An image processing method comprising:

• a three-dimensional model storing step configured to store, in a storage unit, a three-dimensional model data expressing a three-dimensional model of a three-dimensional region, positions of a plurality of devices including a camera disposed in the three-dimensional region as camera positions in the three-dimensional model, and a plurality of device icons expressing types of the devices in the three-dimensional model;
• an acquiring step configured to acquire a shot image taken at the camera and a shooting direction when shooting;
• a composing step configured to determine a view point with respect to the three-dimensional model as the camera position, disposed in the three-dimension region, generate a three-dimensional model by disposing the device icons corresponding to the device types on positions of the devices stored in the three-dimensional model storing unit according to the determined view point and the shooting direction, generate a two-dimensional projection image that the three-dimensional model is projected from a same direction as the shooting direction, at a same scaling factor as a scaling factor of the shot image, onto a two-dimensional plane, and generate a composite image by composing the shot image in a predetermined region that is generated so as to match a center position of the generated two-dimensional projection image with a center position of said shot image, on the generated two-dimensional projection image;
• and
• an outputting step configured to output the composite image, wherein the composing step is configured to display, in case that said device icon is displayed overlapping with the predetermined region when the device icon not corresponding to the camera is displayed on the composite image, the predetermined region in the foreground rather than said device icon.

An image processing apparatus comprising:

• a three-dimensional model storage unit configured to store a three-dimensional model data expressing a three-dimensional model of a three-dimensional region, and a position of a camera disposed in the three-dimensional region as a position in the three-dimensional model;
• an acquiring unit read from a non-transitory recording medium and implemented by a processor configured to acquire a shot image taken at the camera and a shooting direction when shooting;
• an image storing unit configured to store the shot image and the shooting direction that are acquired;
• a manipulation unit comprising at least one of a mouse or a touch panel configured to receive a play-back instruction of the shot image stored in the image storing unit;
• a composing unit read from the non-transitory recording medium and implemented by the processor configured to, when the play-back instruction is received, determine a view point with respect to the three-dimensional model according to the camera position disposed in the three-dimensional region, generate a two-dimensional projection image by projecting the three-dimensional model onto a two-dimensional plane according to the determined view point and the shooting direction stored in the image storing unit, and generate a composite image by composing the shot image stored in the image storing unit onto a predetermined region on the generated two-dimensional projection image;
• and
• an output unit read from the non-transitory recording medium and implemented by the processor configured to output the composite image that is composed, wherein the three-dimensional model further includes another camera icon corresponding to another camera that is different from the camera in the three-dimension region, the acquiring unit acquires selection information indicating whether the camera, when taking the shot image, was in a state selected by the user, a shot image acquired by the another camera, a shooting direction of the another camera when acquiring the shot image, and a selection information indicating whether the another camera, when taking the shot image, was in a state selected by the user, the image storing unit further stores a selection information indicating whether the camera was in a selected state selected by the user when shooting in a corresponding manner with the shot image, and further stores the shot image taken by the another camera, a shooting direction of the another camera when acquiring the shot image, and a selection information indicating whether the another camera was in a selected state selected by the user when shooting in a corresponding manner, and the composing unit, when the manipulation unit receives a selection of the camera icon for the another camera, newly determines a view point position for the three-dimensional model according to a position of the another camera in the three-dimensional model, generates two-dimensional projection image for the three-dimensional model according to the newly determined view point position and the shooting direction corresponding to the shot image taken by the another camera corresponding to the another camera icon, and generates newly a composite image by composing the shot image, which is acquired by the another camera and stored in the image storing unit, onto a predetermined region of the newly generated two dimension project image.

An image processing apparatus comprising:

• a three-dimensional model storage unit configured to store a three-dimensional model data expressing a three-dimensional model of a three-dimensional region, and a position of a camera disposed in the three-dimensional region as a position in the three-dimensional model;
• an acquiring unit read from a non-transitory recording medium and implemented by a processor configured to acquire a shot image taken at the camera and a shooting direction when shooting;
• an image storing unit configured to store, in a corresponding manner, the shot image and the shooting direction that are acquired;
• a manipulation unit comprising at least one of a mouse or a touch panel configured to receive a play-back instruction of the shot image stored in the image storing unit;
• a composing unit read from the non-transitory recording medium and implemented by the processor configured to, when the play-back instruction is received, determine a view point with respect to the three-dimensional model according to the camera position disposed in the three-dimensional region, generate a two-dimensional projection image by projecting the three-dimensional model onto a two-dimensional plane according to the determined view point and the shooting direction stored in the image storing unit, and generate a composite image by composing the shot image stored in the image storing unit onto a predetermined region on the generated two-dimensional projection image;
• and
• an output unit read from the non-transitory recording medium and implemented by the processor configured to output the composite image that is composed,
• wherein
• the three-dimensional model further includes another camera icon corresponding to another camera that is different from the camera in the three-dimension region,
• the manipulation unit is configured to receive a user's selection of the another camera icon corresponding to the another camera that is different from the camera in the two-dimensional projection region,
• the acquiring unit is further configured to acquire a shot image taken at the another camera and a shooting direction when shooting, the image storing unit further stores, in a corresponding manner, the shot image acquired by the acquiring unit and taken by the another camera, and the shooting direction of the another camera when acquiring the shot image,
• the composing unit, when the manipulation unit receives a selection of the camera icon for the another camera,
• newly determines a view point position for the three-dimensional model according to a position of the another camera in the three-dimensional model,
• generates two-dimensional projection image for the three-dimensional model according to the newly determined view point position and the shooting direction corresponding to the shot image taken by the another camera corresponding to the another camera icon, and
• generates newly a composite image by composing the shot image, which is acquired by the another camera and stored in the image storing unit, onto a predetermined region of the newly generated two dimension project image.

An image processing apparatus comprising:

• a three-dimensional model storage unit configured to store a three-dimensional model data expressing a three-dimensional model of a three-dimensional region, and a position of a plurality of cameras disposed in the three-dimensional region as positions in the three-dimensional model;
• an acquiring unit read from a non-transitory recording medium and implemented by a processor configured to acquire a shot image taken at the camera and a shooting direction when shooting;
• an image storing unit configured to store the shot image and the shooting direction that are acquired;
• a manipulation unit comprising at least one of a mouse or a touch panel configured to receive a play-back instruction of the shot image stored in the image storing unit;
• a composing unit read from the non-transitory recording medium and implemented by the processor configured to, when the play-back instruction is received, determine a view point with respect to the three-dimensional model according to the camera position disposed in the three-dimensional region, generate a two-dimensional projection image by projecting the three-dimensional model onto a two-dimensional plane according to the determined view point and the shooting direction stored in the image storing unit, and generate a composite image by composing the shot image stored in the image storing unit onto a predetermined region on the generated two-dimensional projection image;
• an output unit read from the non-transitory recording medium and implemented by the processor configured to output the composite image that is generated;
• a plurality of sensor icons configure to correspond to a plurality of sensors in the three-dimensional region;
• a sensor management table configured to manage association with the plurality of sensors and the plurality of camera icons corresponding to the plurality of cameras;
• wherein
• the manipulation unit is configured to receive use's selection of one sensor icon from the plurality of the sensor icons in the two-dimensional projection image,
• the composing unit, when the manipulation unit receives the selection of the sensor icon, identifies a camera icon corresponding to the selected sensor icon from the sensor management table,
• newly determines a view point position for the three-dimensional model based on a position of the identified camera icon in the three-dimensional model,
• generates the two-dimensional projection image for the three-dimensional model according to the newly determined view point position and a shooting direction corresponding to the shot image taken by the camera corresponding to the identified camera icon, and
• generates newly a composite image by composing the shot image, which is acquired by the camera corresponding to the identified camera icon that corresponds to the selected sensor icon and stored in the image storing unit onto a predetermined region of the generated two dimension project image by using the newly determined view point position.