Image processing apparatus, image processing method, and program

An image processing method comprising:

• generating and outputting a virtual viewpoint image with reference to a position and an orientation of a target object, wherein the target object is included in an imaging region and a plurality of images on the basis of the plurality of images obtained by imaging the imaging region with a plurality of imaging devices of which at least either of imaging positions or imaging directions are different;
• generating an adjustment position and an adjustment orientation based on the position and the orientation of the target object by smoothing an amount of temporal changes in at least one of the position or the orientation of the target object;
• controlling a display aspect of the virtual viewpoint image by generating and outputting the virtual viewpoint image with reference to the adjustment position and the adjustment orientation;
• and
• controlling a display region of the virtual viewpoint image by controlling a resolution for each region included in the display region of the virtual viewpoint image,
• wherein the display region of the virtual viewpoint image is divided into a facing region facing the orientation and a peripheral region surrounding the facing region, and
• a resolution of the peripheral region is set to be lower than a resolution of the facing region.

A non-transitory computer-readable storage medium storing a program executable by a computer to perform a process comprising:

• generating and outputting a virtual viewpoint image with reference to a position and an orientation of a target object, wherein the target object is included in an imaging region and a plurality of images on the basis of the plurality of images obtained by imaging the imaging region with a plurality of imaging devices of which at least either of imaging positions or imaging directions are different;
• generating an adjustment position and an adjustment orientation based on the position and the orientation of the target object by smoothing an amount of temporal changes in at least one of the position or the orientation of the target object;
• controlling a display aspect of the virtual viewpoint image by generating and outputting the virtual viewpoint image with reference to the adjustment position and the adjustment orientation;
• and
• controlling a display region of the virtual viewpoint image by controlling a resolution for each region included in the display region of the virtual viewpoint image,
• wherein the display region of the virtual viewpoint image is divided into a facing region facing the orientation and a peripheral region surrounding the facing region, and
• a resolution of the peripheral region is set to be lower than a resolution of the facing region.