Generation apparatus of virtual viewpoint image, generation method, and storage medium

A virtual viewpoint image generation method comprising:

• obtaining a plurality of first images which are images based on capturing a first area including a predetermined area using a plurality of first image capturing devices from a plurality of directions,
• obtaining a plurality of second images which are images based on capturing a second area including the predetermined area using a plurality of second image capturing devices from a plurality of directions, wherein a resolution of an image corresponding to the predetermined area in at least one of the second images is higher than a resolution of an image corresponding to the predetermined area in at least one of first images;
• setting a position and direction of a virtual viewpoint;
• generating, based on at least one of the obtained first images, a first virtual viewpoint image corresponding to the position and direction of the virtual viewpoint which are set;
• determining whether or not to generate a second virtual viewpoint image based on at least one of the obtained second images and corresponding to the position and direction of the virtual viewpoint which are set, based on at least an evaluation of an image quality of an image corresponding to the predetermined area in the first virtual viewpoint image;
• and
• generating the second virtual viewpoint image in a case where to generate the second virtual viewpoint image is determined.

A non-transitory computer readable storage medium storing a program for causing a computer to perform a virtual viewpoint image generation method, the method comprising:

• obtaining a plurality of first images which are images based on capturing a first area including a predetermined area using a plurality of first image capturing devices from a plurality of directions,
• obtaining a plurality of second images which are images based on capturing a second area including the predetermined area using a plurality of second image capturing devices from a plurality of directions, wherein a resolution of an image corresponding to the predetermined area in at least one of the second images is higher than a resolution of an image corresponding to the predetermined area in at least one of first images;
• setting a position and direction of a virtual viewpoint;
• generating, based on at least one of the obtained first images, a first virtual viewpoint image corresponding to the position and direction of the virtual viewpoint which are set;
• determining whether or not to generate a second virtual viewpoint image based on at least one of the obtained second images and corresponding to the position and direction of the virtual viewpoint which are set, based on at least an evaluation of an image quality of an image corresponding to the predetermined area in the first virtual viewpoint image;
• and
• generating the second virtual viewpoint image in a case where to generate the second virtual viewpoint image is determined.