Generation apparatus, system and method for generating virtual viewpoint image

A method for a system, the method comprising:

• generating three-dimensional shape data corresponding to a moving object captured from a plurality of directions;
• acquiring three-dimensional shape data corresponding to a structure which is different from the moving object and which is captured from the plurality of directions;
• acquiring background data corresponding to a background which is different at least from the moving object and the structure and which is captured from the plurality of directions;
• acquiring information representing a virtual viewpoint;
• and
• generating an image based on the generated three-dimensional shape data corresponding to the moving object, the acquired three-dimensional shape data corresponding to the structure, the acquired background data, and the acquired virtual viewpoint information,
• wherein the generated three-dimensional shape data corresponding to the moving object is generated based on a difference between (A) an image acquired based on first image capturing in a state where the structure and the moving object exist and (B) an image acquired based on second image capturing from the same direction as that of the first image capturing in a state where the structure exist and the moving object does not exist, where a timing which the second image capturing was performed is different from a timing which the first image capturing was performed.

A non-transitory computer readable storage medium storing a program to cause a computer to perform a method for a system, the method comprising:

• generating three-dimensional shape data corresponding to a moving object captured from a plurality of directions;
• acquiring three-dimensional shape data corresponding to a structure which is different from the moving object and which is captured from the plurality of directions;
• acquiring background data corresponding to a background which is different at least from the moving object and the structure and which is captured from the plurality of directions;
• acquiring information representing a virtual viewpoint;
• and
• generating an image based on the generated three-dimensional shape data corresponding to the moving object, the acquired three-dimensional shape data corresponding to the structure, the acquired background data, and the acquired virtual viewpoint information,
• wherein the generated three-dimensional shape data corresponding to the moving object is generated based on a difference between (A) an image acquired based on first image capturing in a state where the structure and the moving object exist and (B) an image acquired based on second image capturing from the same direction as that of the first image capturing in a state where the structure exist and the moving object does not exist, where a timing which the second image capturing was performed is different from a timing which the first image capturing was performed.