Image processing apparatus, image generating method, and storage medium

An image processing apparatus comprising:

• one or more hardware processors;
• and
• one or more memories storing one or more programs configured to be executed by the one or more hardware processors, the one or more programs including instructions for:
• (A) obtaining object information indicating a three-dimensional position and a three-dimensional shape of a specific object in a three-dimensional space, wherein the specific object is included in at least one of captured images obtained by a plurality of imaging apparatuses;
• (B) obtaining viewpoint information indicating a three-dimensional position of a virtual viewpoint and a direction from the virtual viewpoint in the three-dimensional space;
• (C) determining, based on (1) the obtained object information and (2) the obtained viewpoint information, a three-dimensional position of a virtual object in the three-dimensional space, wherein the virtual object is not included in the plurality of captured images;
• and
• (D) generating a virtual viewpoint image including a region corresponding to a virtual object whose content presents determined information, based on (i) the obtained object information, (ii) the obtained viewpoint information, and (iii) the determined three-dimensional position of the virtual object,
• wherein in the virtual viewpoint image, the specific object, and the virtual object do not overlap.

An image generating method executable by an image processing apparatus, the method comprising:

• (A) obtaining object information indicating a three-dimensional position and a three-dimensional shape of a specific object in a three-dimensional space, wherein the specific object is included in at least one of captured images obtained by a plurality of imaging apparatuses;
• (B) obtaining viewpoint information indicating a three-dimensional position of a virtual viewpoint and a direction from a viewpoint in the three-dimensional space;
• (C) determining, based on (1) the obtained object information and (2) the obtained viewpoint information, a three-dimensional position of a virtual object in the three-dimensional space, wherein the virtual object is not included in the plurality of captured images;
• and
• (D) generating a virtual viewpoint image including a region corresponding to a virtual object whose content presents determined information, based on (i) the obtained object information, (ii) the obtained viewpoint information, and (iii) the determined three-dimensional position of the virtual object,
• wherein in the virtual viewpoint image, the specific object, and the virtual object do not overlap.

A non-volatile computer-readable storage medium which stores a program for causing a computer to execute a method, the method comprising:

• (A) obtaining object information indicating a three-dimensional position and a three-dimensional shape of a specific object in a three-dimensional space, wherein the specific object is included in at least one of captured images obtained by a plurality of imaging apparatuses;
• (B) obtaining viewpoint information indicating a three-dimensional position of a virtual viewpoint and a direction from a virtual viewpoint in the three-dimensional space;
• (C) determining, based on (1) the obtained object information and (2) the obtained viewpoint information, a three-dimensional position of a virtual object in the three-dimensional space, wherein the virtual object is not included in the plurality of captured images;
• (D) generating a virtual viewpoint image including a region corresponding to a virtual object whose content presents determined information, based on (i) the obtained object information, (ii) the obtained viewpoint information, and (iii) the determined three-dimensional position of the virtual object,
• wherein in the virtual viewpoint image, the specific object, and the virtual object do not overlap.