Image processing apparatus, method of controlling the same, non-transitory computer-readable storage medium, and image processing system

A method of controlling an image processing apparatus that operates in a system for generating a virtual view-point image based on a plurality of images acquired by a plurality of image capturing devices that capture an image capturing area from different directions, the method comprising:

• receiving first image data based on image capturing at a first timing by a first image capturing device which is one of the plurality of image capturing devices;
• obtaining evaluation information for evaluating an image quality of encoded second image data, the second image data being image data based on image capturing at a second timing previous to the first timing by the first image capturing device;
• obtaining evaluation information for evaluating an image quality of encoded third image data, the third image data being image data based on image capturing at the first timing by a second image capturing device which is different from the first image capturing device and is one of the plurality of image capturing devices;
• determining, based on at least the obtained evaluation information of the encoded second image data and the obtained evaluation information of the encoded third image data, an encoding parameter for encoding the first image data so that an image quality difference between the encoded first image data and the encoded second image data falls within a predetermined range and an image quality difference between the encoded first image data and the encoded third image data falls within a predetermined range;
• and
• encoding the first image data according to the determined encoding parameter.

A non-transitory computer-readable storage medium storing a program which, when read and executed by a computer, causes the computer to perform the steps of a method of controlling an image processing apparatus that operates in a system for generating a virtual view-point image based on shot images acquired by a plurality of image capturing devices, the method comprising:

• receiving first image data based on image capturing at a first timing by a first image capturing device which is one of the plurality of image capturing devices;
• obtaining evaluation information for evaluating an image quality of encoded second image data, the second image data being image data based on image capturing at a second timing previous to the first timing by the first image capturing device;
• obtaining evaluation information for evaluating an image quality of encoded third image data, the third image data being image data based on image capturing at the first timing by a second image capturing device which is different from the first image capturing device and is one of the plurality of image capturing devices;
• determining, based on at least the obtained evaluation information of the encoded second image data and the obtained evaluation information of the encoded third image data, an encoding parameter for encoding the first image data so that an image quality difference between the encoded first image data and the encoded second image data falls within a predetermined range and an image quality difference between the encoded first image data and the encoded third image data falls within a predetermined range;
• and
• encoding the first image data according to the determined encoding parameter.

An image processing system comprising an information processing apparatus which generates a virtual view-point image at a virtual view-point position based on a plurality of images acquired by a plurality of image capturing devices at different view-point positions, and the plurality of image capturing devices each of which includes an image capturing unit, encodes a captured image, and transmits the encoded image to the information processing apparatus,

• wherein the information processing apparatus comprises:
• one or more memories that store a set of instructions;
• and
• one or more processors that execute the instructions to:
• receive first image data based on image capturing at a first timing by a first image capturing device which is one of the plurality of image capturing devices;
• obtain evaluation information for evaluating an image quality of encoded second image data, the second image data being image data based on image capturing at a second timing previous to the first timing by the first image capturing device;
• obtain evaluation information for evaluating an image quality of encoded third image data, the third image data being image data based on image capturing at the first timing by a second image capturing device which is different from the first image capturing device and is one of the plurality of image capturing devices;
• determine, based on at least the obtained evaluation information of the encoded second image data and the obtained evaluation information of the encoded third image data, an encoding parameter for encoding the first image data so that an image quality difference between the encoded first image data and the encoded second image data falls within a predetermined range and an image quality difference between the encoded first image data and the encoded third image data falls within a predetermined range;
• encode the first image data according to the determined encoding parameter.