Image processing apparatus, display system, image processing method, and medium

A display system comprising a display area in which an image is displayed,

• wherein the display area has a configuration in which a plurality of flat display screens are placed, each display screen being capable of displaying an image,
• wherein a display image to be displayed on each of the plurality of display screens is generated on the basis of one input image acquired through shooting by one image capturing apparatus,
• wherein the display area displays an image resulting from projecting the input image on a projection plane having a shape formed by cutting out a part of a cylindrical surface,
• wherein the display system further comprises an image processing apparatus that generates the display image to be displayed in the display area, the image processing apparatus comprising:
• (1) an obtaining unit configured to obtain the input image acquired through shooting by the image capturing apparatus;
• (2) a generating unit configured to generate the display image from the input image on the basis of a correspondence between a first projection plane corresponding to the input image and a second projection plane corresponding to the display area;
• and
• (3) a holding unit configured to hold information indicating the correspondence,
• wherein the correspondence is a correspondence calculated in accordance with a shooting field angle at which the input image has been captured and a view angle with which the display image is displayed in the display area with respect to a point-of-view position,
• wherein the first projection plane has a size that is based on the shooting field angle,
• wherein the second projection plane has a size that is based on the view angle,
• wherein the correspondence is a relationship that is based on a ratio of a length of the first projection plane in a horizontal direction to a length of the second projection plane in the horizontal direction,
• wherein the correspondence is a relationship in which positions at a predetermined interval on the first projection plane are associated with corresponding positions on the second projection plane such that the corresponding positions are equally spaced,
• wherein the first projection plane is a flat plane,
• wherein the second projection plane is a plane formed by curving a flat plane in a horizontal direction, and
• wherein the correspondence has a linearity relationship between a coordinate indicating a position of a point on the first projection plane and an angle indicating a position of a point on the second projection plane such that the coordinate indicating a position of a point of the first projection plane is equal to the sum of (a) a first constant multiplied by the angle indicating a position of a point of the second projection plane and (b) a second constant.

A non-transitory computer-readable medium storing a program which, when executed by a computer comprising a processor and a memory, causes the computer to perform an image processing method of generating a display image to be displayed in a display system including a display area, the method comprising:

• obtaining one input image acquired through shooting by one image capturing apparatus;
• and
• generating the display image from the input image on the basis of a correspondence between a first projection plane corresponding to the input image and a second projection plane corresponding to the display area,
• wherein information indicating the correspondence is held in a holding unit,
• wherein the correspondence is a correspondence calculated in accordance with a shooting field angle at which the input image has been captured and a view angle with which the display image is displayed in the display area with respect to a point-of-view position,
• wherein the first projection plane has a size that is based on the shooting field angle,
• wherein the second projection plane has a size that is based on the view angle,
• wherein the correspondence is a relationship that is based on a ratio of a length of the first projection plane in a horizontal direction to a length of the second projection plane in the horizontal direction,
• wherein the correspondence is a relationship in which positions at a predetermined interval on the first projection plane arc associated with corresponding positions on the second projection plane such that the corresponding positions are equally spaced,
• wherein the first projection plane is a flat plane,
• wherein the second projection plane is a plane formed by curving a flat plane in a horizontal direction, and
• wherein the correspondence has a linearity relationship between a coordinate indicating a position of a point on the first projection plane and an angle indicating a position of a point on the second projection plane such that the coordinate indicating a position of a point of the first projection plane is equal to the sum of (a) a first constant multiplied by the angle indicating a position of a point of the second projection plane and (b) a second constant.

An image processing method of generating a display image to be displayed in a display system including a display area, the method comprising:

• obtaining one input image acquired through shooting by one image capturing apparatus;
• and
• generating the display image from the input image on the basis of a correspondence between a first projection plane corresponding to the input image and a second projection plane corresponding to the display area,
• wherein information indicating the correspondence is held in a holding unit,
• wherein the correspondence is a correspondence calculated in accordance with a shooting field angle at which the input image has been captured and a view angle with which the display image is displayed in the display area with respect to a point-of-view position,
• wherein the first projection plane has a size that is based on the shooting field angle,
• wherein the second projection plane has a size that is based on the view angle,
• wherein the correspondence is a relationship that is based on a ratio of a length of the first projection plane in a horizontal direction to a length of the second projection plane in the horizontal direction,
• wherein the correspondence is a relationship in which positions at a predetermined interval on the first projection plane are associated with corresponding positions on the second projection plane such that the corresponding positions are equally spaced,
• wherein the first projection plane is a flat plane,
• wherein the second projection plane is a plane formed by curving a flat plane in a horizontal direction, and
• wherein the correspondence has a linearity relationship between a coordinate indicating a position of a point on the first projection plane and an angle indicating a position of a point on the second projection plane such that the coordinate indicating a position of a point of the first projection plane is equal to the sum of (a) a first constant multiplied by the angle indicating a position of a point of the second projection plane and (b) a second constant.