Multi-viewpoint image processing method and apparatus

An image processing apparatus comprising:

• multi-viewpoint image input means for inputting images obtained from a plurality of viewpoint positions arranged on different straight lines;
• storing means for storing images input in said multi-viewpoint image input means;
• detection means for detecting a viewpoint position and a view direction of the user;
• and
• image generating means for generating a virtual image viewed from the detected viewpoint, the virtual image being generated on the basis of images adaptively selected from the image stored in said storing means, the detected viewpoint position and the direction detected in the detection step.

An image generating apparatus comprising:

• a storage device which stores a plurality of images picked up at a plurality of viewpoint positions;
• an input device which inputs an imaginary viewpoint position;
• and
• an image generating device which generates an image viewed from the imaginary viewpoint position of the basis of images adaptively selected from the plurality of images stored in said storage device according to the imaginary viewpoint position and a viewing direction from the imaginary viewpoint position.

An image generating method comprising:

• the storing step of storing a plurality of images picked up at a plurality of viewpoint positions;
• the input step of inputting an imaginary viewpoint position;
• and
• the image generating step of generating an image viewed from the imaginary viewpoint position on the basis of images adaptively selected from the plurality of images stored in said storage device according to the imaginary viewpoint position and a viewing direction from the imaginary viewpoint position.