Storage medium having stored therein stereoscopic image display program, stereoscopic image display device, stereoscopic image display system, and stereoscopic image display method

A stereoscopic image display device for displaying an image on a stereoscopic display device capable of producing stereoscopic display using two images, comprising:

• processing circuitry for obtaining two captured images of a predetermined image-capture object in a real space captured respectively by two image-capturing devices;
• calculating respective positional relationships between the predetermined image-capture object and each of the image-capturing devices based on the two captured images;
• determining a zero-parallax distance using at least one of the positional relationships, wherein the zero-parallax distance corresponds to a distance, in a virtual space image-capturing direction, from at least one of two virtual cameras to a point in a virtual space that appears to be present at a position of a screen of the stereoscopic display device in stereoscopic display or a distance, in a real space image-capturing direction, from the image-capturing device associated with the used positional relationship to a point in the real space that appears to be present at the position of the screen of the stereoscopic display device in stereoscopic display;
• determining respective display positions of the two captured images to be displayed on the stereoscopic display device so that a display object present at a position in accordance with the zero-parallax distance appears to be present at the position of the screen of the stereoscopic display device in stereoscopic display;
• setting each of the two virtual cameras for producing a respective virtual image representing an object in the virtual space by using a corresponding one of the positional relationships so that a range of the virtual space represented by the respective virtual image and a range of the real space represented by the corresponding captured image coincide with each other, and producing two virtual images based on the two virtual cameras which have been set;
• and performing, for each captured image, a process of producing a synthesized image for display on the stereoscopic display device, each synthesized image obtained by synthesizing one of the virtual images with the corresponding captured image.

A stereoscopic image display system for displaying an image on a stereoscopic display device capable of producing stereoscopic display using two images, comprising:

• a predetermined image-capture object in a real space;
• processing circuitry for obtaining two captured images of the predetermined image-capture object captured respectively by two image capturing devices;
• calculating respective positional relationships between the predetermined image-capture object and each of the image-capturing devices based on the two captured images;
• determining a zero-parallax distance using at least one of the positional relationships, wherein the zero-parallax distance corresponds to a distance, in a virtual space image-capturing direction, from at least one of two virtual cameras to a point in a virtual space that appears to be present at a position of a screen of the stereoscopic display device in stereoscopic display or a distance, in a real space image-capturing direction, from the image-capturing device associated with the used positional relationship to a point in the real space that appears to be present at the position of the screen of the stereoscopic display device in stereoscopic display;
• determining respective display positions of the two captured images to be displayed on the stereoscopic display device so that a display object present at a position in accordance with the zero-parallax distance appears to be present at the position of the screen of the stereoscopic display device in stereoscopic display;
• setting each of the two virtual cameras for producing a respective virtual image representing an object in the virtual space by using a corresponding one of the positional relationships so that a range of the virtual space represented by the respective virtual image and a range of the real space represented by a corresponding captured image coincide with each other, and producing two virtual images based on the two virtual cameras which have been set;
• and a performing, for each captured image, a process of producing a synthesized image for display on the stereoscopic display device, each synthesized image obtained by synthesizing one of the virtual images with the corresponding captured image.

A stereoscopic image display method for displaying an image on a stereoscopic display device capable of producing stereoscopic display using two images, comprising:

• obtaining two captured images of a predetermined image-capture object in a real space captured respectively by two image-capturing devices;
• calculating respective positional relationships between the predetermined image-capture object and each of the image-capturing devices based on the two captured images;
• determining a zero-parallax distance using at least one of the positional relationships, wherein the zero-parallax distance corresponds to a distance, in a virtual space image-capturing direction, from at least one of two virtual cameras to a point in a virtual space that appears to be present at a position of a screen of the stereoscopic display device in stereoscopic display or a distance, in a real space image-capturing direction, from the image-capturing device associated with the used positional relationship to a point in the real space that appears to be present at the position of the screen of the stereoscopic display device in stereoscopic display;
• determining respective display positions of the two captured images to be displayed on the stereoscopic display device so that a display object present at a position in accordance with the zero-parallax distance appears to be present at the position of the screen of the stereoscopic display device in stereoscopic display;
• setting each of the two virtual cameras for producing a respective virtual image representing an object in the virtual space by using a corresponding one of the positional relationships so that a range of the virtual space represented by the respective virtual image and a range of the real space represented by a corresponding captured image coincide with each other, and producing two virtual images based on the two virtual cameras which have been set;
• and
• performing, for each captured image, a process of producing a synthesized image for display on the stereoscopic display device, each synthesized image obtained by synthesizing one of the virtual images with the corresponding captured image.

A stereoscopic image display device comprising:

• spaced-apart left and right real cameras for capturing respective left and right real images of a marker positioned in a real space;
• a stereoscopic display;
• and
• processing circuitry comprising a processor, the processing circuitry being configured to at least:
• calculate respective positional relationships between the marker and each of the left and right real cameras based on the left and right real images;
• determine a zero-parallax distance using at least one of the positional relationships;
• determine respective display positions of the left and right real images to be displayed on the stereoscopic display so that a display object present at the zero-parallax distance appears to be present at a screen surface of the stereoscopic display;
• producing left and right virtual images, each representing an object in a virtual space, using left and right virtual cameras set using the positional relationships;
• and
• synthesizing the left virtual image and the left real image and synthesizing the right virtual image and the right real image to produce left and right images for display on the stereoscopic display.