Mixed reality presentation apparatus and control method thereof

A mixed reality presentation apparatus for presenting a mixed reality to an observer by superimposing a virtual space image including a virtual object image on a real space image visually identified by said observer and presenting the virtual space image to the observer, comprising:

• real space image capturing means for capturing a real space image;
• detecting means for detecting viewpoint information of said observer;
• virtual image generating means for generating a virtual space image based on the viewpoint information;
• and
• superimposing means for superimposing the virtual space image on the real space image,
• wherein said virtual image generating means includes;
• region determination means for determining a boundary box region that surrounds virtual text information generated as the virtual space image;
• tone detection means for detecting a tone within the boundary box region in the real space image;
• calculating means for calculating a calculated tone having some difference from the tone of the boundary box region;
• and
• drawing means for drawing the virtual text information using the calculated tone, and
• wherein said apparatus further comprises setting means for setting whether the calculated tone is to be used for drawing the virtual text information or not in an initialization setting of said apparatus.

A mixed reality presentation apparatus for presenting a mixed reality to an observer by superimposing a virtual space image including a virtual object image on a real space image visually identified by the observer and presenting the virtual space image to the observer, comprising:

• real space image capturing means for capturing a real space image;
• detecting means for detecting viewpoint information of the observer;
• virtual image generating means for generating a virtual space image based on the viewpoint information, wherein said virtual image generating means includes tone detection means for detecting a tone within a predetermined region in the real space image and tone determination means for determining a tone of the virtual space image based on the detected tone;
• superimposing means for superimposing the virtual space image on the real space image;
• and
• display location changing means for changing the display location of the virtual object image when the difference between a predetermined tone for the virtual object image and the tone determined by said tone determination means is more than a predetermined value, and for supplying the predetermined tone as the determination result from said tone determination means to said virtual space image generation means if the difference between the tone determined by said tone determination means and the predetermined tone is equal to or less than the predetermined value at the changed display location.

A control method of a mixed reality presentation apparatus for presenting a mixed reality to an observer by superimposing a virtual space image including a virtual object image on a real space image visually identified by the observer and presenting the virtual space image to the observer, comprising:

• a real space image capturing step of capturing a real space image;
• a detecting step of detecting viewpoint information of the observer;
• a virtual image generating step of generating a virtual space image based on the viewpoint information;
• and
• a superimposing step of superimposing the virtual space image on the real space image,
• wherein said virtual image generating step includes:
• a region determination step of determining a boundary box region that surrounds virtual text information generated as the virtual space image;
• a tone detection step of detecting an average tone within the boundary box region in the real space image;
• a calculating step of calculating the complementary color of the average tone as a calculated tone;
• and
• a drawing step of drawing the virtual text information using the calculated tone.

A control method of a mixed reality presentation apparatus for presenting a mixed reality to an observer by superimposing a virtual space image including a virtual object image on a real space image visually identified by the observer and presenting the virtual space image to the observer, comprising:

• a real space image capturing step of capturing a real space image;
• a detecting step of detecting viewpoint information of the observer;
• a virtual image generating step of generating a virtual space image based on the viewpoint information, wherein said virtual image generating step includes a tone detection step of detecting a tone within a predetermined region in the real space image and a tone determination step of determining a tone of the virtual space image based on the detected tone;
• a superimposing step of superimposing the virtual space image on the real space image;
• and
• a display location changing step of changing the display location of the virtual object image when the difference between a predetermined tone for the virtual object image and the tone determined by said tone determination step is more than a predetermined value, and for supplying the predetermined tone as the determination result from said tone determination step to said virtual space image generation step if the difference between the tone determined by said tone determination step and the predetermined tone is equal to or less than the predetermined value at the changed display location.

A computer-readable storage medium storing a control program of a mixed reality presentation apparatus for presenting a mixed reality to an observer by superimposing a virtual space image including a virtual object image on a real space image visually identified by the observer and presenting the virtual space image to the observer, said program comprising:

• a real space image capturing process program for capturing a real space image;
• a detecting process program for detecting viewpoint information of the observer;
• a virtual image generating process program for generating a virtual space image based on the viewpoint information;
• and
• a superimposing process program for superimposing the virtual space image on the real space image,
• wherein said virtual image generating process program includes:
• a region determination process program for determining a boundary box region that surrounds virtual text information generated as the virtual space image;
• a tone detection process program for detecting an average tone within the boundary box region in the real space image;
• a calculating process program for calculating the complementary color of the average tone as a calculated tone;
• and
• a drawing process program for drawing the virtual text information using the calculated tone.

A computer-readable storage medium storing a control program of a mixed reality presentation apparatus for presenting a mixed reality to an observer by superimposing a virtual space image including a virtual object image on a real space image visually identified by the observer and presenting the virtual space image to the observer, said program comprising:

• a real space image capturing process program for capturing a real space image;
• a detecting process program for detecting viewpoint information of the observer;
• a virtual image generating process program for generating a virtual space image based on the viewpoint information wherein said virtual image generating process program includes a tone detection process program for detecting a tone within a predetermined region in the real space image and a tone determination process program for determining a tone of the virtual space image based on the detected tone;
• a superimposing process program for superimposing the virtual space image on the real space image;
• and
• a display location changing process program for changing the display location of the virtual object image when the difference between a predetermined tone for the virtual object image and the tone determined by the tone determination process program is more than a predetermined value and for supplying said predetermined tone as the determination result from said tone determination process program to said virtual space image generation process program if the difference between the tone determined by said tone determination process program and the predetermined tone is equal to or less than the predetermined value at the changed display location.

A control method of a mixed reality presentation apparatus for presenting a mixed reality to an observer by superimposing a virtual space image including a virtual object image on a real space image visually identified by the observer and presenting the virtual space image to said observer, comprising:

• a real space image capturing step of capturing a real space image;
• a detecting step of detecting viewpoint information of said observer;
• a virtual image generating step of generating a virtual space image based on the viewpoint information;
• and
• a superimposing step of superimposing the virtual space image on the real space image,
• wherein said virtual image generating step includes;
• a region determination step of determining a boundary box region that surrounds virtual text information generated as the virtual space image;
• a tone detection step of detecting a tone within the boundary box region in the real space image;
• a calculating step of calculating a calculated tone having some difference from the tone of the boundary box region;
• and
• a drawing step of drawing the virtual text information using the calculated tone, and
• wherein said control method further comprising a setting step of setting whether the calculated tone is to be used for drawing the virtual text information or not in an initialization setting of said apparatus.

A computer-readable storage medium storing a control program of a mixed reality presentation apparatus for presenting a mixed reality to an observer by superimposing a virtual space image including a virtual object image on a real space image visually identified by the observer and presenting the virtual space image to the observer, said program comprising:

• a real space image capturing process program for capturing a real space image;
• a detecting process program for detecting viewpoint information of the observer;
• a virtual image generating process program for generating a virtual space image on the real space image,
• wherein said virtual image generating process program includes:
• a region determination process program for determining a boundary box region that surrounds virtual text information generated as the virtual space image;
• a tone detection process program for detecting a tone within the boundary box region in the real space image;
• a calculating process program for calculating a calculated tone with some difference from the tone of the boundary box region;
• and
• a drawing process program for drawing the virtual text information using the calculated tone, and
• wherein said program further comprising a setting process program for setting whether the calculated tone is to be used for drawing the virtual text information or not in an initialization setting of said apparatus.