Mixed reality presentation system

A display device which is connected with an image processing apparatus comprising:

• an acquisition unit configured to acquire position and orientation information indicating a position and orientation of the display device;
• a transmission unit configured to transmit the acquired position and orientation information to said image processing apparatus;
• a reception unit configured to receive, from said the image processing apparatus, a virtual object which is generated by using a first position and orientation, wherein the first position and orientation is different from the position and orientation indicated by the acquired position and orientation information and is obtained based on the acquired position and orientation information;
• and
• a display unit configured to display the virtual object which is transmitted from said image processing apparatus.

An image processing apparatus which is connected with a display device comprising:

• an obtaining unit configured to obtain position and orientation information of the display device;
• a generation unit configured to generate a virtual object by using a first position and orientation of said display device, wherein the first position and orientation is different from a position and orientation indicated by the obtained position and orientation information and is obtained based on the obtained position and orientation information;
• and
• a transmission unit configured to transmit the generated virtual object to said display device.

A method of controlling a system, the system including a display device having a display unit configured to display an image and an image processing apparatus configured to generate an image to be displayed on the display unit, wherein

• said display device performs steps comprising:
• a display step of displaying a virtual object which is transmitted from said image processing apparatus;
• an acquisition step of acquiring position and orientation information indicating a position and orientation of the display device;
• and
• a first transmission step of transmitting the acquired position and orientation information to said image processing apparatus, and
• said image processing apparatus performs steps comprising:
• a reception step of receiving the position and orientation information transmitted by said first transmission step;
• a generation step of generating the virtual object by using a first position and orientation which is obtained based on the received position and orientation information;
• and
• a second transmission step of transmitting the virtual object generated by said generation step to said display device.

A method of controlling a display device which is connected with an image processing apparatus, the method comprising:

• an acquisition step of acquiring position and orientation information indicating a position and orientation of the display device;
• a transmission step of transmitting the acquired position and orientation information to said image processing apparatus;
• a reception step of receiving, from said the image processing apparatus, a virtual object which is generated by using a first position and orientation,
• wherein the first position and orientation is different from the position and orientation indicated by the acquired position and orientation information and is obtained based on the acquired position and orientation information;
• and
• a display step of displaying the virtual object which is transmitted from said image processing apparatus.

A method of controlling an image processing apparatus which is connected with a display device, the method comprising:

• an obtaining step of obtaining position and orientation information of the display device;
• a generation step of generating a virtual object by using a first position and orientation of said display device,
• wherein the first position and orientation is different from a position and orientation indicated by the obtained position and orientation information and is obtained based on the obtained position and orientation information;
• and
• a transmission step of transmitting the generated virtual object to said display device.