Head mounted display device, method of controlling head mounted display device, system, synchronous control apparatus, and method of controlling synchronous control apparatus

A system comprising a head mounted display device including a first image capturing unit and a second image capturing unit different from the first image capturing unit, and an image processing apparatus,

• the head mounted display device including:
• a first generation unit configured to generate, based on a signal representing an image output timing of the first image capturing unit, a first signal for controlling a start of exposure of the second image capturing unit, and supply the generated first signal to the second image capturing unit;
• and
• a second generation unit configured to generate, based on the signal representing the image output timing of the first image capturing unit, a second signal for controlling a start of measurement of a sensor that measures a position and orientation of the sensor, and supply the generated second signal to the sensor, and
• the image processing apparatus including:
• an obtaining unit configured to obtain, from the head mounted display device, an image captured by the first image capturing unit, an image captured by the second image capturing unit in response to reception of the first signal, and a position and orientation measured by the sensor in response to reception of the second signal:
• a unit configured to generate an image of a virtual space based on the image captured by the second image capturing unit and the position and orientation measured by the sensor, and generate a composite image of the generated image of the virtual space and the image captured by the first image capturing unit;
• and
• a unit configured to output the composite image to the head mounted display device.

A synchronous control apparatus comprising:

• an image capturing unit;
• a sensor configured to measure a position and orientation of the sensor;
• an obtaining unit configured to obtain a signal out of an external sync input signal externally input to control the image capturing unit, and a sync output signal output from the image capturing unit;
• and
• a control unit configured to control to execute measurement processing of the sensor at an arbitrary timing in an exposure time in the image capturing unit based on the signal obtained by the obtaining unit.

A method of controlling a synchronous control apparatus including:

• an image capturing unit;
• and
• a sensor configured to measure a position and orientation of the sensor, the method comprising:
• obtaining a signal out of an external sync input signal externally input to control the image capturing unit, and a sync output signal output from the image capturing unit;
• and
• controlling to execute measurement processing of the sensor at an arbitrary timing in an exposure time in the image capturing unit based on the obtained signal.