External imaging system, external imaging method, external imaging program

An external imaging method in which an external video is captured by an external imaging system including a head mounted display to which an external imaging camera for imaging the outside is detachably connected and a gaze detection device, the external imaging method comprising:

• a displaying step of displaying an image based on a video captured by the external imaging camera on a display unit;
• an irradiating step in which the head mounted display irradiates an eye of a user with invisible light;
• an imaging step in which the head mounted display captures an image including the eye of the user being irradiated with the invisible light on the basis of the invisible light;
• a first transmitting step of transmitting a captured image captured by the head mounted display and capturing time information indicating a capturing time at which the captured image is captured to the gaze detection device;
• a first receiving step in which the gaze detection device receives the captured image and the capturing time information;
• a gaze detecting step in which the gaze detection device analyzes the captured image to detect a gaze direction of the user;
• a second transmitting step in which the gaze detection device transmits information on the detected gaze direction to the head mounted display in association with the capturing time of the captured image used in detecting the gaze direction;
• and
• a controlling step in which the head mounted display performs control of imaging by the external imaging camera on the basis of information on a plurality of gaze directions and a gaze time of the user calculated from the capturing time associated with the gaze direction.

An external imaging program for capturing an external video by a head mounted display in an external imaging system including the head mounted display to which an external imaging camera for imaging the outside is detachably connected and a gaze detection device, wherein the external imaging program allows a computer to execute

• a displaying function of displaying an image based on a video captured by the external imaging camera on a display unit;
• an irradiating function in which the head mounted display irradiates an eye of a user with invisible light;
• an imaging function of imaging an image including the eye of the user being irradiated with the invisible light on the basis of the invisible light;
• a transmitting function of transmitting the captured image and capturing time information indicating a capturing time at which the captured image is captured to the gaze detection device;
• a receiving function of receiving, from the gaze detection device, information on gaze directions detected by the gaze detection device on the basis of the captured image and the capturing time at which the image used in the detection is captured;
• and
• a controlling function of performing control of imaging by the external imaging camera on the basis of information on a plurality of gaze directions and a gaze time of the user calculated from the capturing time associated with the gaze direction.