Gaze detection system, gaze point detection method, and gaze point detection program

A gaze detection system comprising:

• a head mounted display, mounted on a user's head for use, comprising,
• a first infrared light source unit illuminating a user's right eye with infrared light;
• a second infrared light source unit illuminating a user's left eye with infrared light;
• a first image capturing device imaging the right eye illuminated by the infrared light;
• a second image capturing device imaging the left eye illuminated by the infrared light;
• and
• a display unit displaying a three-dimensional image, and
• a gaze detection device detecting a gaze of the user comprising,
• a first detection unit detecting a gaze direction of the right eye based on the image captured by the first image capturing device;
• a second detection unit detecting a gaze direction of the left eye based on the image captured by the second image capturing device;
• and
• a tracking unit that determines a gaze point of the user in the three-dimensional image on the basis of the gaze direction of the right eye and the gaze direction of the left eye,
• in which the first detection unit calculates the right eye gaze vector indicating the gaze direction of the right eye, and the second detection unit calculates the left eye gaze vector indicating the gaze direction of the left eye,
• wherein the display unit displays a three-dimensional image consisting of a plurality of layers in a depth direction, and the tracking unit identifies the layer that the user is gazing at by selecting the layer having a shortest distance between intersection points of the right eye gaze vector and the left eye gaze vector with each layer.

A method of determining a gaze point of a user in a gaze detection system comprising a head mounted display worn on the head of the user and a gaze detection device determining the gaze point of the user, comprising:

• displaying a three-dimensional image on the head mounted display;
• illuminating a user's right eye and left eye with infrared light from an infrared light source;
• acquiring images of the user's right eye and left eye illuminated by the infrared light;
• transferring an acquired image data to the gaze detection device;
• determining in the gaze detection device the user's right eye gaze direction vector showing the gaze direction of the user's right eye based on the acquired image of the right eye;
• determining in the gaze detection device the user's left eye gaze direction vector showing the gaze direction of the user's left eye based on the acquired image of the left eye;
• and
• determining a location that the user is gazing at in the three-dimensional image based on the right eye gaze direction and the left eye gaze direction,
• in which the head mounted display displays a three-dimensional image consisting of a plurality of layers in the depth direction, wherein
• the detection device identifies a layer the user is gazing at by selecting the layer having a shortest distance between the intersection points of the right eye gaze vector and the left eye gaze vector with each layer.

A gaze detection program executing on a computer that determines a gaze point of a user wearing a head mounted display that displays a three-dimensional image, wherein the computer comprises:

• a function of obtaining the image data, acquired under infrared light illumination, of a right eye and a left eye of the user wearing the head mounted display;
• a function of detecting a right eye gaze direction of the right eye based on the image data of the right eye;
• a function of detecting a left eye gaze direction of the left eye based on the image data of the left eye;
• a function of determining a gaze point of the user in the three-dimensional image based on the right eye gaze direction and the left eye gaze direction;
• a function of calculating a right eye gaze vector indicating the gaze direction of the right eye;
• a function of calculating a left eye gaze vector indicating the gaze direction of the left eye;
• and
• a function of displaying a three-dimensional image consisting of a plurality of layers in a depth direction, wherein
• the function of detecting the gaze direction identifies the layer that the user is gazing at by selecting the layer having a shortest distance between intersection points of the right eye gaze vector and the left eye gaze vector with each layer.