Head mount display device providing eye gaze calibration and control method thereof

An eye gaze calibration method of an HMD device comprising:

• sensing an image of surroundings located in front of the HMD device using a camera unit;
• detecting a reference object from the sensed image of the surroundings using an image processing unit;
• detecting an eye gaze direction in which a user gazes at the detected reference object using an eye gaze detection unit;
• and
• performing eye gaze calibration based on the detected reference object and the detected eye gaze direction using a controller,
• wherein the step of detecting the reference object comprises:
• detecting at least one object contained in the sensed image of the surroundings as a first object;
• detecting a hand of the user contained in the sensed image of the surroundings as a second object;
• detecting an event of the second object with respect to the first object;
• and
• deciding the first object, on which the event has been detected, as the reference object.

An eye gaze calibration method of an HMD device comprising:

• sensing an image of surroundings located in front of the HMD device using a camera unit;
• detecting a reference object from the sensed image of the surroundings using an image processing unit;
• detecting an eye gaze direction in which a user gazes at the detected reference object using an eye gaze detection unit;
• and
• performing eye gaze calibration based on the detected reference object and the detected eye gaze direction using a controller,
• wherein the step of detecting the reference object comprises:
• detecting a hand of the user contained in the sensed image of the surroundings as a first object;
• detecting at least one object contained in the sensed image of the surroundings as a second object;
• detecting an event of the first object with respect to the second object;
• and
• deciding the second object, on which the event has been detected, as the reference object.

An HMD device comprising:

• a camera unit configured to sense an image of surroundings located in front of the HMD device;
• an image processing unit configured to detect a reference object from the sensed image of the surroundings;
• an eye gaze detection unit configured to detect an eye gaze direction in which a user gazes at the detected reference object;
• and
• a controller configured to perform eye gaze calibration based on the detected reference object and the detected eye gaze direction,
• wherein the image processing unit is configured to
• detect a hand of the user contained in the sensed image of the surroundings,
• detect a gesture performed by the hand of the user, and
• decide the detected hand of the user together with the gesture as the reference object.