Head-mount type display device, control system, method of controlling head-mount type display device, and computer program

A method of controlling a head-mounted display device including a display configured to display virtual imagery, and at least one of:

• capable of transmitting an external sight through the display, and capable of transmitting the external sight via video transmission, the method comprising:
• controlling a camera to acquire images, and while the camera is acquiring images:
• detecting, by image processing, whether or not the acquired images include image data that is the same as image data of an operation object stored in a memory;
• and
• when the acquired images include image data that is the same as the image data of the stored operation object:
• determining whether the operation object is located within a predetermined distance range from the display, and
• if the operation object is located within the predetermined distance range:
• controlling the display to display a virtual image associated with the operation object;
• detecting, by image processing, a gesture associated with the operation object;
• and
• when the gesture associated with the operation object has been detected, controlling the display to display a predetermined image associated with the operation object.

A non-transitory computer readable medium storing computer-executable program instructions used with a head-mounted display device including a display configured to display virtual imagery and at least one of:

• capable of transmitting an external sight through the display, and capable of transmitting the external sight via video transmission, the computer-executable program instructions, when executed by at least one processor of the head-mounted display device, cause the at least one processor to:
• control a camera to acquire images, and while the camera is acquiring images:
• detect, by image processing, whether or not the acquired images include image data that is the same as image data of an operation object stored in a memory;
• and
• when the acquired images include image data that is the same as the image data of the stored operation object:
• determine whether the operation object is located within a predetermined distance range from the display, and
• if the operation object is located within the predetermined distance range:
• control the display to display a virtual image associated with the operation object;
• detect, by image processing, a gesture associated with the operation object;
• and
• when the gesture associated with the operation object has been detected, control the display to display a predetermined image associated with the operation object.

A head-mount type display device comprising:

• a display configured to display virtual imagery, and at least one of:
• capable of transmitting an external sight through the display, and capable of transmitting the external sight via video transmission;
• and
• at least one processor or circuit configured to:
• control a camera to acquire images, and while the camera is acquiring images:
• detect, by image processing, whether or not the acquired images include image data that is the same as image data of two or more operation objects stored in a memory;
• and
• when the acquired images include image data that is the same as the image data of the two or more stored operation objects:
• control the display to display a virtual image associated with the two or more operation objects;
• detect, by image processing, a gesture associated with at least one of the at least two operation objects;
• and
• when the gesture associated with the at least one operation object has been detected, control the display to display a predetermined image associated with the at least one operation object.

A method of controlling a head-mounted display device including a display configured to display virtual imagery, and at least one of:

• capable of transmitting an external sight through the display, and capable of transmitting the external sight via video transmission, the method comprising:
• controlling a camera to acquire images, and while the camera is acquiring images:
• detecting, by image processing, whether or not the acquired images include image data that is the same as image data of two or more operation objects stored in a memory;
• and
• when the acquired images include image data that is the same as the image data of the two or more stored operation objects:
• controlling the display to display a virtual image associated with the two or more operation objects;
• detecting, by image processing, a gesture associated with at least one of the at least two operation objects;
• and
• when the gesture associated with the at least one operation object has been detected, controlling the display to display a predetermined image associated with the at least one operation object.

A non-transitory computer readable medium storing computer-executable program instructions used with a head-mounted display device including a display configured to display virtual imagery and at least one of:

• capable of transmitting an external sight through the display, and capable of transmitting the external sight via video transmission, the computer-executable program instructions, when executed by at least one processor of the head-mounted display device, cause the at least one processor to:
• control a camera to acquire images, and while the camera is acquiring images:
• detect, by image processing, whether or not the acquired images include image data that is the same as image data of two or more operation objects stored in a memory;
• and
• when the acquired images include image data that is the same as the image data of the two or more stored operation objects:
• control the display to display a virtual image associated with the two or more operation objects;
• detect, by image processing, a gesture associated with at least one of the at least two operation objects;
• and
• when the gesture associated with the at least one operation object has been detected, control the display to display a predetermined image associated with the at least one operation object.