Operation support system, wearable apparatus, image pickup apparatus, and operation support method

A wearable apparatus comprising:

• a first image pickup device configured to acquire first image data during an operation with operation information corresponding to the direction of an eye line of an operator;
• a communication unit configured to:
• acquire second image data from a second image pickup device with ambient information relating to the operation, the second image pickup device provided at a different position from a position of the operator;
• and
• communicate with a database configured to store operation information corresponding to a predetermined operation and to associate the first image data with the second image data;
• and
• an operation judgment circuit configured to judge whether the operation is correctly performed by comparing the first image data and the second image data with the operation information stored in the database.

An image pickup apparatus comprising:

• a receiver configured to:
• receive first information from a wearable image pickup device configured to acquire first image data during an operation with operation information corresponding to a direction of an eye line of an operator during an operation;
• receive second information from an auxiliary image pickup device configured to acquire second image data with ambient information relating to the operation, the auxiliary image pickup device provided at a different position from the direction of the eye line of the operator;
• and
• a database storing defined operation information about a predetermined operation in advance and to associate the first information with the second image information;
• and
• an operation judgment circuit configured to compare the first information and the second information with the defined operation information in the database to determine whether the predetermined operation was correctly performed.

An operation support method comprising:

• acquiring first image data during an operation with operation information corresponding to the direction of an eye line of an operator;
• acquiring second image data serving as operation information with ambient information relating to the operation acquired at a different position from the first image data;
• communicating the acquired first image data and second image data to a control circuit in communication with a database, the database storing defined operation information including image information from a plurality of visual fields relating to a predetermined operation in advance;
• and
• judging whether the operation is correctly performed by comparing the first image data and the second image data with the defined operation information stored in the database.

An operation support system comprising:

• a wearable terminal device configured to acquire movie data associated with an operation in an image pickup range substantially equivalent to a field of view of an operator and worn by the operator;
• an auxiliary camera configured to acquire still image data associated with the operation in a predetermined image pickup range including a predetermined object from a different direction from a direction of the wearable terminal device;
• a control circuit in communication with the wearable terminal device, the auxiliary camera, and a database, the control circuit configured to control the wearable terminal device and the auxiliary camera in cooperation with each other while acquiring predetermined operation information at a time when the operation is performed from the movie data and information on an ambient environment from the still image data;
• and
• the database is configured to store operation information corresponding to a predetermined operation and to associate the predetermined operation information obtained from the movie data with the information on the ambient environment obtained from the still image data,
• wherein the auxiliary camera is controlled, based on the movie data acquired by the wearable terminal device, to acquire still image data serving as evidence of an operation, and
• the control circuit compares the predetermined operation information obtained from the movie data and the information on the ambient environment obtained from the still image data with the operation information stored in the database, and judges whether the operation is correctly performed.

An operation support method comprising:

• acquiring movie data associated with an operation in an image pickup range substantially equivalent to a field of view of an operator;
• acquiring still image data associated with the operation in a predetermined image pickup range including a predetermined object according to the acquired movie data from a different direction from a direction of the movie data as evidence of an operation;
• communicating the acquired movie data and the acquired image data to a control circuit in communication with a database storing defined operation information;
• associating the movie data with the still image data;
• and
• judging whether the predetermined operation was correctly performed by comparing the movie data and the image data with the defined operation information stored in the database.