Remote work supporting system, remote work supporting method, and program

A remote work supporting method for screen-sharing an image photographed by a wearable terminal between the wearable terminal and a remote terminal in order to support remote work, comprising:

• an image acquiring step of acquiring an image photographed by the wearable terminal;
• a screen sharing step of screen-sharing the image between the wearable terminal and the remote terminal;
• an accepting step of accepting an input of instruction information for the image from the remote terminal;
• a first display step of superimposing and displaying the image and a virtual object corresponding to the instruction information on the wearable terminal;
• a second display step of superimposing and displaying the image and the virtual object on the remote terminal,
• an image recognizing step of analyzing the image to recognize a state of a finger;
• a changing step of, when a movement of the finger moving from a position having a predetermined relationship with the virtual object is recognized, changing a display of the virtual object by the first display step and the second display step to move the virtual object in accordance with the recognized movement;
• a response generating step of generating response information that is predetermined for a moving direction of the virtual object, and
• a third display step of displaying the generated response information on the remote terminal.

A program for screen-sharing an image photographed by a wearable terminal between the wearable terminal and a remote terminal in order to support remote work, the program causing a computer to execute:

• an image acquiring step of acquiring an image photographed by the wearable terminal;
• a screen sharing step of screen-sharing the image between the wearable terminal and the remote terminal;
• an accepting step of accepting an input of instruction information for the image from the remote terminal;
• a first display step of superimposing and displaying the image and a virtual object corresponding to the instruction information on the wearable terminal;
• a second display step of superimposing and displaying the image and the virtual object on the remote terminal,
• an image recognizing step of analyzing the image to recognize a state of a finger;
• a changing step of, when a movement of the finger moving from a position having a predetermined relationship with the virtual object is recognized, changing a display of the virtual object by the first display step and the second display step to move the virtual object in accordance with the recognized movement;
• a response generating step of generating response information that is predetermined for a moving direction of the virtual object, and
• a third display step of displaying the generated response information on the remote terminal.

A remote work supporting system for sharing images photographed by a plurality of wearable terminals being respectively used by a plurality of users between each of the wearable terminals and a remote terminal in order to support remote work, comprising:

• an image acquiring unit that acquires an image photographed by each of the wearable terminals;
• a screen sharing unit that screen-shares the image between each of the wearable terminals and the remote terminal;
• an accepting unit that accepts an input of instruction information for the image from the remote terminal;
• a first display unit that is provided for each of the wearable terminals, and superimposes and displays the image and a virtual object corresponding to the instruction information on each of the wearable terminals;
• a second display unit that superimposes and displays the image and the virtual object on the remote terminal;
• an image recognizing unit that analyzes the image to recognize a state of a body part;
• a changing unit that changes a display of the virtual object by the first display unit and the second display unit based on the recognized state;
• and
• a response generating unit that generates a plurality of pieces of response information for the plurality of users respectively, based on the state recognized by the image recognizing unit and the display of the virtual object,
• wherein the second display unit displays the plurality of pieces of response information in different display formats.

A remote work supporting method for sharing images photographed by a plurality of wearable terminals being respectively used by a plurality of users between each of the wearable terminals and a remote terminal in order to support remote work, comprising:

• an image acquiring step of acquiring an image photographed by each of the wearable terminals;
• a screen sharing step of screen-sharing the image between each of the wearable terminals and the remote terminal;
• an accepting step of accepting an input of instruction information for the image from the remote terminal;
• a first display step of superimposing and displaying the image and a virtual object corresponding to the instruction information on each of the wearable terminals;
• a second display step of superimposing and displaying the image and the virtual object on the remote terminal;
• an image recognizing step of analyzing the image to recognize a state of a body part;
• a changing step of changing a display of the virtual object by the first display step and the second display step based on the recognized state;
• a response generating step of generating a plurality of pieces of response information for the plurality of users respectively, based on the recognized state and the display of the virtual object;
• and
• a third display step of displaying on the remoter terminal the plurality of pieces of response information in different display formats.

A program for sharing images photographed by a plurality of wearable terminals being respectively used by a plurality of users between each of the wearable terminals and a remote terminal in order to support remote work, the program causing a computer to execute:

• an image acquiring step of acquiring an image photographed by each of the wearable terminals;
• a screen sharing step of screen-sharing the image between each of the wearable terminals and the remote terminal;
• an accepting step of accepting an input of instruction information for the image from the remote terminal;
• a first display step of superimposing and displaying the image and a virtual object corresponding to the instruction information on each of the wearable terminals;
• a second display step of superimposing and displaying the image and the virtual object on the remote terminal;
• an image recognizing step of analyzing the image to recognize a state of a body part;
• a changing step of changing a display of the virtual object by the first display step and the second display step based on the recognized state;
• a response generating step of generating a plurality of pieces of response information for the plurality of users respectively, based on the recognized state and the display of the virtual object;
• and
• a third display step of displaying on the remoter terminal the plurality of pieces of response information in different display formats.