Relay communication system and relay server

A first relay server configured to connect with a second relay server and a third relay server via a WAN and to connect with a first client terminal and a second client terminal via a LAN, the first relay server comprising:

• a first operation-performing session establishing unit configured to establish a first operation-performing session with the first client terminal;
• a second operation-performing session establishing unit configured to establish a second operation-performing session with the second relay server;
• an operation relay unit configured to relay operation data, including an operation event and image data, between the first operation-performing session and the second operation-performing session;
• a monitoring session establishing unit configured to establish a monitoring session with the second client terminal or the third relay server;
• and
• a monitoring control unit configured to duplicate the image data of the operation data relayed between the first operation-performing session and the second operation-performing session and relay the duplicated image data to the monitoring session.

A relay communication system, comprising:

• a first network;
• a second network;
• a first relay server connected to the first network;
• a second relay server connected to the second network, and configured to communicate with the first relay server via a third network;
• a first client terminal and a second client terminal connected to the first relay server via the first network;
• and
• a third client terminal connected to the second relay server via the second network;
• wherein
• each of the first relay server and the second relay server includes:
• an information sharing unit configured to mutually share relay server information that includes activation information regarding a local relay server, and activation information and connection information regarding any client terminals connected to the local relay server;
• the second relay server includes:
• a second operation control unit configured to, if a request to perform a first remote operation is received from the third client terminal, which is an operation-performing client terminal that performs a remote operation, the first remote operation request being a request to perform the remote operation on the first client terminal selected, referencing the relay server information and including information regarding the third client terminal and the first client terminal, and then to:
• specify the first relay server to which the first client terminal is connected,
• relay the first remote operation request to the first relay server,
• establish a first operation-performing session with the third client terminal, establish a second operation-performing session with the first relay server, and
• relay, between the first operation-performing session and the second operation-performing session, an operation event and image data, which serve as operation data of the first remote operation performed on the first client terminal by the third client terminal based on the first remote operation request;
• and
• the first relay server includes:
• a first operation control unit configured to, if the first remote operation request is received from the second relay server, and then to:
• relay the first remote operation request to the first client terminal,
• establish a third operation-performing session with the first client terminal,
• relay, between the second operation-performing session and the third operation-performing session, the operation data of the first remote operation performed based on the first remote operation request, and
• create first remote operation information, which includes information regarding the first client terminal and the third client terminal;
• and
• a monitoring control unit configured to, if the first remote operation is being performed and a monitoring request to monitor the first remote operation selected based on the first remote operation information is received from the second client terminal, and then to:
• establish, with the second client terminal, a monitoring session to monitor the first remote operation,
• duplicate the image data of the operation data relayed to the second relay server by the second operation-performing session, and
• transmit the duplicated image data to the second client terminal via the monitoring session.

A relay server defining a first relay server that is connected to a first network, that is configured to communicate with a second relay server connected to a second network, and that is connected to a first client terminal via the first network, the relay server comprising:

• an information sharing unit configured to mutually share with the second relay server relay server information which includes activation information regarding the relay server, and activation information and connection information of any client terminals connected to the relay server;
• an operation control unit configured to, if a request to perform a first remote operation is received from a third client terminal, which is connected to the second relay server and is an operation-performing client terminal that performs a remote operation, the first remote operation request being a request to perform a remote operation on the first client terminal selected, referencing the relay server information and including information regarding the third client terminal and the first client terminal, and then to:
• relay the first remote operation request to the first client terminal,
• establish a second operation-performing session with the second relay server,
• establish a third operation-performing session with the first client terminal,
• relay, between the second operation-performing session and the third operation session, an operation event and image data, which serve as operation data of the first remote operation performed on the first client terminal by the third client terminal based on the first remote operation request, via the second operation-performing session, the third operation-performing session, and a first operation-performing session established between the third client terminal and the second relay server, and
• create first remote operation information, which includes information regarding the first client terminal and the third client terminal;
• and
• a monitoring control unit configured to, if the first remote operation is being performed and a monitoring request to monitor the first remote operation selected based on the first remote operation information is received from a second client terminal, and then to:
• establish, with the second client terminal, a monitoring session to monitor the first remote operation,
• duplicate the image data of the operation data relayed to the second relay server by the second operation-performing session, and
• transmit the duplicated image data to the second client terminal via the monitoring session.

A relay communication system, comprising:

• a first network;
• a second network;
• a third network;
• a fourth network;
• a first relay server connected to the first network;
• a second relay server connected to the second network, and configured to communicate with the first relay server via the third network;
• a third relay server connected to the third network, and the first relay server, the second relay server, and the third relay server being connected to one another via a network;
• a first client terminal connected to the first relay server via the first network;
• a third client terminal connected to the second relay server via the second network;
• and
• a fifth client terminal connected to the third relay server via the fourth network;
• wherein
• each of the first relay server, the second relay server, and the third relay server includes:
• an information sharing unit configured to mutually share relay server information that includes activation information regarding a local relay server and activation information and connection information regarding any client terminals connected to the local relay server;
• the second relay server includes:
• a second operation control unit configured to, if a request to perform a first remote operation is received from the third client terminal, which is an operation-performing client terminal that performs a remote operation, the first remote operation request being a request to perform the remote operation on the first client terminal selected, referencing the relay server information and including information regarding the third client terminal and the first client terminal, and then to:
• specify the first relay server to which the first client terminal is connected,
• relay the first remote operation request to the first relay server,
• establish a first operation-performing session with the third client terminal,
• establish a second operation-performing session with the first relay server, and
• relay, between the first operation-performing session and the second operation-performing session, an operation event and image data, which serve as operation data of the first remote operation performed on the first client terminal by the third client terminal based on the first remote operation request;
• and
• the first relay server includes:
• a first operation control unit configured to, if the first remote operation request is received from the second relay server, and then to:
• relay the first remote operation request to the first client terminal,
• establish a third operation-performing session with the first client terminal,
• relay, between the second operation-performing session and the third operation-performing session, the operation data of the first remote operation performed based on the first remote operation request, and
• create first remote operation information, which includes information regarding the first client terminal and the third client terminal;
• and
• a monitoring control unit configured to, if the first remote operation is being performed and a monitoring request to monitor the first remote operation selected based on the first remote operation information is received from the fifth client terminal via the third relay server, and then to:
• establish, with the third relay server, a monitoring session to monitor the first remote operation,
• duplicate the image data of the operation data relayed to the second relay server by the second operation-performing session, and
• transmit the duplicated image data to the fifth client terminal via the monitoring session.

A first relay server configured to connect with a second relay server and a third relay server via a WAN and to connect with a first client terminal and a second client terminal via a LAN, the first relay server comprising:

• a first operation-performing session establishing unit configured to establish a first operation-performing session with the first client terminal;
• a second operation-performing session establishing unit configured to establish a second operation-performing session with the second relay server;
• a first operation relay unit configured to relay first operation data, including an operation event and image data, between the first operation-performing session and the second operation-performing session;
• a monitoring session establishing unit configured to establish a monitoring session with the second client terminal;
• a monitoring control unit configured to duplicate the image data of the first operation data relayed between the first operation-performing session and the second operation-performing session and relay the duplicated image data to the monitoring session;
• a third operation-performing session establishing unit configured to establish a third operation-performing session with the second client terminal that established the monitoring session;
• a fourth operation-performing session establishing unit configured to establish a fourth operation-performing session with the third relay server;
• and
• a second operation relay unit configured to relay second operation data between the third operation-performing session and the fourth operation-performing session.

A first relay server connected with a second relay server and a third relay server via a WAN and connected with a first client terminal and a second client terminal via a LAN, the first relay server comprising:

• a first operation-performing session establishing unit configured to establish a first operation-performing session with the first client terminal;
• a second operation-performing session establishing unit configured to establish a second operation-performing session with the second relay server;
• a first operation relay unit configured to relay first operation data, including an operation event and image data, between the first operation-performing session and the second operation-performing session;
• a monitoring session establishing unit configured to establish a monitoring session with the third relay server;
• a monitoring control unit configured to duplicate the image data of the first operation data relayed between the first operation-performing session and the second operation-performing session and relay the duplicated image data to the monitoring session;
• a third operation-performing session establishing unit configured to establish a third operation-performing session with the third relay server that established the monitoring session;
• a fourth operation-performing session establishing unit configured to establish a fourth operation-performing session with the second client terminal;
• and
• a second operation relay unit configured to relay second operation data between the third operation-performing session and the fourth operation-performing session.

A relay communication system, comprising:

• a first network;
• a second network;
• a first relay server connected to the first network;
• a second relay server connected to the second network, and configured to communicate with the first relay server via a third network;
• a first client terminal and a second client terminal connected to the first relay server via the first network;
• and
• a third client terminal and a fourth client terminal connected to the second relay server via the second network;
• wherein
• each of the first relay server and the second relay server includes:
• an information sharing unit configured to mutually share relay server information that includes activation information regarding a local relay server and activation information and connection information regarding any client terminals connected to the local relay server;
• the second relay server includes:
• a second operation control unit configured to, if a request to perform a first remote operation is received from the third client terminal, which is an operation-performing client terminal that performs a remote operation, the first remote operation request being a request to perform the remote operation on the first client terminal selected, referencing the relay server information and including information regarding the third client terminal and the first client terminal, then to:
• specify the first relay server to which the first client terminal is connected,
• relay the first remote operation request to the first relay server,
• establish a first operation-performing session with the third client terminal,
• establish a second operation-performing session with the first relay server, and
• relay, between the first operation-performing session and the second operation-performing session, an operation event and image data, which serve as operation data of the first remote operation performed on the first client terminal by the third client terminal based on the first remote operation request;
• and
• the first relay server includes:
• a first operation control unit configured to, if the first remote operation request is received from the second relay server, and then to:
• relay the first remote operation request to the first client terminal,
• establish a third operation-performing session with the first client terminal,
• relay, between the second operation-performing session and the third operation-performing session, the operation data of the first remote operation performed based on the first remote operation request, and
• create first remote operation information, which includes information regarding the first client terminal and the third client terminal;
• and
• a monitoring control unit configured to, if the first remote operation is being performed and a monitoring request to monitor the first remote operation selected based on the first remote operation information is received from the second client terminal, and then to:
• establish, with the second client terminal, a monitoring session to monitor the first remote operation,
• duplicate the image data of the operation data relayed to the second relay server by the second operation-performing session, and
• transmit the duplicated image data to the second client terminal via the monitoring session;
• and
• the second client terminal includes:
• a third operation control unit configured to, if a request to perform a second remote operation is received, the second remote operation request being a request to perform a remote operation on the fourth client terminal selected, referencing the relay server information and including information regarding the second client terminal and the fourth client terminal, and then to:
• transmit the second remote operation request to the first relay server,
• establish a fourth operation-performing session with the first relay server, and
• control the second remote operation, which is performed on the fourth client terminal based on the second remote operation request, via the fourth operation-performing session, a fifth operation-performing session established between the first relay server and the second relay server, and a sixth operation-performing session established between the second relay server and the fourth client terminal.

A relay server defining a first relay server that is connected to a first network, that is configured to communicate with a second relay server connected to a second network, and that is connected to a first client terminal and a second client terminal via the first network, the relay server comprising:

• an information sharing unit configured to mutually share with the second relay server relay server information, which includes activation information regarding the relay server and activation information and connection information of any client terminals connected to the relay server;
• a first remote operation control unit configured to, if a request to perform a first remote operation is received from a third client terminal connected to the second relay server via the second network and is an operation-performing client terminal that performs a remote operation, the first remote operation request being a request to perform a remote operation on the first client terminal selected, referencing the relay server information and including information regarding the third client terminal and the first client terminal, then to:
• relay the first remote operation request to the first client terminal,
• establish a second operation-performing session with the second relay server,
• establish a third operation-performing session with the first client terminal,
• relay, between the second operation-performing session and the third operation-performing session, an operation event and image data, which serve as operation data of the first remote operation performed on the first client terminal by the third client terminal based on the first remote operation request, via the second operation-performing session, the third operation-performing session, and a first operation-performing session established between the third client terminal and the second relay server, and
• create first remote operation information, which includes information regarding the first client terminal and the third client terminal;
• a monitoring control unit configured to, if the first remote operation is being performed and a monitoring request to monitor the first remote operation selected based on the first remote operation information is received from the second client terminal, and then to:
• establish, with the second client terminal, a monitoring session to monitor the first remote operation,
• duplicate the image data of the operation data relayed to the second relay server by the second operation-performing session, and
• transmit the duplicated image data to the second client terminal via the monitoring session;
• and
• a second remote operation control unit configured to, if a request to perform a second remote operation is received from the second client terminal, the first remote operation request being a request to perform the remote operation on a fourth client terminal selected, referencing the relay server information and connected to the second relay server via the second network, and the first remote operation request including information regarding the second client terminal and the fourth client terminal, and then to:
• specify the second relay server to which the fourth client terminal is connected,
• relay the second remote operation request to the second relay server,
• establish a fourth operation-performing session with the second client terminal,
• establish a fifth operation-performing session with the second relay server,
• relay, between the fourth operation-performing session and the fifth operation-performing session, an operation event and image data, which serve as operation data of a second remote operation performed on the fourth client terminal by the second client terminal based on the second remote operation request, via the fourth operation-performing session, the fifth operation-performing session, and a sixth operation-performing session established between the second relay server and the fourth client terminal, and
• create second remote operation information, which includes information regarding the second client terminal and the fourth client terminal.

A relay communication system, comprising:

• a first network;
• a second network;
• a third network;
• a first relay server connected to the first network;
• a second relay server connected to the second network;
• a third relay server connected to the third network, the first relay server, the second relay server, and the third relay server being connected to one another via a network;
• a first client terminal and a second client terminal connected to the first relay server via the first network;
• a third client terminal connected via to second relay server via the second network;
• and
• a fifth client terminal connected to the third relay server via the third network;
• wherein
• each of the first relay server, the second relay server, and the third relay server includes:
• an information sharing unit configured to mutually share relay server information that includes activation information regarding a local relay server and activation information and connection information regarding any client terminals connected to the local relay server;
• the second relay server includes:
• a second operation control unit configured to, if a request to perform a first remote operation is received from the third client terminal, which is an operation-performing client terminal that performs a remote operation, the first remote operation request being a request to perform the remote operation on the first client terminal selected, referencing the relay server information and including information regarding the third client terminal and the first client terminal, and then to:
• specify the first relay server to which the first client terminal is connected,
• relay the first remote operation request to the first relay server,
• establish a first operation-performing session with the third client terminal,
• establish a second operation-performing session with the first relay server, and
• relay, between the first operation-performing session and the second operation-performing session, an operation event and image data, which serve as operation data of the first remote operation performed on the first client terminal by the third client terminal based on the first remote operation request;
• and
• the first relay server includes:
• a first operation control unit configured to, if the first remote operation request is received from the second relay server, and then to:
• relay the first remote operation request to the first client terminal,
• establish a third operation-performing session with the first client terminal,
• relay, between the second operation-performing session and the third operation-performing session, the operation data of the first remote operation performed based on the first remote operation request, and
• create first remote operation information, which includes information regarding the first client terminal and the third client terminal;
• and
• a monitoring control unit configured to, if the first remote operation is being performed and a monitoring request to monitor the first remote operation selected based on the first remote operation information is received from the fifth client terminal via the third relay server, and then to:
• establish, with the fifth client terminal, a monitoring session to monitor the first remote operation,
• duplicate the image data of the operation data relayed to the second relay server by the second operation-performing session, and transmit the duplicated image data to the fifth client terminal via the monitoring session;
• and
• the fifth client terminal includes:
• a third operation control unit configured to, if a request to perform a second remote operation is received, the second remote operation request being a request to perform a remote operation on the second client terminal selected, referencing the relay server information and including information regarding the fifth client terminal and the second client terminal, and then to:
• transmit the second remote operation request to the third relay server,
• establish a fourth operation-performing session with the third relay server, and
• control the second remote operation, which is performed on the second client terminal based on the second remote operation request, via the fourth operation-performing session, a fifth operation-performing session established between the first relay server and the third relay server, and a sixth operation-performing session established between the first relay server and the second client terminal.

A first relay server configured to connect with a second relay server and a third relay server via a WAN, and configured to connect with a first client terminal, a second client terminal, and a third client terminal via a LAN, the first relay server comprising:

• a first operation-performing session establishing unit configured to establish a first operation-performing session with the first client terminal or the second relay server;
• a second operation-performing session establishing unit configured to establish a second operation-performing session with the second client terminal or the third relay server;
• an operated-upon session establishing unit configured to establish an operated-upon session with the third client terminal;
• an operation relay unit configured to relay operation data, which includes an operation event and image data, between the operated-upon session and the operation-performing session of either the first operation-performing session or the second operation-performing session that has an operation right;
• a monitoring control unit configured to duplicate the image data of the relayed operation data and relay the duplicated image data to the other operation-performing session that does not have the operation right;
• and
• an operation right changing unit configured to change the operation-performing session having the operation right based on an operation right changing request that is received from any one operation-performing session of either the first operation-performing session or the second operation-performing session.

A first relay server configured to connect with a second relay server via a WAN, and configured to connect with a first client terminal and a second client terminal via a LAN, the first relay server comprising:

• a first operation-performing session establishing unit configured to establish a first operation-performing session with the first client terminal;
• a second operation-performing session establishing unit configured to establish a second operation-performing session with the second client terminal;
• an operated-upon session establishing unit configured to establish an operated-upon session with the second relay server;
• an operation relay unit configured to relay operation data, which includes an operation event and image data, between the operated-upon session and one operation-performing session of either the first operation-performing session or the second operation-performing session that has an operation right;
• a monitoring control unit configured to duplicate the image data of the relayed operation data and relay the duplicated image data to the other operation-performing session that does not have the operation right;
• and
• an operation right changing unit configured to change the operation-performing session having the operation right based on an operation right changing request that is received from any one operation-performing session of either the first operation-performing session or the second operation-performing session.

A relay communication system, comprising:

• a first network;
• a second network;
• a first relay server connected to the first network;
• a second relay server connected to the second network, and configured to communicate with the first relay server via a third network;
• a first client terminal connected to the first relay server via the first network;
• and
• a second client terminal and a third client terminal connected to the second relay server via the second network;
• wherein
• each of the first relay server and the second relay server includes:
• an information sharing unit configured to mutually share relay server information that includes activation information regarding a local relay server and activation information and connection information regarding any client terminals connected to the local relay server;
• the second relay server includes:
• a second operation control unit configured to, if a request to perform a remote operation is received from the second client terminal, which is an operation-performing client terminal that performs a remote operation, the remote operation request being a request to perform the remote operation on the first client terminal selected as the operated-upon client terminal, referencing the relay server information and including information regarding the second client terminal and the first client terminal, and then to:
• specify the first relay server to which the first client terminal is connected,
• relay the remote operation request to the first relay server,
• establish a first operation-performing session with the second client terminal,
• establish an inter-relay server session with the first relay server, and
• relay, between the first operation-performing session and the inter-relay server session, an operation event and image data, which serve as operation data of the remote operation performed on the first client terminal by the second client terminal based on the remote operation request;
• and
• the first relay server includes:
• a first operation control unit configured to, if the remote operation request is received from the second relay server, and then to:
• relay the remote operation request to the first client terminal,
• establish a second operation-performing session with the first client terminal,
• relay, between the inter-relay server session and the second operation-performing session, the operation data of the remote operation performed based on the remote operation request, and
• create remote operation information, which includes information regarding the first client terminal and the second client terminal;
• and
• the second operation control unit is configured to:
• if an operation joining request to join the remote operation is received from the third client terminal, which is a joining operation client terminal that referenced the remote operation information, and then to:
• establish a first joining operation session with the third client terminal,
• relay the operation event and the image data, which serve as the operation data, between the first relay server and any one client terminal of the second client terminal and the third client terminal that has an exclusive operation right,
• duplicate the image data of the relayed operation data, and
• relay the duplicated image data to another client terminal.

A relay server defining a first relay server that is connected to a first network, that is configured to communicate with a second relay server connected to a second network, and that is connected to a first client terminal via the first network, the relay server comprising:

• an information sharing unit configured to mutually share with the second relay server relay server information, which includes activation information regarding the relay server and activation information and connection information of any client terminals connected to the relay server;
• and
• an operation control unit configured to, if a request to perform a remote operation is received from a second client terminal connected to the second relay server and is an operation-performing client terminal that performs the remote operation, the remote operation request being a request to perform a remote operation on the first client terminal selected, referencing the relay server information and including information regarding the second client terminal and the first client terminal, and then to:
• relay the remote operation request to the first client terminal,
• establish an inter-relay server session with the second relay server,
• establish a second operation-performing session with the first client terminal,
• relay, between the inter-relay server session and the second operation-performing session, an operation event and image data, which serve as operation data of the remote operation performed on the first client terminal by the second client terminal based on the remote operation request, via the inter-relay server session, the second operation-performing session, and a first operation-performing session established between the second client terminal and the second relay server, and
• create remote operation information, which includes information regarding the first client terminal and the second client terminal;
• wherein
• if an operation joining request to join the remote operation is received from a third client terminal, which is a joining operation client terminal that referenced the remote operation information, then the operation control unit is further configured to:
• establish a joining operation session with the second relay server to which the third client terminal is connected, and
• relay, based on an exclusive operation right to the remote operation performed on the first client terminal that was adjusted by the second relay server, the operation data of the remote operation performed between the first client terminal and the client terminal among the second client terminal and the third client terminal that has the exclusive operation right of the remote operation after the adjustment;
• and
• the operation event is supplied from the client terminal that has the exclusive operation right.

A relay communication system, comprising:

• a first network;
• a second network;
• a third network;
• a fourth network;
• a first relay server connected to the first network;
• a second relay server is connected to the second network, and configured to communicate with the first relay server via the third network;
• a third relay server connected to the fourth network, and connected to the first relay server and the second relay server via the third network so as to communicate with the first relay server and the second relay server;
• a first client terminal connected to the first relay server via the first network;
• a second client terminal connected to the second relay server via the second network;
• and
• a fifth client terminal connected to the third relay server via the fourth network;
• wherein
• each of the first relay server, the second relay server, and the third relay server includes:
• an information sharing unit configured to mutually share relay server information, which includes activation information regarding a local relay server and activation information and connection information regarding any client terminals connected to the local relay server;
• the second relay server includes:
• a second operation control unit configured to, if a request to perform a remote operation is received from the second client terminal, which is an operation-performing client terminal that performs a remote operation, the remote operation request being a request to perform the remote operation on the first client terminal selected as an operated-upon client terminal, referencing the relay server information and including information regarding the second client terminal and the first client terminal, and then to:
• specify the first relay server to which the first client terminal is connected,
• relay the remote operation request to the first relay server,
• establish a first operation-performing session with the second client terminal,
• establish an inter-relay server session with the first relay server, and
• relay, between the first operation-performing session and the inter-relay server session, an operation event and image data, which serve as operation data of the remote operation performed on the first client terminal by the second client terminal based on the remote operation request;
• and
• the first relay server includes:
• a first operation control unit configured to, if the remote operation request is received from the second relay server, and then to:
• relay the remote operation request to the first client terminal,
• establish a second operation-performing session with the first client terminal,
• relay, between the inter-relay server session and the second operation-performing session, the operation data of the remote operation performed based on the remote operation request, and
• create remote operation information, which includes information regarding the first client terminal and the second client terminal;
• the third relay server includes:
• a third operation control unit configured to transmit and receiving an operation joining request;
• and
• the third operation control unit is configured to:
• if an operation joining request to join the remote operation is received from the fifth client terminal, which is a joining operation client terminal that referenced the remote operation information, and then to:
• relay the operation joining request to the first relay server,
• establish a first joining operation session with the fifth client terminal, and
• establish a second joining operation session with the first relay server;
• and
• the first operation control unit is configured to:
• relay the operation event and the image data, which serve as the operation data, between the first client terminal and any one client terminal of the second client terminal and the fifth client terminal that has an operation right,
• duplicate the image data of the relayed operation data, and
• relay the duplicated image data to another client terminal.