Natural User Interface for Remote Communication: An Interactive Collaboration System that allows Co-drawing Pad, Co-browsing/sharing Web/Document Files Using Session Initial Protocol (SIP)/Short Message Peer-to-Peer Protocol (SMPP) to Wake Up Remote Devices

The system of the first claim wherein comprising the server application. There are two kinds of server applications. The first kind is data server, where data is stored, downloaded, uploaded, and shared to all client applications in a private group. The second kind of server is message server, which receives, transmits, and broadcasts all the messages sent by one client application to the others.

The system of the first claim wherein comprising the client application. There are twelve functions in the client application such as connection, pen, text, picture, web browser, redo/undo, eraser, clear, document, message, and close.

The system of the first claim wherein comprising the web browser emulated into the drawing pad. The sharing of web data and co-browsing of web are processed and displayed in real time. It means that one end user can draw on their pads in a client application or surf the Web emulated on the drawing pad and at the same time the other end-users can see those changes on their drawing pad. The client application will send/receive messages to/from the Message server and the Message server will broadcast its actions to the other clients. After receiving the action from the other clients through the message of the Message server, the client application will synchronize its conditions. The system of sending/receiving text message is based on TCP/IP network.

The system of the first claim wherein comprising the ability to transfer data (raw text, images or documents) through client/server mode by using text messages. Text messages will include the sent/received time, the name of the sender, and the link of storing data such as text, images, or document files located in the data server or in a cloud-based system.

The system of the first claim wherein comprising the ability to convert one emulated application displayed in the drawing pad into the background image. After that the end users can modify the background image by drawing some free-shape points, adding highlights, or typing some text in the background image. At the same time, all the other end users at the meeting can see those changes in their drawing pads.

In general, in a one aspect, the term of the second claim is the full-time and low-energy connection between client devices and the server.

The system of the second claim wherein comprising the implementation of the session initial protocol (SIP) to sustain connection between client applications and the server. This connection helps one client application to wake up the other client application installed in a remote device such as a computer, mobile phone, tablet, or home appliance, etc, through a SIP message.

The system of the second claim wherein comprising the implementation of the short-message peer-to-peer protocol (SMPP) to sustain connection between client applications and the server. This connection helps one client application to activate the other client application installed in a remote device such as a computer, mobile phone, tablet, or home appliance through a SMPP message.

In general, in a one aspect, the term of the third claim is to use a message to describe an address link to a Web page, a URL link to a picture, or a URL link to document files on the server, and the server/host client can broadcast the message to the other clients through the system of servers. The application of other clients can download pictures, web pages, or document files by using the URL link in the message. After being downloaded, the data files are automatically displayed on the working pad.