System of converting hand and finger movements into text and audio

A system for converting hand movements to a text or a speech, the system comprising:

• two gloves, and a data processing module;
• wherein each glove comprises
• at least five metacarpophalangeal (MCP) flex sensors;
• at least five proximal interphalangeal (PIP) flex sensors;
• at least six inertial measurement units, wherein each inertial measurement unit comprises an accelerometer, a magnetometer and a gyroscope;
• at least four resistive touch sensors;
• one sensor channel provided for each finger for holding one MCP flex sensor, one PIP flex sensor, one inertial measurement unit and connecting cables together, wherein the sensor channels form a skeleton of the glove;
• two glove fastening straps for fastening the sensor channel to a corresponding finger;
• and
• a control card for collecting movement data received from the at least five MCP flex sensors, the at least five PIP flex sensors, the at least six inertial measurement units, and the at least five resistive touch sensors;
• a wireless device for transmitting the movement data from control card to the data processing module;
• a wrist strap, the sensor channels extend out from the wrist strap;
• wherein the at least five MCP flex sensors are placed on positions corresponding to top of each of the fingers;
• wherein the PIP flex sensors are placed on positions corresponding to a top of the hand to coincide with PIP bones;
• wherein five of the six inertial measurement units are placed on an edge of the fingertip side of each MCP sensor and one of the six inertial measurement units is placed on top of the hand in a position to coincide with a central point of the hand
• wherein the data processing module processes the movement data and convert the movement data into at least one of the speech or the text;
• the data processing module includes a touchscreen display for displaying a user interface.