Electromyographic based touch interaction processing method, device, and system

A touch interaction processing method, comprising:

• periodically collecting, by an electromyographic signal collection device, surface electromyographic signals S1 from multiple channels;
• determining, by the electromyographic signal collection device according to a time-frequency domain feature of the surface electromyographic signals S1, a hand gesture in which a user performs a touch;
• and determining a first touch start time according to the hand gesture, wherein the first touch start time is a start time at which the user performs a touch operation and that is identified by the electromyographic signal collection device;
• and
• sending, by the electromyographic signal collection device, first information to a processing device, such that the processing device generates a touch instruction according to the first information and second information that is sent by a location capturing device, and performs a corresponding interaction operation, wherein the first information comprises a device identifier of the electromyographic signal collection device, the hand gesture, and the first touch start time;
• the second information comprises a quantity of touch points at which the user performs the touch, a second touch start time, and coordinate information of each touch point;
• and the second touch start time is a start time at which the user performs the touch operation and that is identified by the location capturing device.

A processing device, comprising:

• a non-transitory memory configured to store instructions;
• and
• a processor coupled to the memory and configured to execute the instructions to:
• receive first information sent by an electromyographic signal collection device and second information sent by a location capturing device, wherein the first information comprises a device identifier of the electromyographic signal collection device, a hand gesture in which a user performs a touch, and a first touch start time;
• the second information comprises a quantity of touch points at which the user performs the touch, a second touch start time, and coordinate information of each touch point;
• the first touch start time is a start time at which the user performs a touch operation and that is identified by the electromyographic signal collection device;
• and the second touch start time is a start time at which the user performs the touch operation and that is identified by the location capturing device;
• generate a touch instruction when it is determined that a time gap between the first touch start time and the second touch start time is less than a preset threshold, and a quantity of touch points that is corresponding to the hand gesture is the same as the quantity of the touch points that is comprised in the second information, wherein the touch instruction comprises the device identifier of the electromyographic signal collection device, the hand gesture, and the coordinate information of each touch point;
• and
• perform an interaction operation corresponding to the touch instruction.

A touch interaction processing device, comprising:

• a non-transitory memory configured to store instructions;
• and
• a processor coupled to the memory and configured to execute the instructions to:
• periodically collect surface electromyographic signals S1 from multiple channels;
• determine, according to a time-frequency domain feature of the surface electromyographic signals S1, a hand gesture in which a user performs a touch;
• and
• determine a first touch start time according to the hand gesture, wherein the first touch start time is a start time at which the user performs a touch operation and that is identified by the electromyographic signal collection device;
• and
• send first information to a processing device, such that the processing device generates a touch instruction according to the first information and second information that is sent by a location capturing device, and performs a corresponding interaction operation, wherein the first information comprises a device identifier of the electromyographic signal collection device, the hand gesture, and the first touch start time;
• the second information comprises a quantity of touch points at which the user performs the touch, a second touch start time, and coordinate information of each touch point;
• and the second touch start time is a start time at which the user performs the touch operation and that is identified by the location capturing device.