Palm-based human-computer interaction method and apparatus, device, medium, and program product

A computing device comprising a processor, a memory, and at least two proximity sensors, the at least two proximity sensors capturing sensor data of a palm and storing the sensor data of the palm in the memory, the memory further storing at least one computer program, and the at least one computer program being loaded and executed by the processor and causing the computer device to implement a palm-based human-computer interaction method including:

• obtaining sensor data of a palm that is captured by at least two proximity sensors and a palm image of the palm captured by at least one camera, the at least two proximity sensors and the at least one camera being disposed in an array on a surface of the computer device, wherein a first proximity sensor is disposed on a first side of the at least one camera and a second proximity sensor is disposed on a second side of the at least one camera opposite to the first side;
• verifying an identity of the palm based on the palm image;
• in accordance with a determination that the identity of the palm is registered:
• recognizing a hovering interaction of the palm based on the sensor data of the palm;
• performing a first response operation when the hovering interaction action is an offset swipe action in which the sensor data of the palm indicates that the palm moves from the first proximity sensor to the second proximity sensor while a variation value of a distance between the palm and the surface of the computer device is less than a variation threshold during the movement;
• and
• performing a second response operation when the hovering interaction action is a forward/backward tap action in which the sensor data of the palm indicates that at least two distance measurement values of the palm by the at least two first proximity sensors simultaneously changes in a first direction within a first time period and remain substantially unchanged within a second time period after the first time period, wherein the second response operation is different from the first response operation.

A non-transitory computer-readable storage medium storing at least one computer program, and the at least one computer program being loaded and executed by a processor of a computer device and causing the computer device to implement a palm-based human-computer interaction method including:

• obtaining sensor data of a palm that is captured by at least two proximity sensors and a palm image of the palm captured by at least one camera, the at least two proximity sensors and the at least one camera being disposed in an array on a surface of the computer device, wherein a first proximity sensor is disposed on a first side of the at least one camera and a second proximity sensor is disposed on a second side of the at least one camera opposite to the first side;
• verifying an identity of the palm based on the palm image;
• in accordance with a determination that the identity of the palm is registered:
• recognizing a hovering interaction of the palm based on the sensor data of the palm;
• performing a first response operation when the hovering interaction action is an offset swipe action in which the sensor data of the palm indicates that the palm moves from the first proximity sensor to the second proximity sensor while a variation value of a distance between the palm and the surface of the computer device is less than a variation threshold during the movement;
• and
• performing a second response operation when the hovering interaction action is a forward/backward tap action in which the sensor data of the palm indicates that at least two distance measurement values of the palm by the at least two first proximity sensors simultaneously changes in a first direction within a first time period and remain unchanged within a second time period after the first time period, wherein the second response operation is different from the first response operation.