Gesture-based manipulation method and terminal device

A terminal device, comprising:

• a display unit configured to display a target picture having a virtual object to be manipulated using a detected gesture or a detected hand action;
• an obtaining unit configured to obtain F sets of hand images;
• a recognition unit configured to recognize locations of hand knuckles on hands in the F sets of hand images based on the F sets of hand images to obtain spatial locations of F groups of hand knuckles, wherein spatial locations of any group of hand knuckles are spatial locations of hand knuckles on a hand in a set of hand images, and F is an integer greater than 0;
• and
• a processing unit configured to perform, based on the spatial locations of the F groups of hand knuckles, a control operation corresponding to the spatial locations of the F groups of hand knuckles to adjust at least one of a location or a form of the virtual object in the target picture.

A non-transitory computer-readable storage medium having instructions stored therein, and which when executed by a processor, cause the processor perform a method, the method comprising:

• displaying a target picture having a virtual object to be manipulated by using a detected gesture or a detected hand action;
• obtaining F sets of hand images;
• recognizing locations of hand knuckles on hands in the F sets of hand images based on the F sets of hand images, to obtain spatial locations of F groups of hand knuckles, wherein spatial locations of any group of hand knuckles are spatial locations of hand knuckles on a hand in a set of hand images, and F is an integer greater than 0;
• and
• performing, based on the spatial locations of the F groups of hand knuckles, a control operation corresponding to the spatial locations of the F groups of hand knuckles to adjust at least one of a location or a form of the virtual object in the target picture.