Dynamic gesture recognition method, device and computer-readable storage medium
AssigneeUbtech Robotics Corp Ltd
InventorsChi Shao, Miaochen Guo, Jun Cheng, Jianxin Pang
Life of this patent
Estimating the term…
Abstract
A dynamic gesture recognition method includes: performing detection on each frame of image of a video stream using a preset static gesture detection model to obtain a static gesture in each frame of image of the video stream; in response to detection of a change of the static gesture from a preset first gesture to a second gesture, suspending the static gesture detection model and activating a preset dynamic gesture detection model; and performing detection on multiple frames of images that are pre-stored in a storage medium using the dynamic gesture detection model to obtain a dynamic gesture recognition result.
Claims20
A computer-implemented dynamic gesture recognition method, comprising:
- performing detection on each frame of image of a video stream using a preset static gesture detection model to obtain a static gesture in each frame of image of the video stream;
- in response to detection of a change of the static gesture from a preset first gesture to a second gesture, suspending the static gesture detection model and activating a preset dynamic gesture detection model;
- and
- performing detection on a plurality of frames of images that are pre-stored in a storage medium using the dynamic gesture detection model to obtain a dynamic gesture recognition result;
- wherein suspending the static gesture detection model and activating the preset dynamic gesture detection model comprise:
- accumulating a number of frames of images in which the static gesture is the first gesture;
- in response to the number being greater than a first threshold, accumulating a number of frames of images in which the static gesture is the second gesture;
- and
- in response to the number of frames of images in which the static gesture is the second gesture being greater than a second threshold, determining that the first gesture has been changed into the second gesture, suspending the static gesture detection model and activating a preset dynamic gesture detection model.
A dynamic gesture recognition device comprising:
- one or more processors;
- a memory;
- and
- one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprise:
- instructions for performing detection on each frame of image of a video stream using a preset static gesture detection model to obtain a static gesture in each frame of image of the video stream;
- instructions for, in response to detection of a change of the static gesture from a preset first gesture to a second gesture, suspending the static gesture detection model and activating a preset dynamic gesture detection model;
- and
- instructions for, performing detection on a plurality of frames of images that are pre-stored in a storage medium using the dynamic gesture detection model to obtain a dynamic gesture recognition result;
- wherein the instructions for suspending the static gesture detection model and activating the preset dynamic gesture detection model comprise:
- instructions for accumulating a number of frames of images in which the static gesture is the first gesture;
- instructions for, in response to the number being greater than a first threshold, accumulating a number of frames of images in which the static gesture is the second gesture;
- and
- instructions for, in response to the number of frames of images in which the static gesture is the second gesture being greater than a second threshold, determining that the first gesture has been changed into the second gesture, suspending the static gesture detection model and activating a preset dynamic gesture detection model.
A non-transitory computer-readable storage medium storing one or more programs to be executed in a dynamic gesture recognition device, the one or more programs, when being executed by one or more processors of the dynamic gesture recognition device, causing g legged robot to perform processing comprising:
- performing detection on each frame of image of a video stream using a preset static gesture detection model to obtain a static gesture in each frame of image of the video stream;
- in response to detection of a change of the static gesture from a preset first gesture to a second gesture, suspending the static gesture detection model and activating a preset dynamic gesture detection model;
- and
- performing detection on a plurality of frames of images that are pre-stored in a storage medium using the dynamic gesture detection model to obtain a dynamic gesture recognition result;
- wherein suspending the static gesture detection model and activating the preset dynamic gesture detection model comprise:
- accumulating a number of frames of images in which the static gesture is the first gesture;
- in response to the number being greater than a first threshold, accumulating a number of frames of images in which the static gesture is the second gesture;
- and
- in response to the number of frames of images in which the static gesture is the second gesture being greater than a second threshold, determining that the first gesture has been changed into the second gesture, suspending the static gesture detection model and activating a preset dynamic gesture detection model.
Dependencies are inferred from the claim text.