Back to results
US 11,600,116 B2Granted
Methods and apparatuses for recognizing gesture, electronic devices and storage media
AssigneeBoe Technology Group Co., Ltd.
InventorChunshan Zu
Life of this patent
Estimating the term…
Abstract
Provided are a method and an apparatus for recognizing a gesture, an electronic device and a storage medium. In one or more embodiments, the method includes: detecting at least one hand region from a video image and obtaining hand image information of each of the at least one hand region; obtaining hand motion information of each of the at least one hand region by tracking the at least one hand region; determining a gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region; wherein the gesture comprises at least one of a single-hand static gesture, a single-hand dynamic gesture, a double-hand static gesture or a double-hand dynamic gesture.
Claims16
A method of recognizing a gesture, comprising:
- detecting at least one hand region from a video image and obtaining hand image information of each of the at least one hand region;
- obtaining hand motion information of each of the at least one hand region by tracking the at least one hand region;
- determining a gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region;
- wherein the gesture comprises at least one of a single-hand static gesture, a single-hand dynamic gesture, a double-hand static gesture or a double-hand dynamic gesture;
- wherein detecting the at least one hand region from the video image comprises:
- determining that there is only one hand region by detecting the video image;
- and
- determining the gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region comprises:
- obtaining a first recognition result by performing a single-hand static gesture recognition for the hand image information of the hand region;
- and
- in response to that the first recognition result is yes, determining that the gesture corresponding to the hand region is the single-hand static gesture;
- wherein determining the gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region comprises:
- in response to that the first recognition result is no, obtaining a second recognition result by performing a first single-hand dynamic gesture recognition based on the hand motion information of the hand region;
- and
- in response to that the second recognition result is yes, determining that the gesture corresponding to the hand region is the single-hand dynamic gesture;
- wherein determining the gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region comprises:
- in response to that the second recognition result is no, obtaining a third recognition result by performing a second single-hand dynamic gesture recognition based on the hand image information and the hand motion information of the hand region;
- and
- in response to that the third recognition result is yes, determining that the gesture corresponding to the hand region is the single-hand dynamic gesture.
16 more elements
A method of recognizing a gesture, comprising:
- detecting at least one hand region from a video image and obtaining hand image information of each of the at least one hand region;
- obtaining hand motion information of each of the at least one hand region by tracking the at least one hand region;
- determining a gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region;
- wherein the gesture comprises at least one of a single-hand static gesture, a single-hand dynamic gesture, a double-hand static gesture or a double-hand dynamic gesture, wherein
- detecting the at least one hand region from the video image comprises:
- determining that there are at least two hand regions by detecting the video image;
- and
- determining the gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region comprises:
- for any two hand regions, determining a confidence level of the two the hand regions belonging to two hands of a same person according to the hand image information and the hand motion information of the two hand regions;
- in response to that one or more confidence levels are greater than a preset threshold, determining that the two hand regions with the highest confidence level belong to two hands of a same person;
- obtaining a fourth recognition result by performing a double-hand static gesture recognition for the hand image information of the two hand regions belonging to two hands of a same person;
- and
- in response to that the fourth recognition result is yes, determining that the gesture corresponding to the two hand regions is the double-hand static gesture.
10 more elements
An electronic device, comprising:
- a processor;
- a memory, in communication connection with the processor;
- at least one program, stored in the memory and configured to be executed by the processor;
- wherein the at least one program is configured to:
- detect at least one hand region from a video image and obtain hand image information of each of the at least one hand region;
- obtain hand motion information of each of the at least one hand region by tracking the at least one hand region;
- determine a gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region;
- wherein the gesture comprises at least one of a single-hand static gesture, a single-hand dynamic gesture, a double-hand static gesture, or a double-hand dynamic gesture, wherein
- when detecting the at least one hand region from the video image, the processor is configured to:
- determine that there are at least two hand regions by detecting the video image;
- and
- when determining the gesture corresponding to each of the at least one hand region according to the hand image information and/or the hand motion information of each of the at least one hand region, the processor is configured to:
- for any two hand regions, determine a confidence level of the two hand regions belonging to two hands of a same person according to the hand image information and the hand motion information of the two hand regions;
- in response to that one or more confidence levels are greater than a preset threshold, determine that the two hand regions with the highest confidence level belong to two hands of a same person;
- obtain a fourth recognition result by performing a double-hand static gesture recognition for the hand image information of the two hand regions belonging to two hands of a same person;
- in response to that the fourth recognition result is yes, determine that the gesture corresponding to the two hand regions is the double-hand static gesture.
13 more elements
Dependencies are inferred from the claim text.