Gesture recognizing method, interactive method, gesture interactive system, electronic device, and storage medium

A gesture recognizing method, comprising:

• acquiring a plurality of groups of images taken respectively at different photographing moments for a gesture action object, wherein each group of images comprises at least one pair of corresponding depth map and grayscale map;
• and
• according to the plurality of groups of images, obtaining spatial information by using the depth map in each group of images, and obtaining posture information for the gesture action object by using the grayscale map in each group of the images, to recognize a dynamic gesture change of the gesture action object,
• wherein acquiring the plurality of groups of images taken respectively at different photographing moments for the gesture action object, comprises:
• obtaining a plurality of groups of images respectively corresponding to the different photographing moments, by using at least one photographing apparatus to continuously photograph the gesture action object, wherein each photographing apparatus is configured to synchronously output a pair of corresponding depth map and grayscale map at one photographing moment,
• wherein obtaining the plurality of groups of images respectively corresponding to the different photographing moments, by using the at least one photographing apparatus to continuously photograph the gesture action object, comprises:
• by using each photographing apparatus to continuously photograph the gesture action object, obtaining a plurality of pairs of output depth maps and grayscale maps respectively corresponding to the different photographing moments output by the photographing apparatus,
• wherein each photographing apparatus comprises a first acquiring unit,
• the first acquiring unit is configured to acquire a grayscale map in every first frame, and acquire a depth map in every N first frames, wherein the depth map is generated based on N grayscale maps acquired in every N consecutive first frames, the N grayscale maps respectively correspond to N different phases, the depth map and one grayscale map among the N grayscale maps are synchronously output from the photographing apparatus, where N is a positive integer greater than 1;
• by using each photographing apparatus to continuously photograph the gesture action object, obtaining the plurality of pairs of depth maps and grayscale maps respectively corresponding to the different photographing moments output by the photographing apparatus, comprises:
• outputting a pair of corresponding depth map and grayscale map in at most every N−1 first frames by using the photographing apparatus, wherein for one pair of corresponding depth map and grayscale map output in a same frame, the output depth map is obtained based on grayscale maps of N−1 first frames adjacent to the output grayscale map, and the output grayscale map and the grayscale maps of the N−1 first frames correspond to the N different phases.

A gesture recognizing method, comprising:

• acquiring a plurality of groups of images taken respectively at different photographing moments for a gesture action object, wherein each group of images comprises at least one pair of corresponding depth map and grayscale map;
• and
• according to the plurality of groups of images, obtaining spatial information by using the depth map in each group of images, and obtaining posture information for the gesture action object by using the grayscale map in each group of the images, to recognize a dynamic gesture change of the gesture action object,
• wherein acquiring the plurality of groups of images taken respectively at different photographing moments for the gesture action object, comprises:
• obtaining a plurality of groups of images respectively corresponding to the different photographing moments, by using at least one photographing apparatus to continuously photograph the gesture action object, wherein each photographing apparatus is configured to synchronously output a pair of corresponding depth map and grayscale map at one photographing moment,
• wherein obtaining the plurality of groups of images respectively corresponding to the different photographing moments, by using the at least one photographing apparatus to continuously photograph the gesture action object, comprises:
• by using each photographing apparatus to continuously photograph the gesture action object, obtaining a plurality of pairs of output depth maps and grayscale maps respectively corresponding to the different photographing moments output by the photographing apparatus,
• wherein each photographing apparatus comprises a first acquiring unit and a second acquiring unit,
• the second acquiring unit is configured to output a grayscale map in every second frame, and the first acquiring unit is configured to output a depth map in every M second frames, where M is a positive integer greater than 1,
• by using each photographing apparatus to continuously photograph the gesture action object, obtaining the plurality of pairs of depth maps and grayscale maps respectively corresponding to the different photographing moments output by the photographing apparatus, comprises:
• outputting a pair of corresponding depth map and grayscale map in at most every M−1 second frames by using the photographing apparatus, wherein the output depth map comprises a reference depth map, or a depth map obtained by smooth trajectory fitting and prediction based on the reference depth map and at least one grayscale map corresponding to the reference depth map,
• wherein the reference depth map comprises a depth map output by the first acquiring unit at a current second frame or before the current second frame, the current second frame is a second frame outputting the pair of corresponding depth map and grayscale map, and the at least one grayscale map comprises a grayscale map output by the second acquiring unit between the current second frame and a second frame corresponding to the reference depth map.