Capturing and recognizing hand postures using inner distance shape contexts
AssigneeHonda Motor Co., Ltd.
InventorsBehzad Dariush, Raghuraman Gopalan
Life of this patent
Estimating the term…
Abstract
A system, method, and computer program product for recognizing hand postures are described. According to one aspect, a set of training images is provided with labels identifying hand states captured in the training images. Inner Distance Shape Context (IDSC) descriptors are determined for the hand regions in the training images, and fed into a Support Vector Machine (SVM) classifier to train it to classify hand shapes into posture classes. An IDSC descriptor is determined for a hand region in a testing image, and classified by the SVM classifier into one of the posture classes the SVM classifier was trained for. The hand posture captured in the testing image is recognized based on the classification.
Claims19
A computer based method for recognizing a hand posture captured in an image, the method comprising:
- identifying a hand region in the image;
- estimating a scatter direction of the hand region in the image;
- determining an Inner Distance Shape Context (IDSC) descriptor for the hand region identified in the image, the IDSC descriptor not based on the scatter direction;
- matching the scatter direction to one of a plurality orientation bins, the matching orientation bin corresponding to that scatter direction;
- identifying a classifier associated with the matching orientation bin, the classifier comprising a plurality of reference IDSC descriptors corresponding to a plurality of hand posture classes, the classifier generated based on training images having scatter directions that also match the orientation bin;
- classifying the hand region into one of the plurality of hand posture classes by feeding the IDSC descriptor into the classifier.
A computer program product for recognizing a hand posture captured in an image, the computer program product comprising a non-transitory computer-readable storage medium containing executable computer program code for performing a method comprising:
- identifying a hand region in the image;
- estimating a scatter direction of the hand region in the image;
- determining an Inner Distance Shape Context (IDSC) descriptor for the hand region identified in the image, the IDSC descriptor not based on the scatter direction;
- matching the scatter direction to one of a plurality orientation bins, the matching orientation bin corresponding to that scatter direction;
- identifying a classifier associated with the matching orientation bin, the classifier comprising a plurality of reference IDSC descriptors corresponding to a plurality of hand posture classes, the classifier generated based on training images having scatter directions that also match the orientation bin;
- classifying the hand region into one of the plurality of hand posture classes by feeding the IDSC descriptor into the classifier.
A system for recognizing a hand posture captured in an image, the system comprising:
- a computer processor for executing executable computer program code;
- and
- a computer-readable storage medium containing the executable computer program code for performing a method comprising:
- identifying a hand region in the image;
- estimating a scatter direction of the hand region in the image;
- determining an Inner Distance Shape Context (IDSC) descriptor for the hand region identified in the image, the IDSC descriptor not based on the scatter direction;
- matching the scatter direction to one of a plurality orientation bins, the matching orientation bin corresponding to that scatter direction;
- identifying a classifier associated with the matching orientation bin, the classifier comprising a plurality of reference IDSC descriptors corresponding to a plurality of hand posture classes, the classifier generated based on training images having scatter directions that also match the orientation bin;
- classifying the hand region into one of the plurality of hand posture classes by feeding the IDSC descriptor into the classifier.
Dependencies are inferred from the claim text.