Action classification using deep embedded clustering
AssigneeHRL Laboratories, LLC
InventorsAmir M. Rahimi, Heiko Hoffmann, Hyukseong Kwon
Life of this patent
Estimating the term…
Abstract
Described is a system for action recognition through application of deep embedded clustering. For each image frame of an input video, the system computes skeletal joint-based pose features representing an action of a human in the image frame. Non-linear mapping of the pose features into an embedded action space is performed. Temporal classification of the action is performed and a set of categorical gesture-based labels is obtained. The set of categorical gesture-based labels is used to control movement of a machine.
Claims20
A system for action recognition, the system comprising:
- one or more processors and a non-transitory computer-readable medium having executable instructions encoded thereon such that when executed, the one or more processors perform an operation of:
- for each image frame of an input video, computing skeletal joint-based pose features representing an action of a human in the image frame using a pose estimation technique;
- performing non-linear mapping of the pose features into an embedded action space;
- performing temporal classification of the action and obtaining a set of categorical gesture-based labels;
- and
- controlling movement of a machine based on the set of categorical gesture-based labels.
A computer implemented method for action recognition, the method comprising an act of:
- causing one or more processers to execute instructions encoded on a non-transitory computer-readable medium, such that upon execution, the one or more processors perform operations of:
- for each image frame of an input video, computing skeletal joint-based pose features representing an action of a human in the image frame using a pose estimation technique;
- performing non-linear mapping of the pose features into an embedded action space;
- performing temporal classification of the action and obtaining a set of categorical gesture-based labels;
- and
- controlling movement of a machine based on the set of categorical gesture-based labels.
A computer program product for action recognition, the computer program product comprising:
- computer-readable instructions stored on a non-transitory computer-readable medium that are executable by a computer having one or more processors for causing the processor to perform operations of:
- for each image frame of an input video, computing skeletal joint-based pose features representing an action of a human in the image frame using a pose estimation technique;
- performing non-linear mapping of the pose features into an embedded action space;
- performing temporal classification of the action and obtaining a set of categorical gesture-based labels;
- and
- controlling movement of a machine based on the set of categorical gesture-based labels.
Dependencies are inferred from the claim text.