Back to results
US 11,307,667 B2Granted
Systems and methods for facilitating accessible virtual education
AssigneeArizona Board of Regents on behalf of Arizona State University
InventorsAyan Banerjee, Sandeep Gupta, Prajwal Paudyal
Life of this patent
Estimating the term…
Abstract
Various embodiments of systems and methods for a learning environment for accessible virtual computer science education are disclosed.
Claims4
A method, comprising,
- generating an expert reach set for a gesture as performed by a tutor wherein the expert reach set defines correctness for transient movement dynamics and hand shape for the gesture;
- receiving a video feed of a user performing the gesture;
- converting the gesture as performed by the user into a spatio-temporal evolution of continuous variables by:
- generating an X and Y coordinate time series, wherein the positional X and Y coordinate time series is representative of positions of a right wrist and a left wrist of the user;
- and
- extracting a hand shape of the user;
- and
- determining a deviation of the gesture as performed by the user from the expert reach set for the gesture;
- and
- providing correctness feedback to the user based on the deviation of the gesture as performed by the user from the expert reach set for the gesture,
- wherein the expert reach set is a set of continuous states observed from simulating a hybrid system representative of the gesture over time for a bounded set of initial conditions
- wherein the hybrid system is determined by:
- segmenting the gesture as captured by the video feed of the user into a plurality of discrete modes:
- clustering each mode of the plurality of discrete modes in accordance with their respective triggering mechanism;
- obtaining one or more kinematic equations representative of the gesture by:
- processing the gesture data using a multi-variate polynomial regression model or Fisher Information with Cramer Rao bound to obtain a set of flow parameters representative of mode transitions;
- and
- clustering the gesture data using a density based approach to the set of flow parameters for each mode of the plurality of modes;
- and
- deriving guard conditions for each cluster of the gesture.
17 more elements
Dependencies are inferred from the claim text.