Portable and wearable electromyographic biofeedback for spinal cord injury to enhance neuroplasticity
AssigneeRehabilitation Institute of Chicago
InventorRonald Cotton
Life of this patent
Estimating the term…
Abstract
Various embodiments of a platform for providing electromyographic biofeedback are disclosed. The platform includes a sensor device having an IMU and electrodes for simultaneous tracking of IMU and EMG activity. The IMU and EMG data may be generated and leveraged in conjunction with a gaming application provided to a user while engaged to the sensor device to provide biofeedback therapy for rehabilitation.
Claims24
A system, comprising:
- one or more wearable sensor devices configured to engage skin tissue proximate to a muscle of a user and generate signal data resulting from activity of the muscle, the one or more wearable sensor devices including at least one inertial measurement unit (IMU) and at least one electromyogram (EMG) sensor, wherein the IMU includes at least one magnetometer, at least one gyroscope, and at least one accelerometer;
- a processor in operative communication with the one or more wearable sensor devices, wherein the processor is configured for processing electromyography data and inertial data defined by the signal data, and wherein the processor is integrated along the one or more wearable sensor devices and is configured to measure a joint rotation angle about a hinge joint axis while compensating for multi-axial human joint rotation, wherein the processor:
- constructs, based on quaternion pose signal data from the one or more wearable sensor devices, a rotation vector incorporating a unit norm of the quaternion pose signal data,
- projects the rotation vector along a first principal component representative of the hinge joint axis of rotation as a unit norm vector, and
- measures the joint rotation angle about the hinge joint axis based on a length of the rotation vector following projection;
- and
- a mobile game executable by a mobile device in operative communication with the processor, wherein the mobile game configures the mobile device for executing instructions including:
- receiving the electromyography data and the inertial data of the signal data;
- executing an instance of a game program, wherein the electromyography data and inertial data are taken as input to the game program in real-time;
- mapping a set of qualities of the electromyography data to one or more user inputs based on one or more relationships between the set of qualities of the electromyography data and the one or more user inputs, wherein the set of qualities of the electromyography data comprise timing and intensity of muscle activation;
- applying the one or more user inputs to the game program to create an updated state of the game program;
- displaying the updated state of the game program to provide the user with real-time biofeedback based on the electromyography data;
- and
- adjusting a difficulty of the game program by modifying the one or more relationships between the set of qualities of the electromyography data and the one or more user inputs based on the signal data.
A method, comprising:
- receiving, by a processor, electromyography data representing electrical signals resulting from muscle activation by a user;
- receiving, by the processor, inertial data representing movement or spatial orientation of a plurality of inertial sensors associated with the user, wherein the inertial data comprises accelerometer data, gyroscope data, and magnetometer data;
- measuring, by the processor, using the accelerometer data, the gyroscope data, and the magnetometer data, a joint rotation angle about a hinge joint axis while compensating for multi-axial human joint rotation by:
- constructing based on quaternion pose signal data from the one or more wearable sensor devices, a rotation vector incorporating a unit norm of the quaternion pose signal data,
- projecting the rotation vector along a first principal component representative of the hinge joint axis of rotation as a unit norm vector, and
- measuring the joint rotation angle about the hinge joint axis based on a length of the rotation vector following projection;
- updating, by the processor, an attitude vector associated with each inertial sensor using the accelerometer data, the gyroscope data, and the magnetometer data, wherein gyroscopic drift is compensated for by using a set of measured accelerometer and magnetometer data and a set of predicted accelerometer and magnetometer data;
- determining, by the processor, a joint angle vector between two inertial sensors of the plurality of inertial sensors using attitude vectors associated with the two inertial sensors, wherein a baseline attitude vector for each of the two inertial sensors is used to establish relativity between the two inertial sensors;
- determining, by the processor, a rotation rate around a joint axis defined by the joint angle vector;
- and
- controlling actions in an experience presented to the user based on timing and intensity of muscle activation of the user and one or more of the electromyography data, the attitude vector for each inertial sensor, the joint angle vector between the two inertial sensors, or the rotation rate around the joint axis.
A tangible, non-transitory, computer-readable medium having instructions encoded thereon, the instructions, when executed by a processor, being operable to:
- access electromyography data representing electrical signals resulting from muscle manipulation including amplitude and timing of a muscle contraction by a user associated with at least one wearable sensor device;
- access inertial data representing movement or spatial orientation associated with the at least one wearable sensor device, wherein the inertial data comprises accelerometer data, gyroscope data, and magnetometer data;
- map a set of qualities of the electromyography data to actions of the user in a gaming experience, wherein the set of qualities of the electromyography data comprise timing and intensity of muscle activation;
- control actions of the user in the gaming experience based on the set of qualities of the electromyography data;
- and
- measure, using the accelerometer data, the gyroscope data, and the magnetometer data, a joint rotation angle about a hinge joint axis while compensating for multi-axial human joint rotation by:
- constructing, based on quaternion pose signal data from the wearable sensor device, a rotation vector incorporating a unit norm of the quaternion pose signal data;
- projecting the rotation vector along a first principal component representative of the hinge joint axis of rotation as a unit norm vector;
- and measuring the joint rotation angle about the hinge joint axis based on a length of the rotation vector following projection.
Dependencies are inferred from the claim text.