Method and system for adjusting audio signals based on motion deviation

A computer-implemented method to modify an audio signal that is to be provided to a subject in response to changes in motion patterns of the subject, the method comprising:

• identifying a first performance activity for assessment;
• consulting a memory to identify a first set of motion characteristics and a first set of controllable audio features associated with the first performance activity, wherein the memory associates a plurality of performance activities with a plurality of motion characteristics and a plurality of controllable audio features, wherein a particular performance activity of the plurality of performance activities is associated with a particular set of motion characteristics of the plurality of motion characteristics and a particular set of controllable audio features of the plurality of controllable audio features, wherein the first set of motion characteristics comprises multiple motion characteristics of the plurality of motion characteristics;
• receiving the audio signal from a source;
• receiving sensor motion data from at least one sensor coupled to a leg prosthesis worn by the subject;
• determining a plurality of measurements for the first set of motion characteristics based on the sensor motion data;
• determine a deviation value and a deviation type by comparing the plurality of measurements to corresponding baseline measurements and target measurements wherein the baseline measurements and the target measurements are different and are generated based at least in part on measurements associated with a prior performance of the first performance activity by the subject;
• based at least in part on a determination that the deviation value is greater than a first deviation threshold and less than a second deviation threshold, modifying the audio signal by adjusting at least one controllable audio feature of the first set of controllable audio features of the audio signal by a first amount, wherein the first deviation threshold is based at least in part on the target measurements, and the second deviation threshold is greater than the first deviation threshold and is based at least in part on the baseline measurements, and wherein the at least one controllable audio feature is based at least in part on the deviation type;
• and
• based at least in part on a determination that the deviation value is greater than the second deviation threshold, modify the received audio signal by adjusting the at least one controllable audio feature of the first set of controllable audio features by a second amount, wherein the second amount is greater than the first amount.

A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by one or more processors cause the one or more processors to:

• identify a first performance activity for assessment;
• consult a memory to identify a first set of motion characteristics and a first set of controllable audio features associated with the first performance activity, wherein the memory associates a plurality of performance activities with a plurality of motion characteristics and a plurality of controllable audio features, wherein a particular performance activity of the plurality of performance activities is associated with a particular set of motion characteristics of the plurality of motion characteristics and a particular set of controllable audio features of the plurality of controllable audio features, wherein the first set of motion characteristics comprises multiple motion characteristics of the plurality of motion characteristics;
• receive an audio signal from a source;
• receive sensor motion data that corresponds to a subject;
• determine a plurality of measurements for the first set of motion characteristics based on the sensor motion data;
• determine a deviation value and deviation type based on differences between the plurality of measurements and corresponding subject-specific target measurements and subject-specific baseline measurements, wherein the corresponding subject-specific target measurements are generated based at least in part on measurements associated with a prior performance of the performance activity by the subject;
• based at least in part on a determination that the deviation value is greater than a first deviation threshold that corresponds to the subject-specific target measurements and less than a second deviation threshold that is greater than the first deviation threshold and that corresponds to the subject-specific baseline measurements, modify the audio signal by adjusting at least one controllable audio feature of the first set of controllable audio features of the audio signal by a first amount, wherein the at least one controllable audio feature is based at least in part on the deviation type;
• and
• based at least in part on a determination that the deviation value is greater than the second deviation threshold, modify the received audio signal by adjusting the at least one controllable audio feature of the first set of controllable audio features by a second amount that is greater than the first amount.