Adaptive neuromodulator action policy generation

A computer program product comprising one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions executable by a processor to cause the processor to perform operations comprising:

• collecting, by a data collection module, a first set of patient data and a first set of treatment data associated with a patient population treated with neuromodulation;
• clustering, by a clustering module, the patient population into a plurality of cohorts;
• generating, by a state discovery module, a plurality of states using a second set of patient data associated with a cohort in the plurality of cohorts;
• generating, by an action discovery module, a plurality of actions using a second set of treatment data associated with the cohort;
• determining, by a decision-making module based on the plurality of actions, a plurality of probabilities associated with a transition from a first state to a second state in the plurality of states;
• and
• generating, by a recommendation module based on the plurality of probabilities, a neuromodulator action policy for a patient in the cohort.

A computer system comprising a processor and one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions executable by the processor to cause the processor to perform operations comprising:

• collecting, by a data collection module, a first set of patient data and a first set of treatment data associated with a patient population treated with neuromodulation;
• clustering, by a clustering module, the patient population into a plurality of cohorts;
• generating, by a state discovery module, a plurality of states using a second set of patient data associated with a cohort in the plurality of cohorts;
• generating, by an action discovery module, a plurality of actions using a second set of treatment data associated with the cohort;
• determining, by a decision-making module based on the plurality of actions, a plurality of probabilities associated with a transition from a first state to a second state in the plurality of states;
• and
• generating, by a recommendation module based on the plurality of probabilities, a neuromodulator action policy for a patient in the cohort.