Warm starting an online bandit learner model utilizing relevant offline models

A non-transitory computer readable medium comprising instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

• determining an initial entropy of an environment based on an observation history for the environment, the environment comprising context associated with a multi-bandit problem;
• identifying, using an offline model of a plurality of offline models, reward estimates associated with performing a set of computer-implemented tasks corresponding to the environment;
• determining, entropy reductions for the set of computer-implemented tasks by determining how much information each computer-implemented task from the set of computer-implemented tasks provides about the environment based on how each computer-implemented task differentiates between the plurality of offline models;
• and
• selecting, based on the reward estimates and the entropy reductions for the set of computer-implemented tasks, a computer-implemented task to perform from the set of computer-implemented tasks using the offline model.

A system comprising:

• one or more memory devices;
• and
• one or more servers coupled to the one or more memory devices that cause the system to:
• determine an initial entropy of an environment based on an observation history for the environment, the environment comprising context associated with a multi-bandit problem;
• identify, using an offline model of a plurality of offline models, reward estimates associated with performing a set of computer-implemented tasks corresponding to the environment;
• determine entropy reductions for the set of computer-implemented tasks by determining how much information each computer-implemented task from the set of computer-implemented tasks provides about the environment based on how each computer-implemented task differentiates between the plurality of offline models;
• and
• select, based on the reward estimates and the entropy reductions for the set of computer-implemented tasks, a computer-implemented task to perform from the set of computer-implemented tasks using the offline model.