Temporal difference learning, reinforcement learning approach to determine optimal number of threads to use for file copying
AssigneeMicro Focus Software Inc.
InventorARSHAD JAVEED
Life of this patent
Estimating the term…
Abstract
For a given file type, an optimal number of threads to use to copy files of each of a number of different discrete file sizes is determined, using a temporal difference learning, reinforcement learning approach in which file copy time is used as feedback reward reinforcement. A continuous function corresponding to the given file type and outputting the number of threads to use to copy files having this given file type and that are of any input file size is fitted onto the optimal numbers of threads determined for the discrete file sizes.
Claims20
A method comprising:
- for each discrete file size of a plurality of discrete file sizes, determining an optimal number of threads to use to copy files of the discrete file size and having a given file type, using a temporal difference learning, reinforcement learning approach in which file copy time is used as feedback reward reinforcement;
- fitting a continuous function corresponding to the given file type, the continuous function outputting the number of threads to use to copy files of any input file size and that have the given file type onto the optimal numbers of threads determined for the discrete file sizes;
- and
- copying particular files having the given file type using a number of threads output by the continuous function for a file size of the particular files.
A non-transitory computer-readable data storage medium storing program code executable by a processor to perform processing comprising:
- receiving a continuous function corresponding to a file type, the continuous function outputting the number of threads to use to copy files having the file type and of any input file size, the continuous function fitted onto optimal numbers of threads used to copy files having the file type and of discrete file sizes;
- and
- copying a plurality of particular files having the file type using a number of threads output by the continuous function for a file size of the particular files,
- wherein the optimal numbers of threads for the discrete file sizes correspond to the file type and have been determined using a temporal difference learning, reinforcement learning approach in which file copy time is used as feedback reward reinforcement.
A computing system comprising:
- a memory storing a Q-learning table of cumulative values for a plurality of state-action pairs, each state-action pair comprising one of a plurality of states and one of a plurality of actions, the states corresponding to different numbers of threads, the actions comprising incrementing the number of threads, the Q-learning table corresponding to a given file type, decrementing the number of threads, and maintaining the number of threads;
- and
- a processor to:
- for each of a plurality of discrete file sizes, determine an optimal number of threads to use to copy files of the discrete file size, the files having the given file type, by iteratively performing, until a stable state has been reached:
- probabilistically selecting an action to transition from a current state to a next state using the Q-learning table, the action probabilistically selected based on the action of the state-action pair including the current state and that has a highest cumulative value within the table;
- copying the files of the discrete file size using the number of threads of the next state and monitoring file transfer times to copy the files;
- updating, within the Q-learning table, the cumulative value for the state-action pair corresponding to the current state and the selected action based on a reward value taking into account the monitored file transfer times;
- for each discrete file size, set the optimal number of threads for the discrete file size to the number of threads corresponding to the stable state that has been reached for the discrete file size;
- and
- fit a continuous function corresponding to the given file type and outputting the number of threads to use to copy files having the given file type and of any input file size onto the optimal numbers of threads determined for the discrete file sizes.
Dependencies are inferred from the claim text.