Operating method for configuring model performing reinforcement learning related to task planning and electronic apparatus supporting thereof
AssigneeAgency for Defense Development
InventorsSun Ju LEE, Do Hyung KIM, Beom Ki KIM
Life of this patent
Estimating the term…
Abstract
Provided is a method of configuring a model by an electronic apparatus, the method including designing a multi-agent reinforcement learning structure to perform reinforcement learning based on each agent configured to correspond to each military unit identified as a target of task planning in a virtual battlespace simulation, and configuring a model performing reinforcement learning related to task planning for each military unit based on the multi-agent reinforcement learning structure.
Claims10
A method of configuring a model by an electronic apparatus, the method comprising:
- designing a multi-agent reinforcement learning structure to perform reinforcement learning based on each agent configured to correspond to each military unit identified as a target of task planning in a virtual battlespace simulation;
- and
- configuring a model performing reinforcement learning related to task planning for each military unit based on the multi-agent reinforcement learning structure,
- wherein the multi-agent reinforcement learning structure is designed to include each agent reinforcement learning structure configured to correspond to each agent in order that each agent learns the task planning for each military unit,
- wherein each agent reinforcement learning structure comprises:
- an attention network structure generating battlespace information reflecting an importance of each military unit based on information about each military unit identified through the virtual battlespace simulation;
- and
- a task selection network structure determining and selecting a task to be performed by each military unit based on the battlespace information among one or more tasks performable by each military unit in the virtual battlespace simulation,
- wherein the task selection network structure includes a selection network selecting the task to be performed by each military unit among the one or more tasks and one or more task networks respectively corresponding to the one or more tasks, and
- wherein when a specific task is selected among the one or more tasks by the selection network, a specific task network corresponding to the specific task among one or more task networks is activated and the activated specific task network is set to output input value information for performing the specific task.
(canceled)
A non-transitory computer-readable storage medium having a program for executing a method of configuring a model on a computer, the method comprising:
- designing a multi-agent reinforcement learning structure to perform reinforcement learning based on each agent configured to correspond to each military unit identified as a target of task planning in a virtual battlespace simulation;
- and
- configuring a model performing reinforcement learning related to task planning for each military unit based on the multi-agent reinforcement learning structure,
- wherein the multi-agent reinforcement learning structure is designed to include each agent reinforcement learning structure configured to correspond to each agent in order that each agent learns the task planning for each military unit, and
- wherein each agent reinforcement learning structure comprises:
- importance of each military unit based on information about each military unit identified through the virtual battlespace simulation;
- and
- a task selection network structure determining and selecting a task to be performed by each military unit based on the battlespace information among one or more tasks performable by each military unit in the virtual battlespace simulation,
- wherein the task selection network structure includes a selection network selecting the task to be performed by each military unit among the one or more tasks and one or more task networks respectively corresponding to the one or more tasks, and
- wherein when a specific task is selected among the one or more tasks by the selection network, a specific task network corresponding to the specific task among one or more task networks is activated and the activated specific task network is set to output input value information for performing the specific task.
An electronic apparatus configuring a model, the electronic apparatus comprising:
- a processor;
- and
- one or more memories configured to store one or more instructions,
- wherein the one or more instructions, when executed, control the processor to perform:
- designing a multi-agent reinforcement learning structure to perform reinforcement learning based on each agent configured to correspond to each military unit identified as a target of task planning in a virtual battlespace simulation;
- and
- configuring a model performing reinforcement learning related to task planning for each military unit based on the multi-agent reinforcement learning structure,
- wherein the multi-agent reinforcement learning structure is designed to include each agent reinforcement learning structure configured to correspond to each agent in order that each agent learns the task planning for each military unit, and
- wherein each agent reinforcement learning structure comprises:
- importance of each military unit based on information about each military unit identified through the virtual battlespace simulation;
- and
- a task selection network structure determining and selecting a task to be performed by each military unit based on the battlespace information among one or more tasks performable by each military unit in the virtual battlespace simulation,
- wherein the task selection network structure includes a selection network selecting the task to be performed by each military unit among the one or more tasks and one or more task networks respectively corresponding to the one or more tasks, and
- wherein when a specific task is selected among the one or more tasks by the selection network, a specific task network corresponding to the specific task among one or more task networks is activated and the activated specific task network is set to output input value information for performing the specific task.
Dependencies are inferred from the claim text.