Back to results
US 2026/0087311 A1Published application
Controlling agents using ambiguity-sensitive neural networks and risk-sensitive neural networks
AssigneeDeepMind Technologies Limited
InventorsJordi Grau Moya, Gregoire Deletang, Markus Kunesch, Pedro Alejandro Ortega Caballero
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for controlling agents. In particular, an agent can be controlled using an action selection system that is risk-sensitive, ambiguity-sensitive, or both.
Claims20
A method for controlling an agent interacting with an environment, the method comprising:
- obtaining an observation;
- processing the observation using each action selection neural network in an ensemble of multiple action selection neural networks, each action selection neural network in the ensemble being configured to process an action selection input comprising the observation to generate a respective action selection output that defines a respective action selection policy for selecting an action from a set of actions in response to the observation;
- generating a meta-policy input from the respective action selection outputs generated by each of the action selection neural networks in the ensemble;
- processing the meta-policy input using a meta-policy neural network to generate a meta-policy output that defines a meta-policy for selecting an action from the set of actions in response to the observation;
- selecting an action from the set of actions using the meta-policy output;
- and
- causing the agent to perform the selected action.
4 more elements
A system comprising:
- one or more computers;
- and
- one or more storage devices communicatively coupled to the one or more computers, wherein the one or more storage devices store instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
- obtaining an observation;
- processing the observation using each action selection neural network in an ensemble of multiple action selection neural networks, each action selection neural network in the ensemble being configured to process an action selection input comprising the observation to generate a respective action selection output that defines a respective action selection policy for selecting an action from a set of actions in response to the observation;
- generating a meta-policy input from the respective action selection outputs generated by each of the action selection neural networks in the ensemble;
- processing the meta-policy input using a meta-policy neural network to generate a meta-policy output that defines a meta-policy for selecting an action from the set of actions in response to the observation;
- selecting an action from the set of actions using the meta-policy output;
- and
- causing the agent to perform the selected action.
7 more elements
One or more non-transitory computer storage media storing instructions that when executed by one or more computers cause the one or more computers to perform the operations comprising:
- obtaining an observation;
- processing the observation using each action selection neural network in an ensemble of multiple action selection neural networks, each action selection neural network in the ensemble being configured to process an action selection input comprising the observation to generate a respective action selection output that defines a respective action selection policy for selecting an action from a set of actions in response to the observation;
- generating a meta-policy input from the respective action selection outputs generated by each of the action selection neural networks in the ensemble;
- processing the meta-policy input using a meta-policy neural network to generate a meta-policy output that defines a meta-policy for selecting an action from the set of actions in response to the observation;
- selecting an action from the set of actions using the meta-policy output;
- and
- causing the agent to perform the selected action.
4 more elements
Dependencies are inferred from the claim text.