Fast exploration and learning of latent graph models
AssigneeDeepMind Technologies Limited
InventorsSivaramakrishnan Swaminathan, Meet Kirankumar Dave, Miguel Lazaro-Gredilla, Dileep George
Life of this patent
Estimating the term…
Loading patent…
AssigneeDeepMind Technologies Limited
InventorsSivaramakrishnan Swaminathan, Meet Kirankumar Dave, Miguel Lazaro-Gredilla, Dileep George
Estimating the term…
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a graph model representing an environment being interacted with by an agent. In one aspect, one of the methods include: obtaining experience data; using the experience data to update a visitation count for each of one or more state-action pairs represented by the graph model; and at each of multiple environment exploration steps: computing a utility measure for each of the one or more state-action pairs represented by the graph model; determining, based on the utility measures, a sequence of one or more planned actions that have an information gain that satisfies a threshold; and controlling the agent to perform the sequence of one or more planned actions to cause the environment to transition from a state characterized by a last observation received after a last action in the experience data into a different state.
(canceled)
A method performed by one or more computers, wherein the method comprises:
A method performed by one or more computers for exploring an environment being interacted with by an agent, wherein the method comprises:
A method performed by one or more computers, wherein the method comprises:
Dependencies are inferred from the claim text.