Neural network model for reaching a goal state
AssigneeInternational Business Machines Corporation
InventorKenton Jerome Lynne
Life of this patent
Estimating the term…
Loading patent…
AssigneeInternational Business Machines Corporation
InventorKenton Jerome Lynne
Estimating the term…
An object, such as a robot, is located at an initial state in a finite state space area and moves under the control of the unsupervised neural network model of the invention. The network instructs the object to move in one of several directions from the initial state. Upon reaching another state, the model again instructs the object to move in one of several directions. These instructions continue until either: a) the object has completed a cycle by ending up back at a state it has been to previously during this cycle, or b) the object has completed a cycle by reaching the goal state. Upon reaching a state, the neural network model calculates a level of satisfaction with its progress towards reaching the goal state. If the level of satisfaction is low, the neural network model is more likely to override what has been learned thus far and deviate from a path known to lead to the goal state to experiment with new and possibly better paths. If the level of satisfaction is high, the neural network model is much less likely to experiment with new paths. The object is guaranteed to eventually find the best path to the goal state from any starting location, assuming that the level of satisfaction does not exceed a threshold point where learning ceases.
A neural network model used to control the movement of an object amongst a plurality of states from a first state to a goal state, said model comprising:
A method for controlling the movement of an object amongst a plurality of states from a first state to a goal state, said method being performed through the aid of a neural network, said method comprising the steps of:
Dependencies are inferred from the claim text.