Data processing device, data processing method, and program

A data processing method of a data processing device, comprising:

• calculating a state value having a predetermined state of a state transition model, in which a state is transited by an action performed by an agent that can act, set as a reference, of which the value increases as much as a state with a high transition probability to a state close to the predetermined state, for each state of the state transition model based on the state transition model of each action;
• calculating an action value, of which the value increases as a transition probability to a state with a high state value having the predetermined state set as a reference increases, for each state of the state transition model and each action that the agent can perform, based on the state transition model and the state value having the predetermined state set as a reference;
• setting a state with great unevenness in the action value among states of the state transition model to a target state that is the target to reach by an action performed by the agent, based on the action value;
• and
• selecting an action of the agent so as to move toward the target state.

A program causing a computer to function as:

• a state value calculation unit which calculates a state value having a predetermined state of a state transition model, in which a state is transited by an action performed by an agent that can act, set as a reference, of which the value increases as much as a state with a high transition probability to a state close to the predetermined state, for each state of the state transition model based on the state transition model of each action;
• an action value calculation unit which calculates an action value, of which the value increases as a transition probability to a state with a high state value having the predetermined state set as a reference increases, for each state of the state transition model and each action that the agent can perform, based on the state transition model and the state value having the predetermined state set as a reference;
• a target state setting unit which sets a state with great unevenness in the action value among states of the state transition model to a target state that is the target to reach by action performed by the agent, based on the action value;
• and
• an action selection unit which selects an action of the agent so as to move toward the target state.