Method for generating vehicle controlling data, vehicle controller, vehicle control system, and learning device for vehicle

A method for generating vehicle controlling data, the method, comprising:

• when relationship specifying data that specifies a relationship between a state of a vehicle and an action variable, which is a variable related to operation of an electronic device mounted on the vehicle, is stored in a storage device,
• executing an operating process that operates the electronic device with processing circuitry;
• executing an obtaining process that obtains an area variable, which is a variable indicating an area in which the vehicle is located, a state of the vehicle based on a detection value of a sensor with the processing circuitry, and includes a value distinguishing between areas divided based on an average vehicle speed;
• executing a reward calculation process that assigns a reward based on the state of the vehicle obtained by the obtaining process with the processing circuitry, the reward being larger when a property of the vehicle meets a predetermined criterion and relatively smaller when the property of the vehicle does not meet the predetermined criterion;
• and
• executing an updating process that uses the state of the vehicle obtained by the obtaining process, a value of the action variable used for operation of the electronic device, and the reward corresponding to operation of the electronic device as inputs to a predetermined update mapping to update the relationship specifying data with the processing circuitry, wherein
• the update mapping is configured to output the relationship specifying data that is updated to increase an expected return of the reward when the electronic device is operated in accordance with the relationship specifying data, and
• the reward calculation process includes a changing process that changes a reward assigned when the area variable equals a second value indicating that the average vehicle speed is high and the property of the vehicle is a predetermined property from a reward assigned when the area variable equals a first value indicating that the average vehicle speed is low and the property of the vehicle is the predetermined property.