Vehicle control system, vehicle controller, vehicle learning device, vehicle control method, and memory medium

A vehicle control method that is performed by a memory device, a first execution device, and a second execution device, the first execution device being mounted on a vehicle, and the second execution device being an out-of-vehicle device, the vehicle control method comprising:

• using the memory device to store relationship defining data that defines a relationship between a state of a vehicle and an action variable related to an operation of an electronic device in the vehicle;
• causing the first execution device and the second execution device to cooperate to:
• obtain a detection value of a sensor that detects the state of the vehicle,
• operate the electronic device,
• based on the obtained detection value, provide a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard,
• update the relationship defining data by inputting, to a predetermined update map, the state of the vehicle based on the obtained detection value, a value of the action variable used to operate the electronic device, and the reward corresponding to the operation of the electronic device,
• obtain information related to the vehicle, and
• classify vehicles that include the vehicle into groups based on the information related to the vehicle,
• using the first execution device at least to obtain the detection value and operate the electronic device,
• using the second execution device at least to:
• update the relationship defining data,
• obtain information related to the vehicle, and
• classify the vehicles into the groups, wherein
• the operating the electronic device includes operating the electronic device in accordance with the updated relationship defining data and the state of the vehicle,
• the update map outputs the updated relationship defining data so as to increase an expected return of the reward of a case in which the electronic device is operated in accordance with the relationship defining data, and
• in order to update the relationship defining data for each of the classified groups, the relationship defining data is updated by the second execution device, which inputs, into the update map, the states of the vehicles belonging to a same group, the values of the action variables used to operate the electronic devices of the vehicles belonging to the same group, and the rewards corresponding to the operation of the electronic devices.

A non-transitory computer readable medium storing a program that causes a memory device, a first execution device, and a second execution device to execute a vehicle control process, the first execution device being mounted on a vehicle, and the second execution device being an out-of-vehicle device, the vehicle control process comprising:

• using the memory device to store relationship defining data that defines a relationship between a state of a vehicle and an action variable related to an operation of an electronic device in the vehicle;
• causing the first execution device and the second execution device to cooperate to obtain a detection value of a sensor that detects the state of the vehicle, operate the electronic device,
• based on the obtained detection value, provide a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard,
• update the relationship defining data by inputting, to a predetermined update map, the state of the vehicle based on the obtained detection value, a value of the action variable used to operate the electronic device, and the reward corresponding to the operation of the electronic device,
• obtain information related to the vehicle, and
• classify vehicles that include the vehicle into groups based on the information related to the vehicle,
• using the first execution device at least to obtain the detection value and operate the electronic device,
• using the second execution device at least to:
• update the relationship defining data,
• obtain information related to the vehicle, and
• classify the vehicles into the groups, wherein
• the operating the electronic device includes operating the electronic device in accordance with the updated relationship defining data and the state of the vehicle,
• the update map outputs the updated relationship defining data so as to increase an expected return of the reward of a case in which the electronic device is operated in accordance with the relationship defining data, and
• in order to update the relationship defining data for each of the classified groups, the relationship defining data is updated by the second execution device, which inputs, into the update map, the states of the vehicles belonging to a same group, the values of the action variables used to operate the electronic devices of the vehicles belonging to the same group, and the rewards corresponding to the operation of the electronic devices.