Back to results
US 11,453,375 B2Granted
Vehicle controller, vehicle control system, vehicle learning device, vehicle control method, and memory medium
AssigneeToyota Jidosha Kabushiki Kaisha
InventorsYosuke Hashimoto, Akihiro Katayama, Yuta Oshiro, Kazuki Sugie, Naoya Oka
Life of this patent
Estimating the term…
Abstract
A vehicle controller, a vehicle control system, a vehicle learning device, a vehicle control method, and a memory medium are provided. A switching process switches relationship defining data used in an operation process to post-measure data, when a detection process detects that a functional recovery measure has been taken. The switching process includes a process that uses, as the post-measure data, initial data that is the relationship defining data of a state before an update process is executed as the vehicle travels.
Claims10
A vehicle controller, comprising:
- a memory configured to store relationship defining data that defines a relationship between a state of a vehicle that includes at least one of an internal combustion engine and a rotating electric machine and an action variable related to an operation of an operated unit of the at least one of the internal combustion engine and the rotating electric machine;
- and
- circuitry configured to execute:
- an obtaining process that obtains a detection value of a sensor that detects the state of the vehicle,
- an operation process that operates the operated unit of the at least one of the internal combustion engine and the rotating electric machine based on a value of the action variable that is determined by the detection value obtained by the obtaining process and the relationship defining data,
- a reward calculating process that provides, based on the detection value obtained by the obtaining process, a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard,
- an update process that updates the relationship defining data by inputting, to a predetermined update map, the state of the vehicle based on the detection value obtained by the obtaining process, the value of the action variable used to operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine, and the reward corresponding to the operation of the operated unit of the at least one of the internal combustion engine and the rotating electric machine,
- a detection process that detects that a functional recovery measure has been taken for a component in the vehicle that affects the state of the vehicle created by the operation process, and
- a switching process that switches the relationship defining data used in the operation process to post-measure data, when the detection process detects that the functional recovery measure has been taken,
- the update map outputs the updated relationship defining data so as to increase an expected return of the reward of a case in which the operated unit of the at least one of the internal combustion engine and the rotating electric machine is operated in accordance with the relationship defining data, and
- the switching process includes a process that uses, as the post-measure data, initial data that is the relationship defining data of a state before the update process is executed as the vehicle travels.
8 more elements
A vehicle control method comprising:
- using a memory to store relationship defining data that defines a relationship between a state of a vehicle that includes at least one of an internal combustion engine and a rotating electric machine and an action variable related to an operation of an operated unit of the at least one of the internal combustion engine and the rotating electric machine in the vehicle;
- and
- using circuitry to:
- obtain a detection value of a sensor that detects the state of the vehicle,
- operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine based on a value of the action variable that is determined by the obtained detection value and the relationship defining data,
- based on the obtained detection value, provide a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard,
- update the relationship defining data by inputting, to a predetermined update map, the state of the vehicle based on the obtained detection value, a value of the action variable used to operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine, and the reward corresponding to the operation of the operated unit of the at least one of the internal combustion engine and the rotating electric machine,
- detect that a functional recovery measure has been taken for a component in the vehicle that affects the state of the vehicle created by the operated unit of the at least one of the internal combustion engine and the rotating electric machine, and
- switch the relationship defining data used to operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine to post-measure data, when it is detected that the functional recovery measure has been made, wherein
- the update map outputs the updated relationship defining data so as to increase an expected return of the reward of a case in which the operated unit of the at least one of the internal combustion engine and the rotating electric machine is operated in accordance with the relationship defining data, and
- the switching the relationship defining data includes using, as the post-measure data, initial data that is the relationship defining data of a state before the relationship defining data is updated as the vehicle travels.
8 more elements
A non-transitory computer readable medium that stores a program for causing a controller to execute a vehicle control process, the vehicle control process comprising:
- a memory to store relationship defining data that defines a relationship between a state of a vehicle that includes at least one of an internal combustion engine and a rotating electric machine and an action variable related to an operation of an operated unit of the at least one of the internal combustion engine and the rotating electric machine in the vehicle;
- and
- using circuitry to:
- obtain a detection value of a sensor that detects the state of the vehicle,
- operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine based on a value of the action variable that is determined by the obtained detection value and the relationship defining data,
- based on the obtained detection value, provide a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard,
- update the relationship defining data by inputting, to a predetermined update map, the state of the vehicle based on the obtained detection value, a value of the action variable used to operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine, and the reward corresponding to the operation of the operated unit of the at least one of the internal combustion engine and the rotating electric machine,
- detect that a functional recovery measure has been taken for a component in the vehicle that affects the state of the vehicle created by the operated unit of the at least one of the internal combustion engine and the rotating electric machine, and
- switch the relationship defining data used to operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine to post-measure data, when it is detected that the functional recovery measure has been made, wherein
- the update map outputs the updated relationship defining data so as to increase an expected return of the reward of a case in which the operated unit of the at least one of the internal combustion engine and the rotating electric machine is operated in accordance with the relationship defining data, and
- the switching the relationship defining data includes using, as the post-measure data, initial data that is the relationship defining data of a state before the relationship defining data is updated as the vehicle travels.
8 more elements
Dependencies are inferred from the claim text.