Smart vehicle control device and method
AssigneesHyundai Motor Company, Kia Corporation
InventorSanghyun Hwang
Life of this patent
Estimating the term…
Abstract
Provided is a smart vehicle control device including: a user input receiver receiving a user input from a user terminal through a digital key application; a vehicle input receiver receiving a vehicle input input from a vehicle by a user boarding on the vehicle; a reinforcement learning model generating a vehicle control policy for vehicle driving preparation through reinforcement learning based on the user input and the vehicle input; and a vehicle controller configured for controlling the vehicle based on the vehicle control policy.
Claims13
A smart vehicle control apparatus comprising:
- one or more memory devices configured to store program codes;
- and
- one or more processors configured to execute the program codes to perform operations comprising:
- receiving a user input from a user terminal through a digital key application;
- receiving a vehicle input from a vehicle by a user boarding in the vehicle;
- generating a vehicle control policy for vehicle driving preparation through a reinforcement learning model based on the user input and the vehicle input;
- and
- controlling the vehicle based on the vehicle control policy,
- wherein the generating a vehicle control policy for vehicle driving preparation through the reinforcement learning model comprising:
- upon receiving a user answer to a question related to the vehicle driving preparation provided to the user through the digital key application, updating an initial vehicle control policy by performing reinforcement learning based on a first state and a first reward, generated based on the received answer,
- upon receiving a real-time user input related to the vehicle driving preparation through the digital key application, updating the initial vehicle control policy by performing the reinforcement learning model based on a second state and a second reward, generated based on the real-time user input,
- upon receiving the vehicle input which is input from the vehicle by the user boarding in the vehicle, updating the initial vehicle control policy by performing the reinforcement learning based on a third state and a third reward, generated based on the vehicle input, and
- generating the vehicle control policy by repeatedly updating the initial vehicle control policy for reward including the first, second, and third rewards to include a maximum value,
- wherein the first reward includes a value less than zero, the third reward is a minimum negative value, the second reward is a median negative value, and the first reward is a maximum negative value.
A smart vehicle control method performed by a computing device including a processor and a memory, the method comprising:
- receiving, by the processor, a user input from a user terminal through a digital key application;
- receiving, by the processor, a vehicle input from a vehicle by a user boarding on the vehicle;
- performing, by the processor, reinforcement learning based on the user input and the vehicle input by use of a reinforcement learning model, and generating, by the smart vehicle control device, a vehicle control policy for vehicle driving preparation;
- and
- controlling, by the processor, the vehicle based on the vehicle control policy,
- wherein the performing, by the processor, the reinforcement learning based on the user input and the vehicle input by use of the reinforcement learning model, and generating, by the smart vehicle control device, a vehicle control policy for vehicle driving preparation comprising:
- upon receiving a user answer to a question related to the vehicle driving preparation provided to the user through the digital key application, updating an initial vehicle control policy by performing the reinforcement learning model based on a first state and a first reward, generated based on the received answer,
- upon receiving a real-time user input related to the vehicle driving preparation through the digital key application, updating an initial vehicle control policy by performing the reinforcement learning based on a second state and a second reward, generated based on the real-time user input,
- upon receiving the vehicle input which is input from the vehicle by the user boarding in the vehicle, updating the initial vehicle control policy by performing the reinforcement learning based on a third state and a third reward, generated based on the vehicle input, and
- generating the vehicle control policy by repeatedly updating the initial vehicle control policy for reward including the first, second, and third rewards to include a maximum value,
- wherein the first reward includes a value less than zero, the third reward is a minimum negative value, the second reward is a median negative value, and the first reward is a maximum negative value.
Dependencies are inferred from the claim text.