Route guidance device and route guidance system based on augmented reality and mixed reality

A route guidance device comprising:

• a communication unit that communicates with a cloud server;
• an interface unit that receives, from at least one sensor disposed in a vehicle, an environment image around the vehicle including an image of a road on which the vehicle is traveling, and sensing information obtained by sensing a traveling state of the vehicle;
• an Augmented Reality (AR) module that renders AR information including at least one of the sensing information and Point Of Interest (POI) information received from the cloud server;
• a Mixed Reality (MR) module that renders MR information including at least one virtual object, based on the sensing information and map information received from the cloud server;
• and
• a processor that controls the interface unit so that an AR view image including the AR information or an MR view image including the MR information is displayed on a display of the vehicle, and controls the interface unit so that a second view image of the AR view image and the MR view image is displayed on a portion of an area of the display where a first view image of the AR view image and the MR view image is displayed based on whether the vehicle enters a specific situation,
• wherein the cloud server comprises:
• a Digital Twin as a Service (DTaaS) server providing digital-twin 3D map information including virtual objects corresponding to respective buildings included in a map area;
• an MR server that performs communication connection with the route guidance device, provides location information related to the vehicle, collected from the route guidance device, to the DTaaS server, and provides the digital-twin 3D map information provided by the DTaaS server to the route guidance device;
• and
• an AR server that receives the location information related to the vehicle, provided from the route guidance device and the sensing information, and provides Point of Interest (POI) information corresponding to the received information to the route guidance device.