Vulnerable road user highlighting on hybrid augmented reality head-up displays

A system comprising:

• data processing hardware;
• and
• memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
• receiving sensor data detected by a sensor system of a vehicle, the sensor data including one or more data fragments located outside of a line of sight of a driver of the vehicle;
• classifying, based on the sensor data, the one or more data fragments as a vulnerable road user;
• determining, based on the sensor data, classification characteristics of the vulnerable road user, the classification characteristics including at least one of a specific type of the vulnerable road user or a responsibility level of the vulnerable road user indicating distraction or lack of safety gear;
• determining, based on the sensor data, location data of the vulnerable road user;
• assessing a threat level between the vulnerable road user and the vehicle based on the classification characteristics and the location data of the vulnerable road user and vehicle data of the vehicle;
• and
• based on the threat level of the vulnerable road user, displaying, via head-up displays, a graphical alert alerting the driver of the vehicle to the vulnerable road user, the graphical alert including an augmented reality image overlay and a virtual image, the augmented reality image overlay different from the virtual image.