# US 2021/0276484 A1 · Driver assist device and adaptive warning method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0276484 A1 - Document ID: US20210276484A1 - Status: Published application - Kind: A1 - Application number: 16/985,561 - Filed: 2020-08-05 - Published: 2021-09-09 - Earliest claimed: 2020-03-03 - Assignees: Hyundai Motor Company; Kia Motors Corporation - Applicants: Hyundai Motor Company; Kia Motors Corporation - Inventors: Dae Young Kim - Web page: https://patentgrep.com/patent/US20210276484A1 ## CPC - B60K 28/06: responsive to incapacity of driver - B60Q 9/00: Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 {, e.g. haptic signalling} - B60W 30/18163: {Lane change; Overtaking manoeuvres} - B60W 40/02: related to ambient conditions - B60W 40/08: related to drivers or passengers - B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention - B62D 1/06: Rims, e.g. with heating means; Rim covers (B62D1/11 takes precedence) - B62D 15/029: {Steering assistants using warnings or proposing actions to the driver without influencing the steering system} - B60W 2050/0073: {Driver overrides controller} - B60W 2050/143: {Alarm means} - B60W 2050/146: {Display means} - B60W 2540/22: Psychological state; Stress level or workload - B60W 2540/221: Physiology, e.g. weight, heartbeat, health or special needs - B60W 2540/225: Direction of gaze - B60W 2540/26: Incapacity - B60W 2555/00: Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00 - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT - B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M) ## Abstract A driver assist device and an adaptive waning method thereof are provided. The driver assist device includes a processor and a non-transitory storage medium containing program instructions executed by the processor. The processor detects outdoor and indoor information of a vehicle using a detector and determines a waning mode based on a traveling situation and a driver state identified through the detector when a warning-requiring situation is recognized during an operation of a driver assist function. A warning is then output based on the determined warning mode. ## Claims ### Claim 1 A driver assist device, comprising: a processor; and a non-transitory storage medium containing program instructions that, when executed by the processor causes the driver assist device to: detect outdoor information and indoor information of a vehicle using a detector; determine a warning mode based on a traveling situation and a driver state detected by the detector in response to detecting a warning-requiring situation during an operation of a driver assist function; and output a waning based on the determined warning mode. ### Claim 2 (depends on 1) The driver assist device of claim 1, wherein the processor is configured to: determine a visual warning when a driver gaze is forward in response to detecting a hands-off warning-requiring situation; and determine at least one of an auditory warning or a tactile warning together with the visual warning mode when the driver gaze is not forward. ### Claim 3 (depends on 1) The driver assist device of claim 1, wherein the processor is configured not to output the warning in a state in which a direction indicating signal is activated in a lane change direction or a steering wheel is gripped by the driver in response to detecting a lane change warning-requiring situation. ### Claim 4 (depends on 3) The driver assist device of claim 3, wherein the processor is configured to: determine a visual warning when the driver gaze is forward in a state in which the direction indicating signal is not activated in the lane change direction and the steering wheel is not gripped by the driver; and determine at least one of an auditory warning or a tactile warning together with the visual wanting when the driver gaze is not forward in the state in which the direction indicating signal is not activated in the lane change direction and the steering wheel is not gripped. ### Claim 5 (depends on 1) The driver assist device of claim 1, wherein the processor is configured to: determine a visual wanting when a driver gaze is forward in a state in which a steering wheel is not gripped by a driver in response to detecting a warning-requiring situation of deactivation or limit of the driver assist function; and determine at least one of an auditory warning or a tactile warning together with the visual wanting when the driver gaze is not forward in the state in which the steering wheel is not gripped. ### Claim 6 (depends on 1) The driver assist device of claim 1, wherein the processor is configured to determine at least one of an auditory warning or a tactile warning together with a visual warning when a driver gaze is not at a cut-in vehicle in response to detecting a cut-in vehicle warning-requiring situation. ### Claim 7 (depends on 1) The driver assist device of claim 1, wherein the processor is configured to: determine a visual wanting when a driver gaze is forward in response to detecting a forward-looking warning-requiring situation; and determine at least one of an auditory warning or a tactile warning together with the visual wanting when the driver gaze is not forward. ### Claim 8 (depends on 1) The driver assist device of claim 1, wherein the processor is configured to determine at least one of an auditory warning or a tactile warning together with a visual warning when the driver gaze is not forward in response to detecting an override warning-requiring situation. ### Claim 9 (depends on 1) The driver assist device of claim 1, wherein the processor is configured to: determine a visual warning when a driver gaze is directed at a side mirror in a direction matching a direction indicator input in response to detecting a diagonally-rearward warning-requiring situation; and determine at least one of an auditory warning or a tactile warning together with the visual warning when the driver gaze is not directed at the side mirror in the direction matching the direction indicator input. ### Claim 10 (depends on 1) The driver assist device of claim 1, wherein the processor is configured to, in response to determining that an in-vehicle noise level measured by the detector is equal to or greater than a preset reference noise level when outputting an auditory warning, adjust the output of the auditory warning or replace the auditory warning with a tactile warning and output the tactile warning. ### Claim 11 (depends on 1) The driver assist device of claim 1, wherein the processor is configured to additionally output at least one of an auditory warning or a tactile warning when a field of view of a driver is obstructed when outputting a visual warning. ### Claim 12 An adaptive warning method of a driver assist device, comprising: detecting, by a processor, a warning-requiring situation during an operation of a driver assist function; determining, by the processor, a warning mode based on a traveling situation and a driver state in response to detecting the warning-requiring situation; and outputting, by the processor, a warning based on the determined warning mode. ### Claim 13 (depends on 12) The method of claim 12, wherein the determining of the warning mode includes: determining, by the processor, a visual warning when a driver gaze is forward in a hands-off warning-requiring situation; and determining, by the processor, at least one of an auditory warning or a tactile warning together with the visual warning when the driver gaze is not forward. ### Claim 14 (depends on 12) The method of claim 12, wherein the determining of the warning mode includes: determining, by the processor, not to warn when a direction indicating signal is activated in a lane change direction or when a steering wheel is gripped by the driver in a lane change warning-requiring situation. ### Claim 15 (depends on 14) The method of claim 14, wherein the determining of the warning mode further includes: determining, by the processor, a visual warning when the driver gaze is forward in a state in which the direction indicating signal is not activated in the lane change direction and the steering wheel is not gripped by the driver; and determining at least one of an auditory warning or a tactile warning together with the visual waning when the driver gaze is not forward in the state in which the direction indicating signal is not activated in the lane change direction and the steering wheel is not gripped by the driver. ### Claim 16 (depends on 12) The method of claim 12, wherein the determining of the warning mode includes: determining, by the processor, a visual warning when a driver gaze is forward in a state in which a steering wheel is gripped by a driver in a warning-requiring situation of deactivation or limit of the driver assist function; and determining, by the processor, at least one of an auditory warning or a tactile warning together with the visual warning when the driver gaze is not forward in the state in which the steering wheel is not gripped by the driver. ### Claim 17 (depends on 12) The method of claim 12, wherein the determining of the warning mode includes: determining, by the processor, at least one of an auditory warning or a tactile warning together with a visual warning when a driver gaze is not directed at a cut-in vehicle in a cut-in vehicle warning-requiring situation. ### Claim 18 (depends on 12) The method of claim 12, wherein the determining of the warning mode includes: determining, by the processor, a visual warning when a driver gaze is forward in a forward-looking warning-requiring situation; and determining, by the processor, at least one of an auditory warning or a tactile warning together with the visual warning when the driver gaze is not forward. ### Claim 19 (depends on 12) The method of claim 12, wherein the determining of the warning mode includes: determining, by the processor, at least one of an auditory warning or a tactile warning together with a visual warning when the driver gaze is not forward in response to detecting an override warning-requiring situation. ### Claim 20 (depends on 12) The method of claim 12, wherein the determining of the warning mode includes: determining, by the processor, a visual warning when a driver gaze is directed at a side mirror in a direction matching a direction indicator input in a diagonally-rearward warning-requiring situation; and determining, by the processor, at least one of an auditory warning or a tactile warning together with the visual warning when the driver gaze is not directed at the side mirror in the direction matching the direction indicator input.