# US 2021/0171067 A1 · Apparatus for determining hands-on based on motion recognition, sytem including the same, and vehicle control method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0171067 A1
- Document ID: US20210171067A1
- Status: Published application
- Kind: A1
- Application number: 16/904,209
- Filed: 2020-06-17
- Published: 2021-06-10
- Earliest claimed: 2019-12-04
- Assignees: Hyundai Motor Company; Kia Motors Corporation
- Applicants: Hyundai Motor Company; Kia Motors Corporation
- Inventors: Min Chul KANG
- Web page: https://patentgrep.com/patent/US20210171067A1

## CPC

- B60W 40/08: related to drivers or passengers
- B60W 60/0059: {Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity}
- B60K 28/06: responsive to incapacity of driver
- B60W 40/09: Driving style or behaviour
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- B60W 2040/0818: {Inactivity or incapacity of driver}
- B60W 2050/143: {Alarm means}
- B60W 2050/146: {Display means}
- B60W 2540/223: Posture, e.g. hand, foot, or seat position, turned or inclined
- B60W 2540/225: Direction of gaze
- B60W 2555/20: Ambient conditions, e.g. wind or rain
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A hands-on determination device, a system including the same, and a vehicle control method thereof are provided. The hands-on determination device includes a processor that determines a hands-on state of a driver through motion recognition and determines whether to use a result of determination of the hands-on state based on at least one of a weather condition, a condition for validity of motion sensing, classification of a driving road, a vehicle control state, or a driver state and a storage storing data for motion recognition.

## Claims

### Claim 1

A hands-on determination device, comprising:
a processor configured to determine a hands-on state of a driver through motion recognition; and
determine whether to use a result of determination of the hands-on state based on at least one of a weather condition, a condition for validity of motion sensing, classification of a driving road, a vehicle control state, or a driver state; and
a storage configured to store data for the motion recognition.

### Claim 2 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to:
determine a current state as the hands-on state when hands of the driver are located within a predetermined range.

### Claim 3 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to:
classify the weather condition as good in weather, normal in weather, or poor in weather;
classify the validity of the motion sensing as good in sensing time, insufficient in sensing time, good in sensing zone, or poor in sensing zone;
classify the classification of the driving road as an urban expressway without traffic lights, a city street with traffic lights, or a special section road;
classify the vehicle control state as a situation where a lane change is not controlled, in-lane driving on a gentle curve, a situation where a lane change is controlled, a braking and acceleration command by the driver, or in-lane driving on a sharp curve; and
classify the driver state as stable in gaze, unstable in gaze, or normal in gaze determination.

### Claim 4 (depends on 1)

The hands-on determination device of claim 1,
wherein the processor is configured to apply the result of determination of the hands-on state to vehicle control when:
the weather condition is good or poor in weather,
the condition for the validity of the motion sensing is one of being good in sensing time, being good in sensing zone, or being insufficient in sensing time,
the driving road is an urban expressway without traffic lights or a city street with traffic lights,
the vehicle control state is a situation where a lane change is not controlled or in-lane driving on a gentle curve, and
the driver state is always stable in gaze.

### Claim 5 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to apply the result of determination of the hands-on state to vehicle control after a predetermined amount of monitoring time when:
the weather condition is good or normal in weather,
the condition for the validity of the motion sensing is one of being good in sensing time, being good in sensing zone, or being insufficient in sensing time,
the driving road is an urban expressway without traffic lights or a city street with traffic lights, and
the vehicle control state is a braking and acceleration command by the driver or a situation where a lane change is controlled in a state where the driver state is stable in gaze.

### Claim 6 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to apply the result of determination of the hands-on state to vehicle control after a predetermined amount of monitoring time when:
the condition for the validity of the motion sensing is one of being good in sensing time, being good in sensing zone, or being insufficient in sensing time,
the driving road is an urban expressway without traffic lights or a city street with traffic lights,
the vehicle control state is one of a situation where a lane change is not controlled, in-lane driving on a gentle curve, or a situation where a lane change is controlled, and
the driver state is normal in gaze determination.

### Claim 7 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to postpone substituting a hands-on signal based on motion recognition when:
the weather condition is good or normal in weather,
the condition for the validity of the motion sensing is one of being good in sensing time, being good in sensing zone, or being insufficient in sensing time,
the driving road is an urban expressway without traffic lights or a city street with traffic lights,
the driver state is stable in gaze or is normal in gaze determination, and
the vehicle control state is a braking and acceleration command by the driver or in-lane driving on a sharp curve.

### Claim 8 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to postpone substituting a hands-on signal based on motion recognition when:
the weather condition is good or normal in weather,
the condition for the validity of the motion sensing is insufficient in sensing time,
the driving road is an urban expressway without traffic lights, the driver state is always stable in gaze, and
the vehicle control state is a situation where a lane change is controlled.

### Claim 9 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to postpone substituting a hands-on signal based on motion recognition when:
the weather condition is good or normal in weather,
the condition for the validity of the motion sensing is poor in sensing zone,
the driving road is an urban expressway without traffic lights or a city street with traffic lights,
the vehicle control state is one of a situation where a lane change is not controlled, in-lane driving on a gentle curve, a situation where a lane change is controlled, a braking and acceleration command by the driver, or in-lane driving on sharp curve, and
the driver state is stable in gaze or is normal in gaze determination.

### Claim 10 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to postpone substituting a hands-on signal based on motion recognition when:
the weather condition is good in weather,
the condition for the validity of the motion sensing is poor in sensing zone,
the driving road is an urban expressway without traffic lights,
the vehicle control state is a situation where a lane change is not controlled, and
the driver state is unstable in gaze.

### Claim 11 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to postpone substituting a hands-on signal based on motion recognition when:
the weather condition is good or normal in weather,
the condition for the validity of the motion sensing is good in sensing time and is good in sensing zone,
the driving road is a special section road,
the vehicle control state is one of a situation where a lane change is not controlled, in-lane driving on a gentle curve, a situation where a lane change is controlled, a braking and acceleration command by the driver, or in-lane driving on a sharp curve, and
the driver state is stable in gaze or is normal in gaze determination.

### Claim 12 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to:
when the weather condition is poor in weather, determine that it is impossible to substitute a hands-on signal based on motion recognition and notify the driver of the determination, irrespective of the other conditions.

### Claim 13 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to:
when the driver state is unstable in gaze, determine that it is impossible to substitute a hands-on signal based on motion recognition, irrespective of the other conditions; and
postpone substituting a hands-on signal based on motion recognition although the driver state is unstable in gaze, when:
the weather is good,
the sensing zone is poor,
there is an urban expressway without traffic lights, and
a lane change is not controlled.

### Claim 14 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to determine that it is impossible to substitute a hands-on signal based on motion recognition when:
the weather condition is good or normal in weather,
the condition for the validity of the motion sensing is insufficient in sensing time and is poor in sensing zone,
the driving road is a special section road,
the vehicle control state is one of a situation where a lane change is not controlled, in-lane driving on a gentle curve, a situation where a lane change is controlled, a braking and acceleration command by the driver, or in-lane driving on a sharp curve, and
the driver state is stable in gaze or is normal in gaze determination.

### Claim 15 (depends on 1)

The hands-on determination device of claim 1, wherein the processor is configured to determine that it is impossible to substitute a hands-on signal based on motion recognition when:
the weather condition is poor in weather,
the driving road is a special section road,
the vehicle control state is a braking and acceleration command by the driver or in-lane driving on a sharp curve, or
the driver state is unstable in gaze where the condition for the validity of the motion sensing is poor in sensing zone.

### Claim 16

A vehicle system, comprising:
a hands-on determination device configured to:
determine a hands-on state of a driver through motion recognition; and
determine whether to use a result of determination of the hands-on state based on at least one of a weather condition, a condition for validity of motion sensing, classification of a driving road, a vehicle control state, or a driver state; and
a vehicle controller configured to control a vehicle based on the result of the determination.

### Claim 17

A vehicle control method, comprising:
determining a hands-on state of a driver through motion recognition;
determining whether to use a result of determination of the hands-on state based on at least one of a weather condition, a condition for validity of motion sensing, classification of a driving road, a vehicle control state, or a driver state; and
controlling a vehicle based on the result of the determination.

### Claim 18 (depends on 17)

The vehicle control method of claim 17, wherein the determining of the hands-on state includes:
determining a current state as a hands-on state when the hands of the driver are located within a predetermined range.

### Claim 19 (depends on 17)

The vehicle control method of claim 17, wherein the controlling of the vehicle includes:
applying the result of the determination of the hands-on state based on motion recognition immediately to vehicle control when:
the weather condition is good or poor in weather,
the condition for the validity of the motion sensing is one of being good in sensing time, being good in sensing zone, or being insufficient in sensing time,
the driving road is an urban expressway without traffic lights or a city street with traffic lights,
the vehicle control state is a situation where a lane change is not controlled or in-lane driving on a gentle curve, and
the driver state is always stable in gaze.

### Claim 20 (depends on 17)

The vehicle control method of claim 17, wherein the controlling of the vehicle includes:
applying the result of the determination of the hands-on state based on motion recognition to vehicle control after a predetermined amount of monitoring time when:
the weather condition is good or normal in weather,
the condition for the validity of the motion sensing is one of being good in sensing time, being good in sensing zone, or being insufficient in sensing time,
the driving road is an urban expressway without traffic lights or a city street with traffic lights, and
the vehicle control state is a braking and acceleration command by the driver or a situation where a lane change is controlled in a state where the driver state is stable in gaze.
