# US 2017/0364761 A1 · Apparatus and method for monitoring driver's concentrativeness using eye tracing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0364761 A1
- Document ID: US20170364761A1
- Status: Published application
- Kind: A1
- Application number: 15/333,584
- Filed: 2016-10-25
- Published: 2017-12-21
- Earliest claimed: 2016-06-21
- Assignees: Hyundai Motor Company
- Applicants: Hyundai Motor Company
- Inventors: Seong Sook RYU; Byoung Joon LEE; Jin Kwon KIM; Ho Choul JUNG; Sam Yong KIM
- Web page: https://patentgrep.com/patent/US20170364761A1

## CPC

- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- A61B 5/163: {by tracking eye movement, gaze, or pupil change}
- A61B 5/18: for vehicle drivers {or machine operators}
- B60K 35/20: Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/235: with means for detecting the driver's gaze direction or eye points
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- G06V 40/19: Sensors therefor
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/233: controlling the size or position in display areas of virtual images depending on the condition of the vehicle or the driver
- B60K 35/25: using haptic output
- B60K 35/26: using acoustic output
- B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence)
- B60K 35/80: Arrangements for controlling instruments
- B60K 2360/149: Instrument input by detecting viewing direction not otherwise provided for
- B60K 2360/178: Warnings
- B60W 2040/0818: {Inactivity or incapacity of driver}
- B60W 2540/22: Psychological state; Stress level or workload
- B60W 2540/26: Incapacity
- B60Y 2302/03: Actuating a signal or alarm device
- B60Y 2400/90: Driver alarms
- B60Y 2400/92: Driver displays
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60Y: INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY

## Abstract

Provided are an apparatus and method for monitoring driver's concentrativeness capable of monitoring whether a driver is concentratedly obtaining major information by tracing a driver's sight while a vehicle is running, in order to provide alarm to the driver when driver's concentrativeness is dropped at a time when the major information is changed while the vehicle is running.

## Claims

### Claim 1

An apparatus for monitoring driver's concentrativeness using eye tracing while a vehicle is running, the apparatus comprising:
a concentrativeness determiner determining in real time sight regions on which a driver keeps eyes while the vehicle is running and determining a sight concentrativeness value of each pixel corresponding to each sight region having a predetermined size in a front image to generate a concentrativeness map corresponding to the front image;
a region of interest (ROI) determiner determining an ROI requiring driver's concentrativeness having a level equal to or higher than a predetermined level, relative to a peripheral comparison region, in the front image; and
a concentrated state determiner determining whether the driver is in a concentrated state by comparing the ROI with the concentrativeness map corresponding to the front image.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the concentrativeness determiner determines a sight concentrativeness value of each pixel that respective sight concentrativeness values of pixels in each sight region are gradually reduced from a central vision portion positioned at the center of a sight direction of the driver to a peripheral vision portion therearound.

### Claim 3 (depends on 1)

The apparatus according to claim 1, wherein the concentrativeness determiner configures the concentrativeness map by determining each sight region of each image frame, generates the concentrativeness map by accumulating the sight concentrativeness value of each pixel during a predetermined number of frames, and attenuates the sight concentrativeness value of each pixel in every predetermined number of frames.

### Claim 4 (depends on 3)

The apparatus according to claim 3, wherein the concentrativeness determiner applies each weight value to a sight concentrativeness value of each pixel of a previous frame and a sight concentrativeness value of each pixel of a current frame and adds up the sight concentrativeness values to accumulate the sight concentrativeness values.

### Claim 5 (depends on 3)

The apparatus according to claim 3, wherein the concentrativeness determiner applies the same attenuation rate to the entire pixels to attenuate the sight concentrativeness values.

### Claim 6 (depends on 3)

The apparatus according to claim 3, wherein the concentrativeness determiner applies different attenuation rates according to a depth of each pixel on the basis of depth information of each pixel to attenuate the sight concentrativeness values.

### Claim 7 (depends on 1)

The apparatus according to claim 1, wherein the concentrated state determiner determines that the driver is in a concentrated state, in response to a determination that an average of sight concentrativeness values of pixels of the ROI is equal to or greater than a threshold value.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the concentrated state determiner determines that the driver is in a concentrated state, in response to a determination that sight concentrativeness values of pixels of the ROI are increased over time relative to concentrativeness values of the peripheral regions.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein the concentrated state determiner determines that the driver is in a concentrated state, in response to a determination that a distance between the center of pixels having a concentrativeness value equal to or greater than a threshold value and the center of the ROI is smaller than a predetermined value.

### Claim 10 (depends on 1)

The apparatus according to claim 1, wherein the concentrated state determiner provides alarm to the driver through an interface, in response to a determination that the concentrated state of the driver is changed to a non-concentrated state.

### Claim 11

A method for monitoring driver's concentrativeness using eye tracing while a vehicle is running, the method comprising:
determining in real time sight regions on which a driver keeps eyes while the vehicle is running and determining a sight concentrativeness value of each pixel corresponding to each sight region having a predetermined size in a front image to generate a concentrativeness map corresponding to the front image;
determining an ROI requiring driver's concentrativeness having a level equal to or higher than a predetermined level, relative to a peripheral comparison region, in the front image; and
determining whether the driver is in a concentrated state by comparing the ROI with the concentrativeness map corresponding to the front image.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the generating of the concentrativeness map comprises: determining the sight concentrativeness value of each pixel that respective sight concentrativeness values of pixels in each sight region are gradually reduced from a central vision portion positioned at the center of a sight direction of the driver to a peripheral vision portion therearound.

### Claim 13 (depends on 11)

The method according to claim 11, wherein the generating of the concentrativeness map comprises: configuring the concentrativeness map by determining each sight region of each image frame, generating the concentrativeness map by accumulating the sight concentrativeness value of each pixel during a predetermined number of frames, and attenuating the sight concentrativeness value of each pixel in every predetermined number of frames.

### Claim 14 (depends on 13)

The method according to claim 13, wherein each weight value is applied to a sight concentrativeness value of each pixel of a previous frame and a sight concentrativeness value of each pixel of a current frame and the sight concentrativeness values are added up to accumulate the sight concentrativeness values.

### Claim 15 (depends on 13)

The method according to claim 13, wherein the same attenuation rate is applied to the entire pixels in order to attenuate the sight concentrativeness values.

### Claim 16 (depends on 13)

The method according to claim 13, wherein different attenuation rates are applied according to a depth of each pixel on the basis of depth information of each pixel in order to attenuate the sight concentrativeness values.

### Claim 17 (depends on 11)

The method according to claim 11, wherein the determining of whether the driver is in a concentrated state comprises: determining, in response to a determination that an average of sight concentrativeness values of pixels of the ROI is equal to or greater than a threshold value, that the driver is in a concentrated state.

### Claim 18 (depends on 11)

The method according to claim 11, wherein the determining of whether the driver is in a concentrated state comprises: determining, in response to a determination that sight concentrativeness values of the pixels of the ROI are increased over time relative to concentrativeness values of the peripheral regions, that the driver is in a concentrated state.

### Claim 19 (depends on 11)

The method according to claim 11, wherein the determining of whether the driver is in a concentrated state comprises: determining, in response to a determination that a distance between the center of pixels having a concentrativeness value equal to or greater than a threshold value and the center of the ROI is smaller than a predetermined value, that the driver is in a concentrated state.

### Claim 20 (depends on 11)

The method according to claim 11, wherein the determining of whether the driver is in a concentrated state includes: providing, in response to a determination that the concentrated state of the driver is changed to a non-concentrated state, alarm to the driver through an interface.
