# US 2022/0284718 A1 · Driving analysis device and driving analysis method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284718 A1
- Document ID: US20220284718A1
- Status: Published application
- Kind: A1
- Application number: 17/826,403
- Filed: 2022-05-27
- Published: 2022-09-08
- Earliest claimed: 2019-12-02
- Assignees: Denso Corporation
- Applicants: Denso Corporation
- Inventors: Keisuke KUROKAWA; Kaname OGAWA
- Web page: https://patentgrep.com/patent/US20220284718A1

## CPC

- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- A61B 3/113: for determining or recording eye movement
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/265: {Voice}
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 35/654: {the user being the driver}
- B60W 40/09: Driving style or behaviour
- G06T 7/73: using feature-based methods
- G06T 7/74: {involving reference images or patches}
- G06T 7/77: using statistical methods
- G06T 11/26: Drawing of charts or graphs
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- G06V 10/766: using regression, e.g. by projecting features on hyperplanes
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G06V 40/18: Eye characteristics, e.g. of the iris
- G08G 1/16: Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08)
- B60K 35/65: Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
- B60K 2360/178: Warnings
- B60K 2360/1868: according to driving situations
- B60K 2360/21: using cameras
- B60K 2360/741: Instruments adapted for user detection
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20072: Graph-based image processing
- G06T 2207/20076: Probabilistic image processing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30201: Face
- G06T 2207/30268: Vehicle interior
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

In a driving analysis device, an information generation unit generates a time series of detection elements including a line-of-sight direction indicating to which of a plurality of preset viewable areas a line of sight of a driver driving a vehicle is oriented and an open/closed state of driver's eyes. An acquisition unit acquires evaluation data from the time series of the detection elements using a time window having a preset time width. An extraction unit extracts a plurality of feature quantities including at least a result of summation of appearance frequencies with respect to each of the detection elements from the evaluation data. An analysis unit analyzes a driver's tendency using a function that receives, as input, at least a part of the feature quantities extracted by the extraction unit.

## Claims

### Claim 1

A driving analysis device comprising:
an information generation unit configured to generate a time series of detection elements including a line-of-sight direction indicating to which of a plurality of preset viewable areas a line of sight of a driver driving a vehicle is oriented and an open/closed state of driver's eyes;
an acquisition unit configured to acquire evaluation data from the time series of the detection elements using a time window having a preset time width;
an extraction unit configured to extract a plurality of feature quantities including at least a result of summation of appearance frequencies with respect to each of the detection elements from the evaluation data; and
an analysis unit configured to analyze a driver's tendency using a function receiving, as input, at least a part of the feature quantities extracted by the extraction unit.

### Claim 2 (depends on 1)

The driving analysis device according to claim 1, further comprising:
a display part configured to display the at least the part of the feature quantities extracted by the extraction unit in a form of radar chart.

### Claim 3 (depends on 2)

The driving analysis device according to claim 2, wherein
the display part is configured to use, as a reference value shown in the radar chart, either a mean value of the feature quantities about an indefinite number of drivers or a mean value of the feature quantities about the driver as an analysis target of the driving analysis device acquired in past.

### Claim 4 (depends on 1)

The driving analysis device according to claim 1, wherein
the feature quantities extracted by the extraction unit include a value indicating a feature of state transition within an identical detection element or between the plurality of the detection elements.

### Claim 5 (depends on 1)

The driving analysis device according to claim 1, wherein
the analysis unit is configured to use, as the function, a regression function obtained using either a Random forest or Gradient Boosting.

### Claim 6 (depends on 5)

The driving analysis device according to claim 5,
wherein the analysis unit is configured to use at least a result of computation on two or more target feature quantities selected from the feature quantities as comparative data used for branch determination at each node in a regression tree used for generating the regression function, and
wherein, for the target feature quantities, the feature quantities that are identical in unit of value are selected.

### Claim 7 (depends on 1)

The driving analysis device according to claim 1, wherein
the analysis unit is configured to use either a support vector machine or a neural network as the function.

### Claim 8

A driving analysis method comprising:
generating a time series of detection elements, the detection elements including a line-of-sight direction indicating to which of a plurality of preset viewable areas a line of sight of a driver driving a vehicle is oriented and an open/closed state of driver's eyes;
acquiring evaluation data from the time series of the detection elements using a time window having a preset time width;
extracting a plurality of feature quantities including at least a result of summation of appearance frequencies with respect to each of the detection elements from the evaluation data; and
analyzing a driver's tendency by using a function receiving, as input, at least a part of the feature quantities extracted.

### Claim 9

A driving analysis device comprising:
a processor and a memory configured to:
generate a time series of detection elements including a line-of-sight direction indicating to which of a plurality of preset viewable areas a line of sight of a driver driving a vehicle is oriented and an open/closed state of driver's eyes;
acquire evaluation data from the time series of the detection elements using a time window having a preset time width;
extract a plurality of feature quantities including at least a result of summation of appearance frequencies with respect to each of the detection elements from the evaluation data; and
analyze a driver's tendency using a function receiving, as input, at least a part of the feature quantities extracted.
