# US 10,504,237 B2 · Method for determining a viewing direction of a person

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,504,237 B2
- Document ID: US10504237B2
- Status: Granted
- Kind: B2
- Application number: 15/625,521
- Filed: 2017-06-16
- Published: 2017-10-05
- Granted: 2019-12-10
- Earliest claimed: 2014-12-17
- Assignees: Bayerische Motoren Werke Aktiengesellschaft
- Applicants: Bayerische Motoren Werke Aktiengesellschaft
- Inventors: Matthias Roland Kaufmann; Felix Schwarz
- Web page: https://patentgrep.com/patent/US10504237B2

## CPC

- G06T 7/73: using feature-based methods
- B60K 31/00: Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06T 7/50: Depth or shape recovery
- B60K 2360/149: Instrument input by detecting viewing direction not otherwise provided for
- B60K 2360/21: using cameras
- B60Q 9/00: Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 {, e.g. haptic signalling}
- G06T 2207/30201: Face
- G06T 2207/30268: Vehicle interior
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL

## Abstract

A method for determining a viewing direction of a person, such as a driver in a motor vehicle, is provided. The method includes detecting a surface contour of a surface of an eye of the person, ascertaining a normal vector on the surface of the eye depending on the detected surface contour, and determining the viewing direction of the person depending on the normal vector.

## Claims

### Claim 1

A method for determining a viewing direction of a person in a motor vehicle, the method comprising the acts of:
recording, by a camera, a head region of the person in the motor vehicle;
detecting a position of a head of the person based on said recording of the head region;
detecting an eye position of the person based on the detected position of the head of the person;
providing the detected eye position to a depth sensor;
acquiring, by the depth sensor, a surface contour of a surface of an eye of the person based on the detected eye position;
detecting a normal vector on the surface of the eye as a function of the acquired surface contour; and
determining the viewing direction of the person as a function of the normal vector.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the normal vector is detected as a function of a pupil region detected from the surface contour and a curvature of the pupil region.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the pupil region is determined as an elevation on the surface of the eye and the pupil region projects over a spherical surface of an apple of the eye.

### Claim 4 (depends on 2)

The method according to claim 2, wherein the normal vector at the center of the pupil region is detected as a function of the curvature at the center of the pupil region.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the viewing direction is determined by applying one or two correction angles to the normal vector, the one or more correction angles being determined by a calibration method.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the person is a driver of the motor vehicle.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the depth sensor is a TOF camera or a LIDAR sensor.