# US 2017/0287163 A1 · Method for Determining a Viewing Direction of a Person

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0287163 A1
- Document ID: US20170287163A1
- Status: Published application
- Kind: A1
- Application number: 15/625,521
- Filed: 2017-06-16
- Published: 2017-10-05
- Earliest claimed: 2014-12-17
- Assignees: Bayerische Motoren Werke Aktiengesellschaft
- Applicants: Bayerische Motoren Werke Aktiengesellschaft
- Inventors: Matthias Roland KAUFMANN; Felix SCHWARZ
- Web page: https://patentgrep.com/patent/US20170287163A1

## CPC

- G06T 7/73: using feature-based methods
- B60K 31/00: Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06T 7/50: Depth or shape recovery
- B60K 2360/149: Instrument input by detecting viewing direction not otherwise provided for
- B60K 2360/21: using cameras
- B60Q 9/00: Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 {, e.g. haptic signalling}
- G06T 2207/30201: Face
- G06T 2207/30268: Vehicle interior
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL

## Abstract

A method for determining a viewing direction of a person, such as a driver in a motor vehicle, is provided. The method includes detecting a surface contour of a surface of an eye of the person, ascertaining a normal vector on the surface of the eye depending on the detected surface contour, and determining the viewing direction of the person depending on the normal vector.

## Claims

### Claim 1

A method for determining a viewing direction of a person, the method comprising the acts of:
acquiring a surface contour of a surface of an eye of the person;
detecting a normal vector on the surface of the eye as a function of the acquired surface contour; and
determining the viewing direction of the person as a function of the normal vector.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the act of acquiring the surface contour of the surface of the eye of the person is performed by a depth sensor.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the normal vector is detected as a function of a pupil region detected from the surface contour and a curvature of the pupil region.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the pupil region is determined as an elevation on the surface of the eye and the pupil region projects over a spherical surface of an apple of the eye.

### Claim 5 (depends on 3)

The method according to claim 3, wherein the normal vector at the center of the pupil region is detected as a function of the curvature at the center of the pupil region.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the step of acquiring the surface contour of the surface of the eye includes acquiring the position of the eye via another camera and acquiring the surface contour by the position of the eye.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the viewing direction is determined by applying one or two correction angles to the normal vector, the one or more correction angles being determined by a calibration method.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the person is a driver in a motor vehicle.

### Claim 9 (depends on 2)

The method according to claim 2, wherein the depth sensor is a TOF camera or a LIDAR sensor.

### Claim 10

A viewing direction detection system for determining a viewing direction of a person comprising:
a depth sensor that acquires a surface contour of a surface of an eye of the person; and
a control unit for executing stored instructions to:
detect a normal vector on the surface of the eye as a function of the acquired surface contour, and
determine the viewing direction of the person as a function of the normal vector.

### Claim 11 (depends on 10)

The viewing direction detection system according to claim 10, further comprising an additional device for determining the viewing direction of the person, wherein the control unit uses an additional viewing direction acquired by the additional device to provide the viewing direction of the person.

### Claim 12 (depends on 10)

The viewing direction detection system according to claim 10, wherein the viewing direction detection system is included in a motor vehicle in order to detect the viewing direction of a driver in a motor vehicle.
