# US 2019/0094854 A1 · Ocular navigation of unmanned aerial vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0094854 A1
- Document ID: US20190094854A1
- Status: Published application
- Kind: A1
- Application number: 15/716,594
- Filed: 2017-09-27
- Published: 2019-03-28
- Earliest claimed: 2017-09-27
- Assignees: Intel IP Corporation
- Applicants: Intel IP Corporation
- Inventors: Thomas Seiler; Daniel Pohl; Stefan Menzel
- Web page: https://patentgrep.com/patent/US20190094854A1

## CPC

- G05D 1/0038: {by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation (images analyzed by a computer and used for automatic navigation G05D1/0246)}
- G05D 1/0016: {characterised by the operator's input device (input arrangements for computing systems in general G06F3/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- B64U 10/14: with four distinct rotor axes, e.g. quadcopters
- B64U 2101/30: for imaging, photography or videography
- B64U 2201/20: Remote controls
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR

## Abstract

Herein is disclosed an unmanned aerial vehicle navigation system including one or more cameras configured to detect user image data; and one or more processors configured to determine from the user image data a user eye orientation; select according to a selection criterion a navigation behavior based on the user eye orientation; and determine a navigation instruction to cause the unmanned aerial vehicle to travel in accordance with the navigation behavior.

## Claims

### Claim 1

An unmanned aerial vehicle navigation system comprising:
one or more cameras configured to detect user image data; and
one or more processors configured to
determine from the user image data a user eye orientation;
select according to a selection criterion a navigation behavior based on the user eye orientation; and
determine a navigation instruction to cause the unmanned aerial vehicle to travel in accordance with the navigation behavior.

### Claim 2 (depends on 1)

The unmanned aerial vehicle navigation system of claim 1, further comprising a display, configured to display image data received from the unmanned aerial vehicle, wherein the one or more processors map the user eye orientation to a region of the display.

### Claim 3 (depends on 2)

The unmanned aerial vehicle navigation system of claim 2, wherein the mapped display region corresponds to an object; the navigation behavior is navigation toward the object; and the navigation instruction is selected based on a relationship between a location of the unmanned aerial vehicle and the object.

### Claim 4 (depends on 2)

The unmanned aerial vehicle navigation system of claim 2, wherein the mapped display region corresponds to a navigational direction; the navigation behavior is navigation in the navigational direction; and a navigation instruction is selected based on a relationship between a location of the unmanned aerial vehicle and the navigational direction.

### Claim 5 (depends on 1)

The unmanned aerial vehicle navigation system of claim 1, wherein the selection criterion is a sustained user eye orientation toward an object for at least a predetermined duration.

### Claim 6 (depends on 1)

The unmanned aerial vehicle navigation system of claim 1, wherein the selection criterion is a sustained user eye orientation toward a location for at least a predetermined duration.

### Claim 7 (depends on 1)

The unmanned aerial vehicle navigation system of claim 1, wherein the selection criterion is a sustained eye orientation toward a display region for at least a predetermined duration.

### Claim 8 (depends on 1)

The unmanned aerial vehicle navigation system of claim 1, wherein the selection criterion is a non-ocular election of the mapped display region as an unmanned aerial vehicle destination.

### Claim 9 (depends on 1)

The unmanned aerial vehicle navigation system of claim 1, wherein the mapped display region corresponds to a navigation command, and the navigation behavior is navigation corresponding to the navigation command.

### Claim 10 (depends on 9)

The unmanned aerial vehicle navigation system of claim 9, wherein the navigation command causes the unmanned aerial vehicle to ascend, descend, turn left, turn right, rotate left, rotate right, or return home.

### Claim 11

An method of navigating an unmanned aerial vehicle comprising:
detecting user image data;
determining from the user image data a user eye orientation;
selecting according to a selection criterion a navigation behavior based on the user eye orientation; and
determining a navigation instruction to cause the unmanned aerial vehicle to travel in accordance with the navigation behavior.

### Claim 12 (depends on 11)

The method of navigating an unmanned aerial vehicle of claim 11, further comprising displaying image data received from the unmanned aerial vehicle, and mapping the user eye orientation to a region of a user display.

### Claim 13 (depends on 12)

The method of navigating an unmanned aerial vehicle of claim 12, further comprising selecting the navigation instruction based on a relationship between a location of the unmanned aerial vehicle and an object, wherein the object corresponds to the mapped display region, and the navigation behavior is navigation toward the object.

### Claim 14 (depends on 12)

The method of navigating an unmanned aerial vehicle of claim 12, further comprising selecting a navigation instruction based on a relationship between a location of the unmanned aerial vehicle and a navigational direction, wherein the navigational direction corresponds to the mapped display region, and the navigation behavior is navigation in the navigational direction.

### Claim 15 (depends on 11)

The method of navigating an unmanned aerial vehicle of claim 11, wherein the selection criterion is a sustained user eye orientation toward an object for at least a predetermined duration.

### Claim 16 (depends on 11)

The method of navigating an unmanned aerial vehicle of claim 11, wherein the selection criterion is a sustained user eye orientation toward a location for at least a predetermined duration.

### Claim 17 (depends on 11)

The method of navigating an unmanned aerial vehicle of claim 11, wherein the selection criterion is a sustained eye orientation toward a display region for at least a predetermined duration.

### Claim 18 (depends on 11)

The method of navigating an unmanned aerial vehicle of claim 11, wherein the selection criterion is a non-ocular election of the mapped display region as an unmanned aerial vehicle destination.

### Claim 19 (depends on 11)

The method of navigating an unmanned aerial vehicle of claim 11, wherein the mapped display region corresponds to a navigation command, and the navigation behavior is navigation corresponding to the navigation command.

### Claim 20

The method of navigating an unmanned aerial vehicle of 19, wherein the navigation command causes the unmanned aerial vehicle to ascend, descend, turn left, turn right, rotate left, rotate right or return home.
