# US 2024/0199225 A1 · In-flight vehicle user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0199225 A1
- Document ID: US20240199225A1
- Status: Published application
- Kind: A1
- Application number: 18/541,539
- Filed: 2023-12-15
- Published: 2024-06-20
- Earliest claimed: 2022-12-16
- Assignees: Skyryse, Inc.
- Applicants: Skyryse, Inc.
- Inventors: Christopher Camilo Cole; Gonzalo Javier Rey; Mark Daniel Groden; Chaitanyakumar Vipulbhai Shah; Christina Marie Hicks
- Web page: https://patentgrep.com/patent/US20240199225A1

## CPC

- B64D 11/0646: {Seats characterised by special features of stationary arms, foot or head rests}
- B64D 43/00: Arrangements or adaptations of instruments
- B64D 11/0689: {specially adapted for pilots}
- B64D 43/02: for indicating aircraft speed or stalling conditions
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- B64C 27/00: Rotorcraft; Rotors peculiar thereto
- B64C 29/00: Aircraft capable of landing or taking-off vertically, e.g. vertical take-off and landing [VTOL] aircraft (rotorcraft B64C27/00)
- B64U 2201/20: Remote controls
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B64C: AEROPLANES; HELICOPTERS
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR

## Abstract

A vehicle control and interface system described herein assists an operator of an aerial vehicle with the operation of an aerial vehicle, including navigating during flight. The system can generate a graphical user interface (GUI) through which an operator can specify navigation instructions (e.g., using finger gestures on a touch screen interface). In one example of controlling aerial vehicle navigation using a finger gesture, an operator swipes three fingers simultaneously upwards on a touchpad to increase the vertical speed of the aerial vehicle. The system can update the GUI to show, via a digital avatar of the aerial vehicle, the changing orientation of the aerial vehicle in substantially real time. The GUI may depict representations of the aerial vehicle's environment absent of objects at the surface of the earth or natural features at the earth's surface (e.g., rivers, canyons, mountains, etc.) to reduce a mental strain taken by an operator when using the GUI.

## Claims

### Claim 1

A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed by a processor of an aerial vehicle control and interface system cause the aerial vehicle control and interface system to:
generate a graphical user interface (GUI) comprising:
an avatar of an aerial vehicle;
one or more aerial vehicle attitude indicators corresponding to orientation of the aerial vehicle about one or more of a longitudinal axis or a lateral axis; and
a representation of an environment in which the aerial vehicle travels;
receive a user interaction via the GUI corresponding to a modification of a navigation of the aerial vehicle, wherein the user interaction comprises a gesture of one or more fingers against a touch screen interface through which the aerial vehicle is controlled;
determine the modification of the one or more aerial vehicle attitude indicators based on the received user interaction via the GUI;
transmit an instruction to a controller coupled with an actuator of the aerial vehicle to modify an operation of the actuator based on the determined modification; and
update the GUI to display the modification of the one or more aerial vehicle attitude indicators.

### Claim 2 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the instructions to determine the modification to the one or more aerial vehicle attitude indicators further comprises instructions to:
track a current angle of one or more of the lateral axis or the longitudinal axis of the aerial vehicle relative to a level angle of the longitudinal axis when the aerial vehicle is maintaining level flight.

### Claim 3 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the representation of the environment includes a fixed horizon line.

### Claim 4 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the representation of the environment includes a representation of a surface of earth absent shapes of land and objects located on the surface of the earth.

### Claim 5 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the one or more aerial vehicle attitude indicators are concentric circles centered at the avatar of the aerial vehicle.

### Claim 6 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the user interaction is one or more of a swipe of a finger in a first direction, a swipe of the finger in a circle, or a swipe of multiple fingers in a second direction.

### Claim 7 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the instructions to modify the navigation of the aerial vehicle is one or more of a speed modification, a lateral orientation modification, a heading modification, or a vertical position modification.

### Claim 8 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the instructions to receive the user interaction via the GUI corresponding to the modification further comprises instructions to change a current navigation state to a previous navigation state, and wherein the user interaction includes a plurality of taps in succession against the touch screen.

### Claim 9 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the GUI further comprises a wind indicator depicting a direction of wind in the environment.

### Claim 10

A method comprising:
generating a graphical user interface (GUI) comprising:
an avatar of an aerial vehicle;
one or more aerial vehicle attitude indicators corresponding to orientation of the aerial vehicle about one or more of a longitudinal axis or a lateral axis; and
a representation of an environment in which the aerial vehicle travels;
receiving a user interaction via the GUI corresponding to a modification of a navigation of the aerial vehicle, wherein the user interaction comprises a gesture of one or more fingers against a touch screen interface through which the aerial vehicle is controlled;
determining the modification of the one or more aerial vehicle attitude indicators based on the received user interaction via the GUI;
transmitting an instruction to a controller coupled with an actuator of the aerial vehicle to modify an operation of the actuator based on the determined modification; and
updating the GUI to display the modification of the one or more aerial vehicle attitude indicators.

### Claim 11 (depends on 10)

The method of claim 10, wherein the GUI further comprises a wind indicator depicting a direction of wind in the environment.

### Claim 12 (depends on 10)

The method of claim 10, wherein the modification to the one or more aerial vehicle attitude indicators tracks a current angle of one or more of the lateral axis or the longitudinal axis of the aerial vehicle relative to a level angle of the longitudinal axis when the aerial vehicle is maintaining level flight.

### Claim 13 (depends on 10)

The method of claim 10, wherein the one or more aerial vehicle attitude indicators are concentric circles centered at the avatar of the aerial vehicle.

### Claim 14 (depends on 10)

The method of claim 10, wherein the user interaction is one or more of a swipe of a finger in a first direction, a swipe of the finger in a circle, or a swipe of multiple fingers in a second direction.

### Claim 15 (depends on 10)

The method of claim 10, wherein the instruction to modify the operation of the actuator includes changing a current navigation state to a previous navigation state, and wherein the user interaction includes a plurality of taps in succession against the touch screen.

### Claim 16

An aerial vehicle control and interface system comprising:
a universal vehicle control interface for an aerial vehicle, the universal vehicle control interface configured to:
receive input commands from an operator of the aerial vehicle; and
provide for display a graphical user interface (GUI) comprising:
an avatar of the aerial vehicle;
one or more aerial vehicle attitude indicators corresponding to orientation of the aerial vehicle about one or more of a longitudinal axis or a lateral axis; and
a representation of an environment in which the aerial vehicle travels; and
a universal avionics control router configured to:
generate the GUI;
receive a user interaction via the GUI corresponding to a modification of a navigation of the aerial vehicle, wherein the user interaction comprises a gesture of one or more fingers against a touch screen interface through which the aerial vehicle is controlled;
determine the modification of the one or more aerial vehicle attitude indicators based on the received user interaction via the GUI;
transmit an instruction to a controller coupled with an actuator of the aerial vehicle to modify an operation of the actuator based on the determined modification; and
update the GUI to display the modification of the one or more aerial vehicle attitude indicators.

### Claim 17 (depends on 16)

The aerial vehicle control and interface system of claim 16, wherein the modification to the one or more aerial vehicle attitude indicators tracks a current angle of one or more of the lateral axis or the longitudinal axis of the aerial vehicle relative to a level angle of the longitudinal axis when the aerial vehicle is maintaining level flight.

### Claim 18 (depends on 16)

The aerial vehicle control and interface system of claim 16, wherein the one or more aerial vehicle attitude indicators are concentric circles centered at the avatar of the aerial vehicle.

### Claim 19 (depends on 16)

The aerial vehicle control and interface system of claim 16, wherein the user interaction is one or more of a swipe of a finger in a first direction, a swipe of the finger in a circle, or a swipe of multiple fingers in a second direction.

### Claim 20 (depends on 16)

The aerial vehicle control and interface system of claim 16, wherein the instruction to modify the operation of the actuator includes changing a current navigation state to a previous navigation state, and wherein the user interaction includes a plurality of taps in succession against the touch screen.
