# US 12,001,206 B2 · Methods and systems for remote operation of vehicles using hands-free functionality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,001,206 B2
- Document ID: US12001206B2
- Status: Granted
- Kind: B2
- Application number: 16/921,699
- Filed: 2020-07-06
- Published: 2021-07-22
- Granted: 2024-06-04
- Earliest claimed: 2020-07-06
- Assignees: Honeywell International Inc.
- Applicants: Honeywell International Inc.
- Inventors: Narayanan Srinivasan; Kiran Gopala Krishna; Gobinathan Baladhandapani; Hariharan Saptharishi
- Web page: https://patentgrep.com/patent/US12001206B2

## CPC

- G05D 1/0011: {associated with a remote control arrangement}
- G05D 1/0061: {for transition from automatic pilot to manual pilot and vice versa}
- G05D 1/0088: {characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00)}
- G05D 1/101: {specially adapted for aircraft}
- G05D 1/46: Control of position or course in three dimensions [3D]
- G05D 1/81: Handing over between on-board automatic and on-board manual control
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 13/00: Speech synthesis; Text to speech systems
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Methods and systems are provided for autonomously enabling remote operation of a vehicle such as an aircraft in response to detecting an event that may impact manual operation of the vehicle. One method autonomously detects an event with respect to manual operation of the vehicle based at least in part on output from one or more systems onboard the vehicle, identifies a hands-free functionality of a vehicle system to be activated based at least in part on a characteristic of the event, and autonomously initiates activation of the hands-free functionality of the vehicle system. A command for operating the vehicle is received from an external system via an onboard communications system and provided to the vehicle system for further implementation or execution using the hands-free functionality.

## Claims

### Claim 1

A method of autonomously enabling remote operation of a vehicle, the method comprising:
autonomously detecting an event with respect to manual operation of the vehicle based at least in part on output from one or more systems onboard the vehicle;
identifying a hands-free functionality of a vehicle system to be activated based at least in part on a characteristic of the event;
autonomously initiating activation of the hands-free functionality of the vehicle system;
deactivating a second hands-free functionality of a second vehicle system to be deconflicted with the hands-free functionality of the vehicle system;
receiving, from an external system via an onboard communications system, a command for operating the vehicle; and
providing the command to the vehicle system using the hands-free functionality.

### Claim 2 (depends on 1)

The method of claim 1, wherein autonomously initiating activation of the hands-free functionality of the vehicle system comprises autonomously initiating activation of the hands-free functionality of an autopilot system.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
receiving, by the autopilot system, the command for an automated action via the hands-free functionality; and
autonomously adjusting, by the autopilot system, an onboard component to influence operation of the vehicle and achieve the automated action in accordance with the command.

### Claim 4 (depends on 1)

The method of claim 1, the characteristic comprising an operator status, wherein identifying the hands-free functionality of the vehicle system comprises identifying the vehicle system based on the operator status.

### Claim 5 (depends on 4)

The method of claim 4, further comprising providing, via the onboard communications system, notification of the operator status to the external system prior to receiving the command.

### Claim 6 (depends on 1)

The method of claim 1, wherein the hands-free functionality comprises a text-to-speech functionality.

### Claim 7 (depends on 1)

The method of claim 1, wherein the hands-free functionality comprises a speech-to-text functionality.

### Claim 8 (depends on 1)

A non-transitory computer-readable medium having computer-executable instructions stored thereon that, when executed by a processing system onboard the vehicle, cause the processing system to perform the method of claim 1.

### Claim 9

A method of autonomously enabling remote control of an aircraft, the method comprising:
autonomously detecting an event with respect to manual operation of the aircraft based at least in part on output from a component onboard the aircraft;
determining an onboard system to be activated based on a characteristic of the event;
autonomously initiating activation of a hands-free functionality of the onboard system; and
generating an audio representation of a command for an automated action received from an external system via a communications system onboard the aircraft, wherein the onboard system thereafter receives, via the hands-free functionality, the audio representation of the command and automatically performs the automated action in accordance with the command in response to receiving the audio representation of the command via the hands-free functionality.

### Claim 10 (depends on 9)

The method of claim 9, the onboard system comprising an autopilot system, wherein:
determining the onboard system comprises determining the autopilot system should be activated based on a pilot status;
autonomously initiating activation of the hands-free functionality comprises autonomously initiating activation of the hands-free functionality of the autopilot system; and
the autopilot system automatically performs the automated action by autonomously adjusting an onboard component to influence operation of the aircraft in accordance with the command.

### Claim 11 (depends on 10)

The method of claim 10, further comprising determining the pilot status based on output from one or more user interface devices onboard the aircraft.

### Claim 12 (depends on 9)

The method of claim 9, further comprising:
providing, via a communications system onboard the aircraft, notification of the event to an external system; and
receiving the command from the external system via the communications system.

### Claim 13 (depends on 9)

The method of claim 9, further comprising deactivating a second hands-free functionality of a second onboard system to deconflict the hands-free functionality of the onboard system.

### Claim 14 (depends on 9)

The method of claim 9, wherein the component comprises at least one of a camera or a sensor located in a cockpit of the aircraft.

### Claim 15

An aircraft system comprising:
an avionics system onboard an aircraft;
a second system onboard the aircraft to provide output data indicative of an event;
a communications system to receive a command for operating the aircraft from an external system; and
a processing system coupled to the avionics system, the second system and the communications system to autonomously detect the event based at least in part on the output from the second system and autonomously initiate activation of a hands-free functionality of the avionics system in response to detecting the event, wherein:
the avionics system receives the command via the hands-free functionality; and
the processing system is coupled to the communications system to provide notification of the event to the external system prior to receipt of the command.

### Claim 16 (depends on 15)

The aircraft system of claim 15, wherein the avionics system is capable of performing an automated action by autonomously adjusting a mechanical or electrical configuration of an onboard component to influence operation of the aircraft in accordance with the command.

### Claim 17 (depends on 15)

The aircraft system of claim 15, further comprising:
an audio output device coupled to the communications system to generate an audio representation of the command; and
an audio input device coupled to the avionics system, wherein the hands-free functionality of the avionics system receives the audio representation of the command from the audio input device.