# US 2022/0092994 A1 · Controlling a vehicle based on detected movement of an object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0092994 A1
- Document ID: US20220092994A1
- Status: Published application
- Kind: A1
- Application number: 17/481,607
- Filed: 2021-09-22
- Published: 2022-03-24
- Earliest claimed: 2020-09-23
- Assignees: Aurora Flight Sciences Corporation, a subsidiary of The Boeing Company
- Applicants: Aurora Flight Sciences Corporation, a subsidiary of The Boeing Company
- Inventors: Zarrin Chua; Martin Kearney-Fischer
- Web page: https://patentgrep.com/patent/US20220092994A1

## CPC

- G05D 1/0016: {characterised by the operator's input device (input arrangements for computing systems in general G06F3/00)}
- G08G 5/51: for control when on the ground, e.g. taxiing or rolling
- B64F 1/002: {Taxiing aids}
- G05D 1/0083: {to help an aircraft pilot in the rolling phase}
- G05D 1/0202: {specially adapted to aircraft}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G08G 5/21: located onboard the aircraft
- G08G 5/80: Anti-collision systems
- B64D 47/08: Arrangements of cameras
- B64U 2201/20: Remote controls
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B64F: GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method of controlling a vehicle includes detecting, by an optical sensor, a movement of at least one object in a field of view of the optical sensor. The method further includes identifying, by a processor circuit, a pattern based on the movement of the at least one object. The method further includes determining, by the processor circuit based on the pattern, a vehicle command to be performed by the vehicle.

## Claims

### Claim 1

A method of enhancing operational efficiency of a vehicle, the method comprising:
detecting, by an optical sensor, a movement of at least one object in a field of view of the optical sensor;
identifying, by a processor circuit, a pattern based on the movement of the at least one object; and
determining, by the processor circuit based on the pattern, a vehicle command to be performed by the vehicle.

### Claim 2 (depends on 1)

The method of claim 1, wherein the optical sensor comprises a forward-facing optical sensor, and
wherein the field of view is directed towards a direction of the vehicle's motion.

### Claim 3 (depends on 1)

The method of claim 1, wherein the movement of the at least one object comprises a gesture performed by a body part of a human.

### Claim 4 (depends on 1)

The method of claim 1, wherein the vehicle comprises an aircraft, and
wherein the vehicle command comprises a taxiing command that causes the aircraft to perform a taxiing operation.

### Claim 5 (depends on 1)

The method of claim 1, wherein the at least one object comprises an equipment being held by a human.

### Claim 6 (depends on 5)

The method of claim 5, wherein the equipment comprises an illuminated lighting element being held by the human.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the vehicle command further comprises correlating the pattern with a relevant command of a stored command inventory.

### Claim 8 (depends on 1)

The method of claim 1, further comprising determining, by the processor circuit, whether the movement of the at least one object is associated with an authorization to provide the vehicle command.

### Claim 9 (depends on 8)

The method of claim 8, wherein the determining whether the movement of the at least one object is associated with the authorization further comprises determining whether a human associated with the movement of the object is authorized to provide the vehicle command.

### Claim 10 (depends on 9)

The method of claim 9, wherein the determining whether the movement of the at least one object is associated with the authorization further comprises identifying, by the processor circuit, a uniform element being worn by the human that is indicative of the authorization to provide the vehicle command, wherein determining whether the human is authorized is at least partially based on the uniform element.

### Claim 11 (depends on 9)

The method of claim 9, wherein the determining whether the movement of the at least one object is associated with the authorization further comprises identifying, by the processor circuit, a fiducial being held by the human that is indicative of the authorization to provide the vehicle command, wherein determining whether the human is authorized is at least partially based on the fiducial.

### Claim 12 (depends on 8)

The method of claim 8, further comprising receiving, by a receiver, a signal from a transmitter associated with the at least one object,
wherein determining whether the movement of the at least one object is associated with the authorization is at least partially based on the signal.

### Claim 13 (depends on 12)

The method of claim 12, wherein receiving the signal further comprises receiving the signal that is associated with the vehicle command from a baton held by a human; and
verifying, by the processor circuit, the vehicle command at least partially based on the signal.

### Claim 14 (depends on 1)

The method of claim 1, further comprising causing, by the processor circuit, a component of the vehicle to execute the vehicle command.

### Claim 15 (depends on 14)

The method of claim 14, further comprising selectively illuminating a lighting element of the vehicle to provide a visual indication of at least one of a detection of the object, a detection of the movement, a determination of the vehicle command, or an execution of the vehicle command.

### Claim 16 (depends on 14)

The method of claim 14, further comprising selectively moving a movable element of the vehicle to provide a visual indication of at least one of a detection of the object, a detection of the movement, a determination of the vehicle command, or the execution of the vehicle command.

### Claim 17

A non-transitory computer-readable storage medium for enhancing operational efficiency of a vehicle comprising executable instructions that, in response to execution, cause a system that comprises a processor circuit to perform operations comprising:
receiving sensor data from at least one optical sensor of a vehicle;
based on an analysis of the sensor data, determining a movement of an object in a field of view of the at least one optical sensor;
based on the movement of the object, identifying a pattern; and
based on the pattern, determining a vehicle command to be performed by the vehicle.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein the movement of the object comprises a gesture by a human,
wherein determining the movement of the object further comprises identifying the gesture, and
wherein the operations further comprise determining whether the human is authorized to provide the vehicle command.

### Claim 19

A system for enhancing operational efficiency of a vehicle comprising:
a processor circuit; and
a memory comprising machine-readable instructions that, when executed by the processor circuit, cause the processor circuit to perform operations comprising:
identifying, by the processor circuit, at least one gesture performed by a human based on an arm movement of the human;
determining, by the processor circuit, a vehicle command to be performed by the vehicle based on the at least one gesture;
determining, by the processor circuit, whether the human is authorized to provide the vehicle command; and
in response to determining that the human is authorized, executing the vehicle command.

### Claim 20 (depends on 19)

The system of claim 19, further comprising:
a vehicle comprising the processor circuit and the memory, the vehicle further comprising:
a forward-facing optical sensor configured to detect the arm movement of the human in a field of view of the forward-facing optical sensor, wherein the human is external to the vehicle.
