# US 2022/0035367 A1 · Coordination of remote vehicles using automation level assignments > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0035367 A1 - Document ID: US20220035367A1 - Status: Published application - Kind: A1 - Application number: 17/275,183 - Filed: 2019-09-12 - Published: 2022-02-03 - Earliest claimed: 2018-09-14 - Assignees: Human Automation Teaming Solutions, Inc. - Applicants: Human Automation Teaming Solutions, Inc. - Inventors: Nhut Ho; Walter Johnson; Kenneth Wakeland; Kevin Keyser; Karanvir Panesar; Garrett Sadler; Nathaniel Wilson - Web page: https://patentgrep.com/patent/US20220035367A1 ## CPC - G05D 1/0027: {involving a plurality of vehicles, e.g. fleet or convoy travelling (fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00)} - G05D 1/104: {involving a plurality of aircrafts, e.g. formation flying (traffic control systems for aircraft G08G5/00)} - G08G 5/22: located on the ground - G08G 5/26: Transmission of traffic-related information between aircraft and ground stations - G08G 5/53: for cruising - G08G 5/55: for a single aircraft - G08G 5/56: for two or more aircraft - G08G 5/57: for unmanned aircraft - G08G 5/727: {from a ground station} - B64U 10/25: Fixed-wing aircraft (VTOL aircraft B64U10/20) - B64U 2201/00: UAVs characterised by their flight controls - B64U 2201/102: adapted for flying in formations - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) - B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR ## Abstract Systems and methods here may include computing system configured to coordinate more than one remotely operated vehicle using level of automation determination and assignments. In some examples, the method for coordinating a plurality of drones includes using a computer with a processor and a memory in communication with the plurality of drones, and a candidate problem resolver for retrieving a candidate resolution from a data storage, and sending the retrieved candidate resolution to a candidate resolution states predictor. ## Claims ### Claim 1 A non-transitory computer-readable medium having computer-executable instructions thereon for a method of coordinating a plurality of remote drones, the method comprising: analyzing input data to determine a system state of the plurality of drones, at a system state monitor; sending system state variables to a problem detector, wherein a problem is a variable outside a predetermined threshold; if a new problem is detected by the problem detector, determining candidate resolutions at a candidate problem resolver using problem threshold data; determining a level of automation for each of the determined candidate resolutions, wherein the levels of automation are one of autonomous, veto, select, and manual; sending resolutions and associated level of automation assignments for each of the remote drones to a resolution recommender; and if the level of automation is autonomous, sending a top resolution as a command to each of the plurality of drones. ### Claim 2 (depends on 1) The non-transitory computer-readable medium of claim 1 wherein if the level of autonomy is veto, sending commands to each of the plurality of drones unless a veto is received from the user. ### Claim 3 (depends on 1) The non-transitory computer-readable medium of claim 1 wherein if the level of autonomy is select, sending manual selections for the user to select; receiving one of the manual selections; and sending the received manual selection to each of the plurality of drones. ### Claim 4 (depends on 1) The non-transitory computer-readable medium of claim 1 wherein if the level of autonomy is manual, waiting to receive manual input from the user; receiving a manual input; and sending the received manual input to each of the plurality of drones. ### Claim 5 A method for coordinating a plurality of drones, the method comprising, by a computer with a processor and a memory in communication with the plurality of drones, by a candidate problem resolver, retrieving a candidate resolution from a data storage, and sending the retrieved candidate resolution to a candidate resolution states predictor; by the candidate resolution states predictor, generating predicted candidate resolution states, based on the retrieved candidate resolution; determining a level of autonomy governing the process of presentation for each candidate resolution; selecting a top candidate resolution to execute from the a plurality of candidate resolutions; determining the level of autonomy for the top candidate resolution; and if the determined level of autonomy for the top candidate is autonomous, sending commands to each of the plurality of drones. ### Claim 6 (depends on 5) The method of claim 5 wherein if the level of autonomy is veto, sending commands to each of the plurality of drones unless a veto is received from the user. ### Claim 7 (depends on 6) The method of claim 6 wherein if the level of autonomy is select, sending manual selections for the user to select; receiving one of the manual selections; and sending the received manual selection to each of the plurality of drones. ### Claim 8 (depends on 7) The method of claim 7 wherein if the level of autonomy is manual, waiting to receive manual input from the user; receiving a manual input; and sending the received manual input to each of the plurality of drones. ### Claim 9 (depends on 5) The method of claim 5 further comprising an asynchronous problem resolver resolution manager configured to receive candidate resolutions with assigned levels of autonomy from an asynchronous problem resolver level of autonomy selector, and determining at least one of the following for the received candidate resolutions: identifying candidate resolutions sharing highest level of autonomy, breaking a tie, causing display of ordered recommendation list, causing display of a top candidate, sending a message for display to an operator that no acceptable candidate found by automation, and autonomously executing the top candidate. ### Claim 10 (depends on 5) The method of claim 5 further comprising receiving a play from the user, wherein a play allows a user to select, configure, tune, and confirm. ### Claim 11 (depends on 10) The method of claim 10 wherein select includes filter, search, and choose a play from a playlist. ### Claim 12 (depends on 10) The method of claim 10 wherein configure includes adding or removing assets and modifying thresholds. ### Claim 13 (depends on 10) The method of claim 10 wherein tune includes reviewing the play checklist, and changing the corresponding level of autonomy. ### Claim 14 (depends on 10) The method of claim 10 wherein confirm includes projecting actions that will occur after the play is initialized. ### Claim 15 (depends on 10) The method of claim 10 wherein a play includes nodes, and wherein each node includes inputs, tasks, and subplays. ### Claim 16 (depends on 10) The method of claim 10 wherein a node graph connects nodes to achieve the play.