# US 2023/0122689 A1 · Control system with task manager

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0122689 A1
- Document ID: US20230122689A1
- Status: Published application
- Kind: A1
- Application number: 18/050,341
- Filed: 2022-10-27
- Published: 2023-04-20
- Earliest claimed: 2014-11-14
- Assignees: Transportation IP Holdings, LLC
- Applicants: Transportation IP Holdings, LLC
- Inventors: Huan Tan; John Michael Lizzi; Charles Burton Theurer; Balajee Kannan; Romano Patrick
- Web page: https://patentgrep.com/patent/US20230122689A1

## CPC

- B25J 9/1682: {Dual arm manipulator; Coordination of several manipulators}
- B25J 9/16: Program controls (total factory control, i.e. centrally controlling a plurality of machines, G05B19/418)
- B25J 9/1666: {Avoiding collision or forbidden zones}
- B61G 7/04: Coupling or uncoupling by means of trackside apparatus
- B61J 99/00: Subject matter not provided for in other groups of this subclass
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- B61G: COUPLINGS; DRAUGHT AND BUFFING APPLIANCES (vehicle connections in general B60D)
- B61J: SHIFTING OR SHUNTING OF RAIL VEHICLES (shifting vehicles in general B60S; marshalling systems B61B)

## Abstract

A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.

## Claims

### Claim 1

A system, comprising:
a task manager including one or more processors and a communication circuit operably connected to the one or more processors, the one or more processors configured to determine sub-tasks required to perform a task on a target object that is on one of a vehicle or stationary equipment,
the one or more processors configured to assign a first sequence of the sub-tasks to a first robotic machine for performance by the first robotic machine, and to assign a second sequence of the sub-tasks to a second robotic machine for performance by the second robotic machine, wherein the first robotic machine has at least one capability that differs from a set of capabilities of the second robotic machine,
the sub-tasks in the first sequence assigned to the first robotic machine include the first robotic machine identifying the target object and communicating a signal to the second robotic machine, the signal including location information of the target object,
the sub-tasks in the second sequence assigned to the second robotic machine include the second robotic machine moving to the target object, based on the signal received from the first robotic machine, and manipulating the target object via a robotic arm of the second robotic machine,
the communication circuit configured to communicate the first sequence of the sub-tasks to the first robotic machine and communicate the second sequence of the sub-tasks to the second robotic machine.

### Claim 2 (depends on 1)

The system of claim 1, wherein the first robotic machine is an aerial device, and the sub-tasks in the first sequence include flying along a length of the vehicle or the stationary equipment, generating image data of the vehicle or the stationary equipment, and analyzing the image data to detect the target object.

### Claim 3 (depends on 1)

The system of claim 1, wherein the sub-task in the second sequence to manipulate the target object involves the second robotic machine grasping at least a portion of the target object and moving the at least portion of the target object.

### Claim 4 (depends on 1)

The system of claim 1, further comprising the first robotic machine and the second robotic machine, wherein the first robotic machine is configured to perform the first sequence of sub-tasks and the second robotic machine is configured to perform the second sequence of sub-tasks, upon receiving the respective first and second sequences from the communication circuit, to accomplish the task.

### Claim 5 (depends on 4)

The system of claim 4, wherein, after manipulating the target object, the second robotic machine is configured to, as one of the sub-tasks in the second sequence, transmit a notification to the first robotic machine, the notification indicating that the target object is actuated.

### Claim 6 (depends on 5)

The system of claim 5, wherein, in response to receiving the notification from the second robotic machine, the first robotic machine is configured to, as two of the sub-tasks in the first sequence, analyze one of image data or sensor data of the vehicle or the stationary equipment generated after receiving the notification to verify that the target object is actuated.

### Claim 7 (depends on 4)

The system of claim 4, wherein at least some of the sub-tasks in the first sequence are sequential with at least some of the sub-tasks in the second sequence, the second robotic machine configured to not perform a dependent sub-task in the second sequence until after receiving a notification from the first robotic machine that the first robotic machine has completed a specific sub-task in the first sequence.

### Claim 8 (depends on 4)

The system of claim 4, wherein the robotic arm of the second robotic machine is mounted on a mobile base that includes wheels, the second robotic machine configured to move towards the target object by exerting rotational torque on the wheels and controlling the robotic arm to move relative to the mobile base to reach out towards the target object.

### Claim 9 (depends on 1)

The system of claim 1, wherein the target object is one of a brake lever on a vehicle or a brake wheel on the vehicle.

### Claim 10 (depends on 1)

The system of claim 1, wherein the sub-task in the second sequence to manipulate the target object involves the second robotic machine releasing air from a compressed air system of the vehicle or stationary equipment.

### Claim 11 (depends on 1)

The system of claim 1, wherein the sub-task in the second sequence to manipulate the target object involves the second robotic machine connecting a first hose or cable connected to a first vehicle to a second hose or cable connected to a second vehicle.

### Claim 12 (depends on 1)

The system of claim 1, wherein the target object is a mechanical coupler of the vehicle, and the sub-task in the second sequence to manipulate the target object involves the second robotic machine connecting the mechanical coupler to a second mechanical coupler of a second vehicle.

### Claim 13

A system, comprising:
a task manager including one or more processors and a communication circuit operably connected to the one or more processors, the one or more processors configured to determine sub-tasks required to perform a task on a target object on a plurality of equipment, the plurality of equipment including vehicles or stationary equipment,
the one or more processors configured to assign a first sequence of the sub-tasks to a first robotic machine for performance by the first robotic machine, and to assign a second sequence of the sub-tasks to a second robotic machine for performance by the second robotic machine, wherein the first robotic machine has at least one capability that differs from a set of capabilities of the second robotic machine,
the sub-tasks in the first sequence assigned to the first robotic machine include the first robotic machine identifying the target object and communicating a signal to the second robotic machine, the signal including status information of the target object on a first piece of equipment of the plurality of equipment,
the sub-tasks in the second sequence assigned to the second robotic machine include the second robotic machine moving to the target object on the first piece of equipment, based on the status information from the first robotic machine, and manipulating the target object via a robotic arm of the second robotic machine,
the communication circuit configured to communicate the first sequence of the sub-tasks to the first robotic machine and communicate the second sequence of the sub-tasks to the second robotic machine.

### Claim 14 (depends on 13)

The system of claim 13, wherein, responsive to the status information indicating that the target object on the first piece of equipment is in an actuated state, the sub-tasks in the second sequence dictate that the second robotic machine not move toward the first piece of equipment and not manipulate the target object via the robotic arm.

### Claim 15 (depends on 13)

The system of claim 13, wherein the plurality of equipment includes a series of rail vehicles on a track.

### Claim 16 (depends on 13)

The system of claim 13, wherein the first robotic machine is an aerial device, and the sub-tasks in the first sequence include flying along a length of the vehicle or the stationary equipment, generating image data of the vehicle or the stationary equipment, and analyzing the image data in order to identify the target object.

### Claim 17 (depends on 13)

The system of claim 13, further comprising the first robotic machine and the second robotic machine, wherein, after manipulating the target object, the second robotic machine is configured to, as one of the sub-tasks in the second sequence, transmit a notification to the first robotic machine, the notification indicating that the target object is actuated.

### Claim 18

A method comprising:
controlling a first robotic machine, according to a first sequence of sub-tasks assigned to the first robotic machine for performing a task on a target object on one of a vehicle or stationary equipment, to travel along a length of the vehicle or stationary equipment and identify a location of the target object;
controlling the first robotic machine, according to the first sequence of sub-tasks, to communicate a signal to a second robotic machine, the signal including location information of the target object;
responsive to the second robotic machine receiving the signal, controlling the second robotic machine, according to a second sequence of sub-tasks assigned to the second robotic machine for performing the task on the target object, to approach the target object and manipulate the target object via a robotic arm of the second robotic machine.

### Claim 19 (depends on 18)

The method of claim 18, wherein the first robotic machine is an aerial device, and controlling the first robotic machine to travel along the length of the vehicle or stationary equipment includes controlling the first robotic machine to fly along the length of the vehicle or stationary equipment.

### Claim 20 (depends on 18)

The method of claim 18, wherein the second robotic machine includes a mobile base with wheels, and the robotic arm is mounted on the mobile base, wherein controlling the second robotic machine to approach the target object includes controlling the second robotic machine to drive, via the wheels, up to a portion of the vehicle or stationary equipment that includes the target object within sufficient proximity to enable the robotic arm to reach out and contact the target object.
