Augmented reality maintenance system for multiple rovs

A remote maintenance system for inspection and repair of structures in an environment comprising:

• a) a plurality of remotely operated vehicles (ROVs) each having
• 1. a sensor package, for inspecting physical characteristics of said structures in the environment, and
• 2. actuators for maneuvering the ROV;
• b) a position and orientation sensing (P&O) unit for providing a position and orientation, of any-moving objects and each of the ROVs;
• c) an environment model storage device for retaining computer graphic information regarding the environment of the ROV;
• d) an environment modeler for receiving parameters defining objects in the environment of the ROV and producing a computer generated model of the environment and storing the model in the environment model storage device;
• e) an ROV model storage device for retaining computer graphic information regarding the ROV size and shape parameters;
• f) an ROV modeler for receiving parameters defining the ROV and producing a computer generated model of the ROV for storing in the ROV model storage device;
• g) an automated flight planner comprised of:
• i. a pointing device allowing the operator to select an ROV and points on a path which the operator desires the selected ROV to follow,
• ii. a time/space storage coupled to the environment model storage device unit for storing information defining locations in space occupied at different times,
• iii. a course projector coupled to the P&O unit and the ROV model storage device for planning a trajectory for each of the moving objects monitored by the P&O unit, and indicating locations in space which are occupied by the moving objects at different times stored in the time/space storage device, and
• iv. a control unit for receiving the shape of each ROV from the ROV model storage device, and sweeping the received shape of each ROV through the associated planned trajectory which indicates the occupied locations at different times stored in the time/space storage device for all planned trajectories, for planning a path based on the operator selected points which will not intersect any occupied locations.