# US 2019/0168787 A1 · Inspection system and method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0168787 A1 - Document ID: US20190168787A1 - Status: Published application - Kind: A1 - Application number: 16/229,824 - Filed: 2018-12-21 - Published: 2019-06-06 - Earliest claimed: 2002-06-04 - Assignees: General Electric Company - Applicants: General Electric Company - Inventors: Jason Howard Messinger; Robert Carroll Ward; Michael Christopher Domke; Sekhar Soorianarayanan; Scott Leo Sbihli; Thomas Eldred Lambdin; Steven Clifton; Dattaraj Jagdish Rao; Anju Bind; Glenn Robert Shaffer; Peter Henry Tu; Mark Bradshaw Kraeling; Anwarul Azam; Matthew Lawrence Blair; Shannon Joseph Clouse - Web page: https://patentgrep.com/patent/US20190168787A1 ## CPC - B61L 25/021: {Measuring and recording of train speed} - B61L 15/0027: {Radio-based, e.g. using GSM-R} - B61L 15/0072: {On-board train data handling} - B61L 15/0081: {On-board diagnosis or maintenance} - B61L 15/009: {On-board display devices} - B61L 25/023: {Determination of driving direction of vehicle or train} - B61L 25/025: {Absolute localisation, e.g. providing geodetic coordinates} - B61L 25/026: {Relative localisation, e.g. using odometer} - B61L 27/40: Handling position reports or trackside vehicle data - B61L 27/53: for trackside elements or systems, e.g. trackside supervision of trackside control system conditions - B61L 27/57: for vehicles or trains, e.g. trackside supervision of train conditions - B64D 47/08: Arrangements of cameras - G05D 1/0094: {involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target} - G06Q 10/20: Administration of product repair or maintenance - G06V 20/182: {Network patterns, e.g. roads or rivers} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road} - H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks - H04N 7/183: {for receiving images from a single remote source} - H04N 23/65: Control of camera operation in relation to power supply - H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices - H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet - B61L 23/04: for monitoring the mechanical state of the route - B61L 2205/04: Satellite based navigation systems, e.g. global positioning system [GPS] - B64U 80/86: Land vehicles - H04N 7/185: {from a mobile camera, e.g. for remote control} - B61L: GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC (brakes or auxiliary equipment B61H, B61K; point or crossing construction E01B) - B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR ## Abstract An inspection management system is provided. The inspection management system includes an inspection data provider that receives inspection data relating to an inspector, one or more devices used to complete an inspection, one or more assets associated with an inspection, an inspection plan, etc. A display of the inspection management system presents one or more graphical user interfaces based upon the inspection data. The graphical user interfaces may facilitate inspection planning, execution, preparation, and/or real-time inspection monitoring. ## Claims ### Claim 1 An inspection system, comprising: a sensor package comprising one or more sensors that are configured to obtain and to provide inspection data relating to at least one target object; a support platform configured to carry the sensor package to the at least one target object; and a controller configured to: align or index the one or more sensors of the sensor package with or on at least a portion of the target object at least during an inspection operation, communicate with at least one operator that is remote from the target object, send inspection information from the one or more sensors to the at least one remote operator, and receive, from the at least one remote operator, one or more control instructions, programming instructions, or configuration instructions at the support platform, and thereby to control the inspection operation of the sensor package, and wherein the controller is further configured to manipulate the one or more sensors based at least in part in response to the one or more control instructions, programming instructions, or configuration instructions that are received. ### Claim 2 (depends on 1) The inspection system of claim 1, further comprising a display configured to present at least one inspection management graphical user interface to the at least one remote operator, and the inspection management graphical user interface comprises a map and one or more icons, the icons indicating: the at least one target object location on the map, and an inspection status of the at least one target object. ### Claim 3 (depends on 2) The inspection system of claim 2, wherein the display is configured to vary characteristics of the one or more icons to denote characteristics of the inspection data, the at least one remote operator, the one or more sensors of the sensor package, one or more assets associated with the at least one target object, or a combination of two or more thereof. ### Claim 4 (depends on 1) The inspection system of claim 1, wherein the sensor package is part of an inspection device and is at least a visual or optical system. ### Claim 5 (depends on 4) The inspection system of claim 4, wherein the inspection device further comprises a non-visual, non-destructive inspection and testing device. ### Claim 6 (depends on 4) The inspection system of claim 4, wherein the support platform further comprises a housing and the inspection device is at least partially disposed within the housing, and the housing is configured to be manipulated by the at least one remote operator via the receipt of the one or more control instructions, programming instructions, or configuration instructions. ### Claim 7 (depends on 6) The inspection system of claim 6, wherein the controller is further configured to perform an inspection operation based at least in part on: obtaining inspection information, environmental information proximate to the support platform, or both the inspection information and the environmental information; and performing automatically one or more actions or additional inspections in response to the obtained inspection information. ### Claim 8 (depends on 7) The inspection system of claim 7, wherein the one or more actions comprise indexing or aligning on a determined aspect of the target object and maintaining a stationary relationship of at least one of the inspection device, the housing, or the support platform relative to that determined aspect reactively to environmental effects that would urge the one or more sensors to otherwise move relative to that determined aspect. ### Claim 9 (depends on 7) The inspection system of claim 7, wherein the one or more actions comprise indexing or aligning the inspection device on a determined aspect of the target object and executing one or move movements of at least one of the support platform, the housing, or the inspection device relative to that determined aspect so as to sequentially expose the sensor package to portions of the target object in a determined pattern over a period of time, and thereby to inspect of an area of the target object. ### Claim 10 (depends on 6) The inspection system of claim 6, wherein the inspection device is disposed in the housing and includes a visual inspection device, and the housing is configured to respond to operator instructions by initiating movement of the visual inspection device, the non-visual, non-destructive inspection and testing device or both the visual inspection device and the non-visual, non-destructive inspection and testing devices relative to the support platform, and thereby to manipulate the one or more sensors. ### Claim 11 (depends on 10) The inspection system of claim 10, wherein the at least one operator is at least one person and the one or more control instructions, programming instructions, or configuration instructions that are received are manually input by the at least one operator into the controller and are based at least in part on a presentation of visual inspection information from the visual inspection device, non-visual inspection information from the non-visual, non-destructive inspection and testing device, or both the visual inspection information and the non-visual inspection information that are presented to the operator, and thereby to facilitate the input that is manually input by the operator. ### Claim 12 (depends on 11) The inspection system of claim 11, wherein the controller is further configured to initiate a remote collaboration session between a first operator having access to the presentation, and a second operator generating and sending the one or more control instructions, programming instructions, or configuration instructions to the support platform, and the first and second operators are both located remotely from the support platform. ### Claim 13 (depends on 11) The inspection system of claim 11, wherein the presentation includes a notes section configured to provide to the at least one operator one or more of text, images, audio, video, or a combination of two or more thereof. ### Claim 14 (depends on 1) The inspection system of claim 1, further comprising a historical data archive for inspection data relating to the at least one target object, and the controller is further configured to access at least the historical data archive. ### Claim 15 (depends on 1) The inspection system of claim 1, wherein the support platform is one of a plurality of support platforms that is configured to cooperatively inspect portions of the at least one target object. ### Claim 16 (depends on 1) The inspection system of claim 1, wherein the support platform has a plurality of sensor packages with each sensor package in a corresponding housing, and thereby a first sensor package of the plurality of sensor packages is configured to inspect one or more portions of the target object differently than a second sensor package of another housing. ### Claim 17 (depends on 1) The inspection system of claim 1, wherein the controller is configured to define a crash avoidance residence zone for the support platform to avoid contact with the at least one target object, another support platform, or with another object other than the target object. ### Claim 18 (depends on 1) The inspection system of claim 1, wherein the inspection data includes a video of a surveyed area, and wherein the controller is configured to add the video to previously archived video to create a video loop. ### Claim 19 An inspection system, comprising: a sensor package comprising one or more sensors that are configured to obtain and to provide inspection data relating to at least one target object, and the one or more sensors comprise at least (a) a visual or optical system and (b) a non-visual, non-destructive inspection and testing device; a support platform configured to carry the sensor package to the at least one target object; a navigation device configured to provide at least location and direction information; a controller configured to receive the at least location and direction information, and to: align or index the one or more sensors of the sensor package to a determined aspect of the target object and execute one or more movements of the support platform relative to that determined aspect so as to sequentially expose the sensor package to portions of the target object in a determined pattern and capture inspection information from the one or more sensors relating to the target object. ### Claim 20 A method, comprising: directing one or more sensors of a sensor package toward at least a portion of a target object at least during an inspection operation to generate inspection information; communicating the inspection information with at least one operator that is remote from the target object; receiving one or more of control instructions, programming instructions, or configuration instructions; and manipulating the one or more sensors at least in part in response to the one or more control instructions, programming instructions, or configuration instructions that are received. ### Claim 21 (depends on 20) The method of claim 20, further comprising defining a crash avoidance residence zone to avoid contact between a support platform for the sensor package and one or more of: the target object, another support platform, or with an object other than the target object or another support platform.