# US 2022/0044183 A1 · Engineer recertification assistant > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0044183 A1 - Document ID: US20220044183A1 - Status: Published application - Kind: A1 - Application number: 17/394,135 - Filed: 2021-08-04 - Published: 2022-02-10 - Earliest claimed: 2020-08-05 - Assignees: Wi-Tronix, LLC - Applicants: Wi-Tronix, LLC - Inventors: Lawrence B. Jordan; Mihir Phadke; Frank Messina; Roger Martinez; Divya Dinesh - Web page: https://patentgrep.com/patent/US20220044183A1 ## CPC - G06Q 10/06398: {Performance of employee with respect to a job function} - B61L 15/0081: {On-board diagnosis or maintenance} - B61L 15/0094: {Recorders on the vehicle} - B61L 23/04: for monitoring the mechanical state of the route - B61L 25/02: Indicating or recording positions or identities of vehicles or trains - B61L 25/028: {Determination of vehicle position and orientation within a train consist, e.g. serialisation} - B61L 27/40: Handling position reports or trackside vehicle data - B61L 27/57: for vehicles or trains, e.g. trackside supervision of train conditions - G01C 21/16: by integrating acceleration or speed, i.e. inertial navigation - G06N 3/045: Combinations of networks - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/08: Learning methods - G06N 3/09: Supervised learning - G06N 3/092: Reinforcement learning - G06Q 10/10: Office automation; Time management - G06Q 30/018: Certifying business or products - G06Q 50/26: Government or public services (business processes related to the transportation industry G06Q50/40) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - B61L: GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC (brakes or auxiliary equipment B61H, B61K; point or crossing construction E01B) - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract An engineer recertification assistant that utilizes a real-time data acquisition and recording system (DARS), a DARS viewer, and a video analytics system for mobile assets. DARS includes a data recorder, an onboard data manager, and at least one local memory module. The video analytics system processes video data from at least one camera and operational data from the data recorder for critical events and regulatory requirements based on a mobile asset operator's operational performance. The processed video data and operational data is display, along with episodes, exceptions, and user comments, on a display device featuring a web portal. The engineer recertification assistant can further determine an automated score-based recommendation for certification or decertification of the mobile asset operator or can directly certify or decertify the mobile asset operator for gross non-compliance. ## Claims ### Claim 1 A method for automating the assessment of performance skills of a specified mobile asset operator, comprising the steps of: receiving, using a web portal, a request from a user comprising the specified mobile asset operator and a specified time range; receiving, using a data acquisition and recording system, data related to the mobile asset operator and the specified time range, the data based on at least one signal from at least one of: at least one data source onboard a mobile asset, the at least one data source onboard the mobile asset comprising at least one of at least one camera and at least one data recorder of the data acquisition and recording system; and at least one data source remote from the mobile asset; processing, using an artificial intelligence component of a video analytics system, the data into processed data; displaying, using the web portal, the processed data including at least one video on a display device. ### Claim 2 (depends on 1) The method of claim 1, the at least one camera comprising at least one of at least one 360 degrees camera located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, at least one fixed camera located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, and at least one microphone located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, wherein the at least one 360 degrees camera is one of inward facing and outward facing and the at least one fixed camera is one of inward facing and outward facing. ### Claim 3 (depends on 1) The method of claim 1, the at least one data source onboard the mobile asset comprising at least one video recorder located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, at least one sound recorder located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, at least one accelerometer, at least one gyrometer, and at least one magnetometer. ### Claim 4 (depends on 1) The method of claim 1, the data comprising at least one of event data recorder data, accelerometer data, gyroscope data, fuel volume data, microphone data, inward camera data, and outward camera data. ### Claim 5 (depends on 1) The method of claim 1, further comprising: storing, using an onboard data manager, at least one of the data and the processed data in at least one of a back office and at least one local memory component of a data recorder of the data acquisition and recording system; and storing, using a remote data manager, at least one of the data and the processed data in a remote data repository. ### Claim 6 (depends on 1) The method of claim 1, the data comprising at least one of positive train control event logs and network dispatch system data. ### Claim 7 (depends on 1) The method of claim 1, further comprising: continuously monitoring, using a back office, the data for critical events and regulatory requirements based on operational performance. ### Claim 8 (depends on 1) The method of claim 1, wherein the data acquisition and recording system receives the data via at least one of a wireless data link and a wired data link. ### Claim 9 (depends on 1) The method of claim 1, further comprising: coordinating time-synchronized event recorder data and geographic position data with video of a cab of the specified mobile asset and of features adjacent to a course of travel of the specified mobile asset. ### Claim 10 (depends on 1) The method of claim 1, further comprising: analyzing, using the video analytics system, the performance of the specified mobile asset operator by viewing the displayed data and comparing the displayed data to rules directed to safe operation of mobile assets. ### Claim 11 (depends on 1) The method of claim 1, further comprising: analyzing, using the video analytics component, the data including operational data, performance data, and behavioral characteristics related to a predetermined geographic segment, the specified mobile asset operator, and the specified time range based on specified government regulatory requirements for one of certification and decertification of the specified mobile asset operator. ### Claim 12 (depends on 1) The method of claim 1, further comprising: receiving, using the data acquisition and recording system, data related to the mobile asset operator and the specified time range, the data comprising at least one of fuel data, weather data, train consist data, and movement authority data for a specified course of movement of the mobile asset, crew data, and time data. ### Claim 13 (depends on 1) The method of claim 1, wherein displaying the processed data includes displaying at least one of critical geographic zones of operation, critical operational areas, work zones, regulatory-based alerts based on algorithms, and regulatory-based alerts based on output receiving from the artificial intelligence component. ### Claim 14 (depends on 1) The method of claim 1, further comprising: receiving, using the web portal, user comments related to at least one of a specific event identified in the data and a period of time identified in the data; and displaying, using the web portal, the user comments. ### Claim 15 (depends on 1) The method of claim 1, further comprising: generating a summarized report of the specified mobile asset operator's performance; and displaying, using the web portal, the summarized report. ### Claim 16 (depends on 1) The method of claim 1, further comprising: determining an automated score-based recommendation for one of certification and decertification of the specified mobile asset operator. ### Claim 17 A system for automating the assessment of performance skills of a specified mobile asset operator, comprising: a web portal adapted to receive a request from a user comprising the specified mobile asset operator of a mobile asset and a specified time range; a data acquisition and recording system onboard the mobile asset adapted to receive data related to the specified mobile asset operator and the specified time range, the data based on at least one signal from at least one of at least one data source onboard the mobile asset comprising at least one of at least one camera and at least one data recorder of the data acquisition and recording system and at least one data source remote from the mobile asset; and an artificial intelligence component of a video analytics system adapted to process the data into processed data; the web portal adapted to display the processed data including at least one video on a display device. ### Claim 18 (depends on 17) The system of claim 17, the at least one camera comprising at least one of at least one 360 degrees camera located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, at least one fixed camera located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, and at least one microphone located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, wherein the at least one 360 degrees camera is one of inward facing and outward facing and the at least one fixed camera is one of inward facing and outward facing. ### Claim 19 (depends on 17) The system of claim 17, the at least one data source onboard the mobile asset comprising at least one video recorder located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, at least one sound recorder located in at least one of in the mobile asset, on the mobile asset, and in the vicinity of the mobile asset, at least one accelerometer, at least one gyrometer, and at least one magnetometer. ### Claim 20 (depends on 17) The system of claim 17, the data comprising at least one of event data recorder data, accelerometer data, gyroscope data, fuel volume data, microphone data, inward camera data, and outward camera data. ### Claim 21 (depends on 17) The system of claim 17, further comprising: an onboard data manager of the data acquisition and recording system adapted to store at least one of the data and the processed data in at least one of a back office and at least one local memory component of a data recorder of the data acquisition and recording system; and a remote data manager adapted to store at least one of the data and the processed data in a remote data repository. ### Claim 22 (depends on 17) The system of claim 17, the data comprising at least one of positive train control event logs and network dispatch system data. ### Claim 23 (depends on 17) The system of claim 17, further comprising: a back office adapted to continuously monitor the data for critical events and regulatory requirements based on operational performance. ### Claim 24 (depends on 17) The system of claim 17, the data acquisition and recording system further adapted to receive the data via at least one of a wireless data link and a wired data link. ### Claim 25 (depends on 17) The system of claim 17, the data acquisition and recording system further adapted to coordinate time-synchronized event recorder data and geographic position data with video of a cab of the specified mobile asset and of features adjacent to a course of travel of the specified mobile asset. ### Claim 26 (depends on 17) The system of claim 17, the video analytics system further adapted to analyze the performance of the specified mobile asset operator by viewing the displayed data and compare the displayed data to rules directed to safe operation of mobile assets. ### Claim 27 (depends on 17) The system of claim 17, the video analytics system further adapted to analyze the data including operational data, performance data, and behavioral characteristics related to a predetermined geographic segment, the specified mobile asset operator, and the specified time range based on specified government regulatory requirements for one of certification and decertification of the specified mobile asset operator. ### Claim 28 (depends on 17) The system of claim 17, the data acquisition and recording system further adapted to receive data related to the mobile asset operator and the specified time range, the data comprising at least one of fuel data, weather data, train consist data, and movement authority data for a specified course of movement of the mobile asset, crew data, and time data. ### Claim 29 (depends on 17) The system of claim 17, the web portal adapted to display the processed data including displaying at least one of critical geographic zones of operation, critical operational areas, work zones, regulatory-based alerts based on algorithms, and regulatory-based alerts based on output receiving from the artificial intelligence component. ### Claim 30 (depends on 17) The system of claim 17, the web portal further adapted to receive user comments related to at least one of a specific event identified in the data and a period of time identified in the data and adapted to display the user comments. ### Claim 31 (depends on 17) The system of claim 17, the data acquisition and recording system further adapted to generate a summarized report of the specified mobile asset operator's performance and the web portal further adapted to display the summarized report. ### Claim 32 (depends on 17) The system of claim 17, the data acquisition and recording system further adapted to determine an automated score-based recommendation for one of certification and decertification of the specified mobile asset operator.