# US 10,864,928 B2 · Monitoring system for train

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,864,928 B2
- Document ID: US10864928B2
- Status: Granted
- Kind: B2
- Application number: 15/786,704
- Filed: 2017-10-18
- Published: 2019-04-18
- Granted: 2020-12-15
- Earliest claimed: 2017-10-18
- Assignees: Progress Rail Locomotive Inc.
- Applicants: Progress Rail Locomotive Inc.
- Inventors: Alexander Shubs, Jr.; David Matthew Roenspies; James David Seaton
- Web page: https://patentgrep.com/patent/US10864928B2

## CPC

- B61L 23/041: {Obstacle detection}
- B61L 15/0072: {On-board train data handling}
- B61L 15/0081: {On-board diagnosis or maintenance}
- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- G06V 40/161: {Detection; Localisation; Normalisation}
- G08B 21/18: Status alarms (G08B21/02 takes precedence)
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- B61L 15/0094: {Recorders on the vehicle}
- B61L: GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC (brakes or auxiliary equipment B61H, B61K; point or crossing construction E01B)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A monitoring system for a train is provided. The monitoring system includes an image capturing device configured to capture a video feed of a designated area associated with the train. The monitoring system also includes a controller coupled to the image capturing device. The controller is configured to receive the video feed from the image capturing device. The controller is configured to analyze the video feed to determine if a predefined triggering event has occurred. The controller is configured to record and store a predefined length of the video feed based on the determination. The controller is configured to provide a notification of the recorded video feed to a user through a user interface. The controller is configured to allow the user to access at least a portion of the recorded video feed through the notification.

## Claims

### Claim 1

A monitoring system for a train, the monitoring system comprising:
an image capturing device configured to capture a video feed of a designated area associated with the train; and
a controller coupled to the image capturing device, the controller configured to:
receive the video feed from the image capturing device;
analyze the video feed to determine if a predefined triggering event has occurred, the predefined triggering event preceding a predefined rail event;
record and store a relevant section of the video feed in response to determining that the predefined triggering event has occurred, the relevant section of the video feed having a predefined length;
identify a priority type of the predefined triggering event that occurred, the priority type being one of a low priority, a medium priority and a high priority;
push a notification of the recorded and stored relevant section of the video feed to a user on a user interface immediately upon identifying the priority type of the predefined triggering event that occurred as high priority;
push the notification of the recorded and stored relevant section of the video feed to the user on the user interface once a period of time has elapsed after identifying the priority type of the predefined trigger event that occurred as medium priority or low priority; and
enable access by the user to at least a portion of the recorded and stored relevant section of the video feed through interaction with the notification on the user interface.

### Claim 2 (depends on 1)

The monitoring system of claim 1, wherein the controller is coupled to a display unit such that the user interface is provided on the display unit.

### Claim 3 (depends on 1)

The monitoring system of claim 1, wherein the controller is further configured to store a timestamp of a start of the triggering event in response to determining that the predefined triggering event has occurred.

### Claim 4 (depends on 1)

The monitoring system of claim 1, wherein the controller is further coupled to an electronic control module of the train for determination of the occurrence of the triggering event.

### Claim 5 (depends on 1)

The monitoring system of claim 1, wherein the length of the relevant section of the video feed is predefined, such that the monitoring system records the video feed for a predefined time period before each of a start and an end of the triggering event.

### Claim 6 (depends on 1)

The monitoring system of claim 1, wherein the controller is configured to any one of:
provide the notification and allow real-time viewing of the recorded and stored relevant section of the video feed in response to identifying the high priority type of the triggering event; or
log and flag the recorded and stored relevant section of the video feed in response to identifying the medium or low priority type of the triggering event.

### Claim 7 (depends on 1)

The monitoring system of claim 1, wherein the notification includes one of: a set of images, a thumbnail, or a URL link associated with the recorded video feed.

### Claim 8 (depends on 1)

The monitoring system of claim 1, wherein analyzing the video feed includes performing image analysis on the video feed for detecting if the triggering event has occurred.

### Claim 9 (depends on 1)

The monitoring system of claim 1, wherein the controller is provided at a location which is one of on-board the train or at a remote location.

### Claim 10

A method for monitoring a train, the method comprising:
receiving, by a controller, a video feed of a designated area associated with the train from an image capturing device;
analyzing, by the controller, the video feed to determine if a predefined triggering event has occurred, the predefined triggering event preceding a predefined rail event;
recording and storing, by the controller, a relevant section of the video feed in response to determining that the predefined triggering event has occurred, the relevant section of the video feed having a predefined length;
determining a priority type of the predefined triggering even that occurred, the priority type being one of a low priority, a medium priority and a high priority;
pushing, by the controller, a notification of the recorded and stored relevant section of the video feed to a user on a user interface immediately upon determining the priority type of the predefined triggering event that occurred is of high priority;
pushing, by the controller, the notification of the recorded and stored relevant section of the video feed to the user on the user interface once a period of time has elapsed after determining the priority type of the predefined triggering event that occurred is of medium priority or low priority; and
enabling, by the controller, access by the user to at least a portion of the recorded and stored relevant section of the video feed through interaction with the notification on the user interface.

### Claim 11 (depends on 10)

The method of claim 10 further comprising storing, by the controller, a timestamp of a start of the triggering event in response to determining that the predefined triggering event has occurred.

### Claim 12 (depends on 10)

The method of claim 10 further comprising any one of:
providing the notification and allowing real-time viewing of the recorded and stored relevant section of the video feed in response to identifying the high priority type of the triggering event by the controller; or
logging and flagging the recorded and stored relevant section of the video feed in response to identifying the low or medium priority type of the triggering event by the controller.

### Claim 13 (depends on 10)

The method of claim 10, wherein the notification includes one of: a set of images, a thumbnail, or a URL link associated with the recorded video feed.

### Claim 14 (depends on 10)

The method of claim 10, wherein analyzing the video feed step includes performing image analysis on the video feed for detecting if the triggering event has occurred.

### Claim 15

A train comprising:
an engine; and
a monitoring system comprising:
an image capturing device configured to capture a video feed of a designated area associated with the train; and
a controller coupled to the image capturing device, the controller configured to:
receive the video feed from the image capturing device;
analyze the video feed to determine if a predefined triggering event has occurred, the predefined triggering event preceding a predefined rail event;
record and store a relevant section of the video feed in response to determining that the predefined triggering event has occurred, the relevant section of the video feed having a predefined length;
push a notification of the recorded and stored relevant section of the video feed to a user on a user interface immediately upon determining the priority type of the predefined triggering event that occurred is of high priority;
push the notification of the recorded and stored relevant section of the video feed to the user on the user interface once a period of time has elapsed after determining the priority type of the predefined trigger event that occurred is of medium priority or low priority; and
enable access by the user to at least a portion of the recorded and stored relevant section of the video feed through interaction with the notification on the user interface.

### Claim 16 (depends on 1)

The monitoring system of claim 1, wherein the controller is configured to:
provide a timeline on the user interface; and
provide the notification on the user interface at a position relative to the timeline that indicates a start time of the predetermined triggering event.

### Claim 17 (depends on 16)

The monitoring system of claim 16, wherein the controller is configured to provide the notification on the user interface with a width relative to the timeline that indicates a duration of the recorded video feed.

### Claim 18 (depends on 1)

The monitoring system of claim 1, wherein the image capturing device is mounted on infrastructure associated with the train.

### Claim 19 (depends on 1)

The monitoring system of claim 1, wherein the controller is further configured to provide, to the user, a mitigating action to be taken by the user.

### Claim 20 (depends on 10)

The method of claim 10, the method further comprising providing the user with a mitigating action to be taken by the user.