Vegetation detection and alert system for a railway vehicle

A method comprising detecting vegetation using an acquisition device mountable to a railway vehicle, the acquisition device including imaging sensors and a geospatial position sensor, the method comprising:

• capturing, by the imaging sensor, images of an environment of the railway vehicle including a clearance zone around a railroad track on which a railway vehicle moves, the imaging sensor capturing the images from the railway vehicle as the railway vehicle moves on the railroad track;
• determining, by the geospatial positioning sensor, a geolocation of the geospatial position sensor and thereby the environment imaged by the imaging sensor;
• referencing the images captured by the imaging sensor to the geolocation determined by the geospatial position sensor to form geospatial images of the environment including the clearance zone;
• and for one or more geospatial images of the geospatial images,
• processing the one or more geospatial images to produce a geometric computer model of the environment in which objects in the environment are represented by a collection of geometry;
• detecting vegetation in the clearance zone based on the geometric computer model;
• and
• uploading the one or more geospatial images and a notification of detected vegetation from which a backend server is configured to generate an alert for a client.

An acquisition device mountable to a railway vehicle for detecting objects, optionally vegetation, the acquisition device comprising:

• an imaging sensor configured to capture images of an environment of the railway vehicle including a volumetric clearance zone around a railroad track on which the railway vehicle moves, the imaging sensor being configured to capture images from the railway vehicle as the railway vehicle moves on the railroad track;
• a geospatial position sensor configured to determine a geolocation of the geospatial position sensor and together with computer vision as needed to thereby contribute to accurate localization of the environment and objects imaged by the imaging sensor;
• and
• a processor coupled to the imaging sensor and geospatial position sensor, and programmed to at least:
• reference the images captured by the imaging sensor to the geolocation determined by the geospatial position sensor, the geometric parameters of the imaging sensors and object properties in the images to form geospatially referenced images of the environment including the clearance zone;
• and for one or more geospatial images of the geospatial images,
• process the one or more geospatially referenced images to produce a localized geometric computer model of the volumetric environment in which objects in the environment are represented by a collection of geometry and plurality of image pixels and whole images;
• detect and localize objects in the clearance zone based on the geometric computer model and the plurality of image pixels and whole images;
• and
• upload the one or more geospatial images and a notification of detected and localized objects from which an alert can optionally be generated.