Real-time monitoring of surroundings of marine vessel
AssigneeABB Schweiz AG
InventorsSanteri Vanhakartano, Kalevi Tervo, Eero Lehtovaara, Antti Pehkonen, Jari Saarinen
Life of this patent
Estimating the term…
Abstract
Real-time monitoring of surroundings of a marine vessel. One or more observation sensor modules are configured and positioned to generate sensor data extending around the marine vessel. One or more data processors are configured to map and visualize the sensor data in relation to a virtual model of the marine vessel. A user interface is configured to display the virtual model together with the visualized sensor data from a user selectable point of view to a mariner of the marine vessel.
Claims22
A system for real-time monitoring of surroundings of a marine vessel, comprising:
- one or more digital sensors and one or more object detection sensors of one or more observation sensors sensor modules configured and positioned to generate sensor data extending around the marine vessel, wherein the object detection sensors comprise one or more of a radar system, a lidar system, a sonar system, an ultrasound detection system, or an acoustic system;
- one or more data processors, communicatively coupled with the one or more observation sensors sensor modules, wherein the one or more data processors are configured to:
- detect one or more objects in the surroundings of the marine vessel based on analyzing the sensor data,
- combine data from different sensors, and
- map and visualize the detected one or more objects in relation to a virtual model of the marine vessel that is in scale and perspective of a view in real time, wherein the scale of the virtual model is a 1:1 scale, while receiving selection and viewing angle data input through a user interface from a mariner;
- a transceiver, communicatively coupled with the one or more data processors, and configured to transmit the analyzed sensor data to a second marine vessel;
- and
- the user interface, communicatively coupled with the one or more data processors, and configured to display the virtual model together with the visualized sensor data, and the detected one or more objects from at least two user selectable point of views to a mariner of the marine vessel using a split-screen technique.
A computer-implemented method for real-time monitoring of surroundings of a marine vessel, comprising:
- obtaining sensor data extending around the marine vessel from one or more digital sensors and one or more object detection sensors of one or more observation sensors, wherein the object detection sensors comprise one or more of a radar system, a lidar system, a sonar system, an ultrasound detection system, or an acoustic system;
- detecting one or more objects in the surroundings of the marine vessel based on analyzing the sensor data,
- combining data from different sensors, and
- mapping and visualizing the detected one or more objects in relation to a virtual model of the marine vessel that is in scale and perspective of a view in real time, wherein the scale of the virtual model is a 1:1 scale, while receiving selection and viewing angle data input through a user interface from a mariner;
- transmitting the analyzed sensor data to a second marine vessel;
- displaying the virtual model, together with the visualized sensor data, and the detected one or more objects, from at least two user selectable point of views to the mariner of the marine vessel using a split-screen technique.
A non-transitory computer-readable medium comprising computer program code, which, when loaded into one or more data processors and executed by the one or more data processors, causes the one or more data processors to perform computer implemented real-time monitoring of surroundings of a marine vessel comprising:
- obtain sensor data extending around the marine vessel from one or more digital sensors and one or more object detection sensors of one or more observation sensors, wherein the object detection sensors comprises one or more of a radar system, a lidar system, a sonar system, an ultrasound detection system, or an acoustic system;
- detecting one or more objects in the surroundings of the marine vessel based on analyzing the sensor data,
- combining data from different sensors, and
- mapping and visualizing the detected one or more objects in relation to a virtual model of the marine vessel that is in scale and perspective of a view in real time, wherein the scale of the virtual model is a 1:1 scale, while receiving selection and viewing angle data input through a user interface from a mariner;
- transmitting the analyzed sensor data to a second marine vessel;
- display the virtual model, together with the visualized sensor data, and the detected one or more objects, from at least two user selectable point of views to the mariner of the marine vessel using a split-screen technique.
Dependencies are inferred from the claim text.