Systems and methods for automatically identifying available docking positions using a vision system of a marine vessel
AssigneeBrunswick Corporation
InventorsRakshith Sudhir Singh, Jimit J. Gosar
Life of this patent
Estimating the term…
Abstract
A system for automatically identifying available docking positions using a vision system of a marine vessel is provided, the system comprising: an imaging device, wherein the imaging device is configured to be mounted to the marine vessel with an associated field of view of an environment of the marine vessel; and one or more hardware processors configured to: identify, based on image data captured using the imaging device, a dock instance; determine, based on the image data, whether the dock instance is available for docking; indicate that the dock instance is an available docking position; and cause the marine vessel to maneuver to the available docking position.
Claims20
A system for automatically identifying available docking positions using a vision system of a marine vessel, the system comprising:
- an imaging device,
- wherein the imaging device is configured to be mounted to the marine vessel with an associated field of view of an environment of the marine vessel;
- and
- one or more hardware processors configured to:
- identify, based on image data captured using the imaging device, a dock instance;
- determine, based on the image data, whether the dock instance is available for docking;
- indicate that the dock instance is an available docking position;
- and
- cause the marine vessel to maneuver to the available docking position.
A method for automatically identifying available docking positions using a vision method of a marine vessel, the method comprising:
- identifying, based on image data captured using an imaging device, a dock instance,
- wherein the imaging device is configured to be mounted to the marine vessel with an associated field of view of an environment of the marine vessel;
- determining, based on the image data, whether the dock instance is available for docking;
- indicating that the dock instance is an available docking position;
- and
- causing the marine vessel to maneuver to the available docking position.
A system for automatically identifying available docking positions using a vision system of a marine vessel, the system comprising:
- a marine propulsion system comprising one or more propulsion devices;
- a display device;
- an input device;
- an imaging device,
- wherein the imaging device is configured to be mounted to the marine vessel with an associated field of view of an environment of the marine vessel;
- and
- one or more hardware processors configured to:
- capture an image using the imaging device;
- provide the image to a trained object detection model,
- wherein the trained object detection model is trained to identify instances of objects in image data corresponding to a plurality of classes, including a dock class;
- receive, from the trained object detection model, a dock bounding box indicative of a location and size of a dock instance in the image;
- provide the image data to a trained image segmentation model,
- wherein the trained image segmentation model is trained to classify each portion of image data as corresponding to a class of a second plurality of classes, including a water class;
- receive, from the trained image segmentation model, segmentation information indicative of a portions of the image classified as water;
- determine that no more than a threshold portion of the dock bounding box overlaps a bounding box of a different class of the plurality of classes;
- determine, based on the dock bounding box and the segmentation information, that the dock instance is unoccupied;
- present, using the display device, a graphical user interface that includes a model of the marine environment and a selectable user interface element corresponding to the dock instance;
- receive, via the input device, a selection of the selectable user interface element;
- and
- in response to selection of the selectable user interface element, control the marine propulsion system to automatically maneuver the marine vessel to dock at the dock instance without further user intervention.
Dependencies are inferred from the claim text.