# US 2020/0369351 A1 · Marine docking and object awareness system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0369351 A1
- Document ID: US20200369351A1
- Status: Published application
- Kind: A1
- Application number: 15/929,754
- Filed: 2020-05-20
- Published: 2020-11-26
- Earliest claimed: 2019-05-24
- Assignees: Garmin Switzerland GmbH
- Applicants: Garmin Switzerland GmbH
- Inventors: Thomas G. Behrendt; Michael T. Fickenscher; Clifford S. Hofman; Chun Wei Lin; Mei Huei Lin
- Web page: https://patentgrep.com/patent/US20200369351A1

## CPC

- G08G 3/02: Anti-collision systems
- B63B 49/00: Arrangements of nautical instruments or navigational aids (nautical measuring instruments G01C; radio navigation, analogous arrangements using other waves G01S)
- B63B 79/10: using sensors, e.g. pressure sensors, strain gauges or accelerometers
- G06T 7/11: Region-based segmentation
- G06T 7/136: involving thresholding
- G06T 7/194: involving foreground-background segmentation
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/292: Multi-camera tracking
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 11/65: on geographic maps
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30241: Trajectory
- G06T 2207/30261: Obstacle
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B63B: SHIPS OR OTHER WATERBORNE VESSELS; EQUIPMENT FOR SHIPPING (arrangements of vessel ventilation, heating, cooling, or air-conditioning B63J2/00; floating substructures as supports of dredgers or soil-shifting machines E02F9/06)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A marine docking and awareness system for facilitating docking and otherwise maneuvering vessels in marine environments. A navigation system may include a plurality of directional cameras and an image processing computer. Each directional camera generates images of the marine environment in a particular direction. The image processor processes the images from the cameras, including enhancing the images in accordance with various features. The features may include identifying and highlighting water and/or objects, adding distance markers, predicting and warning of collisions with objects, defining and adding virtual boundaries around the vessel and warning when an object crosses a boundary, automatically selecting the most relevant cameras based on the direction of movement or on an object crossing a boundary, combining multiple images from different cameras into an image, and displaying desired, projected, and historical tracks.

## Claims

### Claim 1

A navigation system to assist a user in maneuvering a vessel, the navigation system comprising:
an image processing computer configured to—
receive and process at least a first image generated by at least one camera mounted on the vessel,
detect and identify water and at least a first object in the first image, and
highlight the first object in the first image;
a display device configured to selectively display the first image processed by the image processing computer; and
a user interface configured to allow the user to provide input to the display device with regard to the display of the first image.

### Claim 2 (depends on 1)

The navigation system of claim 1, further including the at least one camera, the at least one camera including a plurality of directional cameras configured to generate directional images of the marine environment in at least two directions.

### Claim 3 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to highlight the water in the first image displayed on the display device.

### Claim 4 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to determine a speed and direction of movement of the first object relative to the vessel.

### Claim 5 (depends on 4)

The navigation system of claim 4, wherein the image processing computer is further configured to communicate a warning to the user when the speed and direction of movement of the first object relative to the vessel indicates that the first object and the vessel will collide.

### Claim 6 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to add a plurality of markers indicating a plurality of distances in the first image displayed on the display device.

### Claim 7 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to determine a direction of movement of the vessel and to automatically display the first image generated by the at least one camera oriented in the direction of movement.

### Claim 8 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to define a virtual boundary and to add the virtual boundary at a specified distance around the vessel to the first image displayed on the display device.

### Claim 9 (depends on 8)

The navigation system of claim 8, wherein the image processing computer is further configured to determine and communicate a warning to the user when the first object crosses the virtual boundary.

### Claim 10 (depends on 9)

The navigation system of claim 9, wherein the image processing computer is further configured to automatically display the first image generated by the at least one camera oriented in the direction of the first object.

### Claim 11 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to combine two or more images generated by two or more cameras to create a combined image.

### Claim 12 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to determine a velocity vector of the vessel and to add an indication of the velocity vector to the first image displayed on the display device.

### Claim 13 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to determine a projected track of the vessel and to add an indication of the projected track to the first image displayed on the display device.

### Claim 14 (depends on 1)

The navigation system of claim 1, wherein the image processing computer is further configured to record a track history of the vessel and to add an indication of the track history to the first image displayed on the display device.

### Claim 15

A navigation system to assist a user in maneuvering a vessel, the navigation system comprising:
an image processing computer configured to receive and process a plurality of images generated by a plurality of cameras mounted on the vessel, the image processing computer configured to—
detect and identify a first object in at least a first image of the plurality of images and highlighting the first object in the first image,
detect and identify water in the first image and highlighting the water in the first image, and
add a plurality of markers to the first image indicating a plurality of distances in the first image;
a display device configured to selectively display the plurality of images processed by the image processing computer, including the first image; and
a user interface configured to allow the user to provide input to the image processing computer and the display device with regard to how the plurality of images are processed and displayed, including the first image.

### Claim 16 (depends on 15)

The navigation system of claim 15, the plurality of cameras including a plurality of directional cameras, wherein each directional camera is mounted in a particular position on the vessel and oriented in a particular direction and configured to generate directional images of the marine environment in the particular direction.

### Claim 17 (depends on 15)

The navigation system of claim 15, wherein the image processing computer is configured to—
determine a speed and direction of movement of the first object relative to the vessel;
communicate a warning to the user when the speed and direction of movement of the first object relative to the vessel indicates that the first object and the vessel will collide; and
determine a direction of movement of the vessel and to automatically display the first image which is a directional image generated by a particular directional camera oriented in the direction of movement.

### Claim 18 (depends on 15)

The navigation system of claim 15, wherein the image processing computer is configured to—
define a virtual boundary and to add the virtual boundary at a specified distance around the vessel to the first image displayed on the display device;
determine and communicate a warning to the user when the first object crosses the virtual boundary; and
automatically display the first image which is a directional image generated by a particular directional camera oriented in the direction of the first object.

### Claim 19 (depends on 15)

The navigation system of claim 15, wherein the image processing computer is configured to—
determine a velocity vector of the vessel and to add an indication of the velocity vector to the first image displayed on the display device;
determine a projected track of the vessel and to add an indication of the projected track to the first image displayed on the display device; and
record a track history of the vessel and to add an indication of the track history to the first image displayed on the display device.

### Claim 20

A navigation system to assist a user in maneuvering a vessel, the navigation system comprising:
a plurality of directional cameras, wherein each directional camera is mounted in a particular position on the vessel and oriented in a particular direction and configured to generate directional images of the marine environment in the particular direction; and
an image processing computer configured to receive and process a plurality of images generated by the plurality of cameras mounted on the vessel, the image processing computer configured to—
detect and identify a first object in a first image of the plurality of images and highlighting the first object in the first image,
detect and identify water in the first image and to highlight the water in the first image, and
add a plurality of markers indicating a plurality of distances in the first image,
communicate a warning to the user when a speed and direction of movement of the first object relative to the vessel indicates that the first object and the vessel will collide,
define a virtual boundary and to add the virtual boundary at a specified distance around the vessel to the first image, and communicate a warning to the user when the first object crosses the virtual boundary, and
determine a velocity vector of the vessel and to add an indication of the velocity vector to the first image displayed on the display device;
a display device configured to selectively display the plurality of images processed by the image processing computer, including the first image; and
a user interface configured to allow the user to provide input to the image processing computer and the display device with regard to how the plurality of images are processed and displayed, including the first image.
