US 12,694,706 B1Granted

Fish identification apparatus and method

OwnerBrian Patrick Moffattinventor

Life of this patent

Estimating the term…

Loading patent…

Abstract

A fish detection system that is deployed behind a vessel and is trolled therebehind wherein the invention provides surveillance, tracking and identification of marine species. The invention includes a species database having a multitude of frames of video footage wherein the video footage has had the grid cell structure thereof analyzed. The video data within the species database is subjected to data augmentation and data optimization. A camera captures a live video stream sourced from behind a vessel in motion wherein the live video stream is analyzed utilizing the metrics and images from the species database. The fish identification system provides elimination of baitfish and baitfish rigs from the video stream. Detection of a marine species occurs and subject to detection the marine species is tracked and surrounded by bounding boxes while all other image data is rejected. Notification of the identified marine species is provided both visually and audially.

Claims14

Dependent claims

A fish identification method that is configured to be deployed behind a marine vessel wherein the fish identification method comprises the steps of:

collecting a multitude of underwater visual video footage, wherein the underwater visual video footage includes images of fish species;
analyzing the underwater visual video footage, wherein the underwater visual video footage is analyzed for fish species identification;
distinguishing the fish species identification;
storing the fish species identification in a database, wherein the fish species identification is labeled in the database;
mounting a camera assembly to the marine vessel, wherein the camera assembly is mounted to the marine vessel utilizing a camera mount;
deploying the camera assembly into water behind the vessel, wherein the camera assembly includes a camera operably coupled to a housing;
towing the camera assembly behind the vessel;
capturing a video data, wherein the camera is employed to capture video feed of the area of water behind the vessel;
analyzing the video data, wherein the video data captured by the camera is continuously analyzed;
identifying a presence of at least one fish, wherein the at least one fish is captured in the video data from the camera assembly;
comparing the video data of the at least one fish to the database;
establishing an identity of the at least one fish, wherein the data comparison of the video data with the fish species identification confirms an identity of the at least one fish;
providing a notification to a user of the presence of the at least one fish, wherein the notification provides the confirmation of the identity of the species of the at least one fish in the video data;
tracking the at least one fish, wherein the at least one fish is tracked in the video data;
augmenting the underwater visual video footage, wherein the underwater visual video footage is augmented and optimized prior to storing in the database;
providing identification of a plurality of types of baitfish and baitfish rigs, wherein video data of baitfish and baitfish rigs is stored in the database;
eliminating video data of baitfish and baitfish rigs from the video data captured by the camera.

14 more elements

A method of identifying fish behind a marine vessel wherein the method comprises the steps of:

collecting a multitude of underwater visual video footage, wherein the underwater visual video footage includes images of fish species;
analyzing the underwater visual video footage, wherein the underwater visual video footage is analyzed for fish species identification;
segmenting the underwater visual video footage, wherein the underwater visual video footage is segmented into frames at a frequency of five to ten frames per second;
annotating each frame of the underwater visual video footage, wherein the frames are annotated for fish species and baitfish types;
establishing a database, wherein the database is created from the underwater visual video footage and has fish species identification stored therein;
mounting a camera assembly to the marine vessel, wherein the camera assembly is mounted to the marine vessel utilizing a camera mount, wherein the camera mount includes a portion configured to be journaled into a rod holder of the marine vessel, said camera mount having operably coupled thereto a controller and a cable spool, said cable spool having a video cable operably coupled to the camera assembly;
deploying the camera assembly into water behind the marine vessel, wherein the camera assembly includes a camera operably coupled to a housing;
towing the camera assembly behind the vessel;
capturing a video data, wherein the camera is employed to capture video feed of the area of water behind the vessel;
segmenting the video data into a grid structure, wherein the video data from the camera is segmented into a grid structure;
eliminating baitfish and baitfish rigs from the video data, wherein the baitfish and baitfish rigs present in the video data from the camera is eliminated;
identifying a presence of at least one fish, wherein the at least one fish is captured in the video data from the camera assembly;
surrounding the at least one fish with bounding boxes, wherein in the video data from the camera the at least one fish is surrounded with bounding boxes;
comparing the video data of the at least one fish to the database;
establishing an identity of the at least one fish, wherein the data comparison of the video data with the fish species identification in the database confirms an identity of the at least one fish;
providing a notification to a user of the presence of the at least one fish, wherein the notification provides the confirmation of the identity of the species of the at least one fish in the video data;
tracking the at least one fish, wherein the at least one fish is tracked in the video data.

14 more elements

Dependencies are inferred from the claim text.