Method and device for situation awareness

A non-transitory computer-readable storage medium storing instructions thereon, the instructions when executed by a processor cause the processor to:

• obtain a target maritime image generated from a camera, wherein the camera is installed on a port or a vessel, and the target maritime image represents a target object;
• obtain a target segmentation image using the target maritime image and a neural network,
• wherein the neural network is trained to output a segmentation image that is assigned values to at least some pixels of an input image in response to the input image,
• wherein a value is selected from identification values including at least a first value, a second value, and a third value,
• wherein the first value corresponds to a water surface, the second value corresponds to a first object at a first distance range, and the third value corresponds to the first object at a second distance range different from the first distance range,
• wherein the first distance range is closer than the second distance range,
• wherein, in the segmentation image, pixels in an area corresponding to an object are assigned the identification value corresponding to the object,
• wherein, in the segmentation image, different identifiers are assigned to each of objects corresponding to the second value;
• and
• determine a distance information related to the target object based on a value corresponding to the target object in the obtained target segmentation image.

A device for situation awareness, the device comprising:

• a memory storing a neural network, wherein the neural network is trained to output a segmentation image that is assigned values to at least some pixels of an input image in response to the input image, wherein a value is selected from identification values including at least a first value, a second value, and a third value, wherein the first value corresponds to a water surface, the second value corresponds to a first object at a first distance range, and the third value corresponds to the first object at a second distance range different from the first distance range, wherein, in the segmentation image, pixels in an area corresponding to an object are assigned the identification value corresponding to the object, wherein, in the segmentation image, different identifiers are assigned to each of objects corresponding to the second value, and
• a controller configured to:
• obtain a target maritime image generated from a camera, wherein the camera is installed on a port or a vessel, and the target maritime image represents a target object,
• obtain a target segmentation image using the target maritime image and a neural network, and
• determine a distance information related to the target object based on a value corresponding to the target object in the obtained target segmentation image.