Object segmentation method based on multimodal data fusion and image annotation tool

An object segmentation method based on multimodal data fusion, comprising steps of:

• S1:
• acquiring an initial RGB image, an initial infrared image, and an initial depth image that contain an object;
• S2:
• aligning the initial RGB image, the initial infrared image, and the initial depth image to obtain a first RGB image, a first infrared image, and a first depth image in a same coordinate system respectively;
• S3:
• specifying an initial prompt point in the first RGB image, and acquiring first masks characterizing an object region from the first RGB image, the first infrared image, and the first depth image through the initial prompt point respectively;
• S4:
• fusing pixel values of the images in different modalities based on the first masks of the first RGB image, the first infrared image, and the first depth image to obtain a second mask;
• and
• S5:
• determining a minimum bounding box of the object based on the second mask, and calibrating the minimum bounding box to obtain a segmentation result of the object.