Particle tracking method for broken coral soil based on multimodal model

A particle tracking method for coral particles in soil based on a multimodal model, comprising the following steps:

• S1, conducting a triaxial test using a transparent rubber triaxial membrane;
• S2, shooting layers of coral soil particles in real time by two cameras and saving the images taken;
• S3, obtaining a three-dimensional cloud image of surface particles by three-dimensional reconstruction of the images taken in S2 through a binocular vision algorithm;
• S4, expanding a side of the triaxial specimen taken in S2 into a plane by a bilinear interpolation method;
• S5, improving a small sample counting model;
• S6, counting the coral soil particles in the image by using an improved small sample counting model, and outputting the position of each target;
• S7, inputting the image in S6 into a segmentation model, segmenting the coral soil particles, and obtaining a segmentation result of the coral soil particles;
• S8, according to the segmentation results of coral soil particles in S7, obtaining contour coordinates of the coral soil particles, and calculating an aspect ratio, convexity, sphericity, roundness, and Feret diameter of coral soil particles according to the contour coordinates;
• S9, inputting multiple images processed in S4 into an optimized BoT-SORT algorithm, and then performing a multi-target tracking, and adding a crushing matching mechanism in a multi-target tracking process;
• S10, inputting the tracking results in S9 into the three-dimensional cloud map of S3, and obtaining a three-dimensional motion trajectory of the surface coral soil particles during the test.