Methods and systems of detecting object boundaries

A system of detecting object boundaries in a video, comprising:

• a non-transitory memory storing a set of instructions;
• and
• a processor coupled to the non-transitory memory, wherein the set of instructions are configured to cause the processor to perform:
• identifying a pixel of an image frame of a video;
• defining a patch for the pixel;
• identifying a set of neighboring image frames for the image frame, the set of neighboring image frames comprising an image frame that comes before and an image frame that comes after the image frame in the video;
• detecting a set of patch matches to the patch from the set of neighboring image frames by searching a plurality of patch transformations of the patch in each image frame of the set of neighboring image frames, wherein each patch match of the set of patch matches is detected by comparing pixels of the patch with pixels of a patch that is being matched, wherein the set of patch matches comprises a patch match for each image frame of the set of neighboring image frames;
• and
• calculating an object boundary probability value for the patch corresponding to the pixel by applying a difference metric to the patch and the set of patch matches;
• wherein the difference metric distinguishes patches corresponding to texture edges from patches corresponding to object boundaries, wherein the difference metric is a function of the set of patch matches, and wherein the difference metric is based on color and gradient information of the patch and the set of patch matches.