Interactive image segmentation

A system, comprising:

• a processor;
• and
• a memory device containing instructions which, when executed by the processor, cause the processor to:
• receive user interaction data comprising user contact points with a graphical user interface displaying an image;
• label a first subset of pixels of the image with an object identifier, wherein the first subset of pixels correspond to pixels in the displayed image coincident with the user contact points;
• pass pixel data representing pixels of the image through an embedding neural network model comprising meta-learned initialized parameters to generate a plurality of pixel embedding vectors corresponding to the pixels of the image;
• generate a prototype embedding vector associated with the object identifier based on pixel embedding vectors corresponding to the first subset of pixels;
• for each pixel of a second subset of pixels of the image, determine a probability that the pixel should be labeled with the object identifier based on the prototype embedding vector and pixel embedding vectors corresponding to the second subset of pixels;
• label one or more pixels in the second subset of pixel embedding vectors with the object identifier based on the determined probabilities;
• and
• segment the pixels in the image into a plurality of segments based on the pixels of the image labeled with the object identifier.

A computer program product comprising code stored in a non-transitory tangible computer-readable storage medium, the code comprising:

• code for labeling a first subset of pixels of an image based on user interactions with the image;
• code for passing pixel data representing the pixels of the image through an embedding neural network model comprising meta-learned initialized parameters to generate a plurality of pixel embedding vectors corresponding to the pixels of the image;
• code for generating an initial prototype embedding vector based on the pixel embedding vectors corresponding to the first subset of pixels;
• and code for updating the initial prototype embedding vector based on pixel embedding vectors corresponding to a second subset of pixels to generate a first prototype embedding vector;
• code for determining, for each pixel of the second subset of pixels, a probability that the pixel should be labeled with the first object identifier based on the first prototype embedding vector and the pixel embedding vectors corresponding to the second subset of pixels;
• code for labeling one or more of second subset of pixels with the first object identifier based on the determined probabilities;
• and code for segmenting the pixels in the image into a plurality of segments based on the pixels of the image labeled with the first object identifier.