Parsing an Ink Document using Object-Level and Stroke-Level Processing

A method for parsing ink stroke data, comprising:

• receiving ink stroke data from an ink capture device, the ink stroke data describing a plurality of ink strokes in an ink document;
• converting the ink stroke data into an ink image;
• mapping the ink image into an image feature embedding;
• classifying individual pixels in the ink image based on the image feature embedding, to produce stroke-level information;

A computer-readable storage medium for storing computer-readable instructions, the computer-readable instructions, when executed by one or more hardware processors, performing a method that comprises:

• receiving ink stroke data from an ink capture device, the ink stroke data describing a plurality of ink strokes in an ink document;
• performing stroke-level processing on the plurality of ink strokes in the ink document, to produce stroke-level information, the stroke-level information identifying at least one characteristic associated with each ink stroke;
• performing object-level processing on individual objects within the ink image, to produce object-level information, the object-level information identifying one or more groupings of ink strokes in the ink document;
• determining a stroke-based classification associated with a particular ink stroke based on the stroke-level information;
• determining an object-based classification associated with a particular object, the particular object being associated with a region in the ink image, and being associated with a particular grouping of ink strokes;
• determining whether the particular ink stroke intersects the region associated with the particular object;
• and
• determining whether the particular ink stroke is a member of the particular object based on a rule that specifies that:
• the particular ink stroke is a member of the particular object when the particular ink stroke intersects the region by at least a prescribed amount, and the particular ink stroke and the particular object have a same classification;
• and the particular ink stroke is not a member of the particular object when the particular ink stroke and the particular object do not have a same classification.