Machine learning-based diagram label recognition
AssigneeSap SE
InventorsBernhard Schaefer, Andreas Gerber
Life of this patent
Estimating the term…
Abstract
Mechanisms are disclosed for machine learning-based diagram label recognition in connection with diagrams represented by unstructured images. An unstructured image of the diagram is received. A plurality of text blocks associated with the diagram is detected. The text blocks are associated with labels contained within the diagram. Textual contents of the text blocks and the labels are recognized. The labels are associated with corresponding edges and shapes within the diagram.
Claims20
One or more non-transitory computer-readable media storing computer-executable instructions that, when executed by a processor, perform a method for machine learning-based diagram label recognition in connection with a diagram represented by an unstructured image of the diagram, the method comprising:
- receiving the unstructured image of the diagram;
- detecting a plurality of text blocks associated with the diagram;
- associating the text blocks with labels contained within the diagram;
- recognizing textual contents of the text blocks and the labels;
- and
- associating the labels with corresponding edges and shapes within the diagram.
A method for machine learning-based diagram label recognition in connection with diagrams represented by unstructured images, the method comprising:
- receiving the unstructured image of the diagram;
- detecting a plurality of objects associated with the diagram;
- associating the plurality of objects with labels contained within the diagram;
- recognizing textual contents of the labels;
- and
- associating the labels with corresponding edges and shapes within the diagram.
A system for machine learning-based diagram label recognition in connection with diagrams represented by unstructured images, the system comprising:
- at least one processor;
- and at least one non-transitory memory storing computer executable instructions that when executed by the at least one processor cause the system to carry out actions comprising:
- receiving the unstructured image of the diagram;
- detecting a plurality of text blocks associated with the diagram by:
- recognizing textual contents associated with the plurality of text blocks;
- and
- recognizing edges of objects contained within the diagram based on relationships between one or more blocks of text;
- associating the plurality of text blocks with labels contained within the diagram;
- recognizing textual contents of the labels;
- and
- associating the labels with corresponding edges and shapes within the diagram.
Dependencies are inferred from the claim text.