System and method for capturing and interpreting images into triple diagrams

A method of creating an editable image and editable text, comprising:

• receiving a raw image from an image acquisition device;
• modifying the raw image to a modified image to include at least one of at least one of reduced noise, normalized raw image data, reduced pixels, and combinations thereof;
• recognizing horizontal, vertical, and diagonal lines in the modified image using a line recognizer;
• connecting the lines in the modified image to form connected lines using a connector that detects and joins proximally positioned terminal ends of the lines in the modified image;
• recognizing areas bounded by the connected lines as bounded objects using a bounded object recognizer;
• and
• overlaying the bounded objects over the raw image to produce a hybrid user interface structure in which the bounded objects are each separate complete geometric shapes that are independently manipulatable from the underlying raw image by a computer image editor application.

An image processing system, comprising:

• a raw image capturing system, wherein the raw image capturing system comprises a camera, wherein the camera captures an RGB image of a print or display graph;
• a pixel reducer, wherein the pixel reducer receives the captured image from the camera and in response converts the image to greyscale and resizes it to pre-set dimensions;
• a background remover, wherein the background remover receives the modified image from the pixel reducer and in response removes the image background, retaining in the image greyscale lines;
• a noise reducer, wherein the noise reducer receives a modified image from the background remover and in response adjusts threshold values to minimize a number of unconnected pixel values;
• an image normalizer, wherein the image normalizer receives a modified image from the noise reducer and in response performs threshold operations to produce a monochrome image;
• an image processor, wherein the image processor receives a modified image from the image normalizer and in response performs processing to convert the image into a final format in which image lines and other geometric objects are manipulatable;
• and
• a client device comprising a computer image editor application that overlays the bounded objects over the raw image to produce a hybrid user interface structure in which the bounded objects are each separate complete geometric shapes that are independently manipulatable from the underlying raw image by the computer image editor.

A triple diagram generator, comprising:

• an image processor, wherein the image processor outputs a set of drawing objects comprising at least one of lines, text strings, shapes, and combinations thereof, generated by transforming a print or display graph, said drawing objects sent to a stencilizer, a line characterizer, and a label characterizer;
• a stencilizer, wherein the stencilizer accesses a database to locate stencils corresponding to drawing objects, wherein the correspondence between stencils and drawing objects is based upon text strings that the system identifies as being labels for the drawing objects;
• a line characterizer, wherein the line characterizer analyzes lines that are not part of shapes in the drawing for characteristics indicative of a line type including at least one of communication lines, stem lines, and combinations thereof, wherein lines are tagged their characteristic type and at least one of source and destination objects for communication lines, a shape object being labeled for object labels, a shape object actor for action stem lines, and combinations thereof;
• a label characterizer, wherein the label characterizer analyzes the text strings in the drawing for characteristics indicative of label types and tags the text strings with their characteristic type and other attributes including at least one selected from an associated communication line, a stem line, a shape object, and combinations thereof;
• a block diagrammer, wherein tagged labels, stencils, and lines are input to the block diagrammer along with drawing objects, and are transformed into a system block diagram;
• a flow charter, wherein tagged labels and tagged lines are input to the flow charter along with drawing objects, and are transformed into a flow chart;
• and
• a data flow diagrammer, wherein tagged labels and tagged lines are input to the data flow diagrammer along with drawing objects, and are transformed into a data flow diagram;
• each of the block diagrammer, flow charter, and data flow diagrammer overlaying the bounded objects over the raw image to produce a hybrid user interface structure in which the bounded objects are each separate complete geometric shapes that are independently manipulable from the underlying raw image by a computer image editor application.