# US 10,311,134 B2 · Data processing systems, devices, and methods for content analysis > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,134 B2 - Document ID: US10311134B2 - Status: Granted - Kind: B2 - Application number: 15/047,814 - Filed: 2016-02-19 - Published: 2016-06-16 - Granted: 2019-06-04 - Earliest claimed: 2011-09-21 - Applicants: Roman Tsibulevskiy; Barry Greenbaum - Inventors: Roman Tsibulevskiy; Barry Greenbaum - Web page: https://patentgrep.com/patent/US10311134B2 ## CPC - G06V 30/1423: {the instrument generating sequences of position coordinates corresponding to handwriting (preprocessing or recognising digital ink G06V30/32)} - G06F 16/24553: {of query operations} - G06F 16/248: Presentation of query results - G06F 16/3344: {using natural language analysis} - G06F 16/94: {Hypermedia (Hyperlinking G06F40/134)} - G06F 40/169: Annotation, e.g. comment data or footnotes - G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 11/60: Creating or editing images; Combining images with text - G06V 30/224: of printed characters having additional code marks or containing code marks - G06V 30/244: using graphical properties, e.g. alphabet type or font - G06V 30/414: Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text - G06V 30/416: Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Systems, devices and methods operative for identifying a reference within a figure and an identifier in a text associated with the figure, the reference referring to an element depicted in the figure, the reference corresponding to the identifier, the identifier identifying the element in the text, placing the identifier on the figure at a distance from the reference, the identifier visually associated with the reference upon the placing, the placing of the identifier on the figure is irrespective of the distance between the identifier and the reference. ## Claims ### Claim 1 A method comprising: accessing, via a processor, a first drawing comprising a first blueprint content containing an element and a callout, wherein the element is associated with the callout, wherein the first drawing is stored in a directory; recognizing, via the processor, the callout while the first drawing is stored in the directory; identifying, via the processor, an alphanumeric content in a second drawing based on the callout being recognized, wherein the second drawing comprises a second blueprint content, wherein the second blueprint content relates to the first blueprint content, wherein the second drawing is stored in the directory; and hyperlinking, via the processor, the callout while the first drawing and the second drawing are stored in the directory such that at least one of a popup, a hover-over, or a slide out is displayed when the callout is activated, wherein the at least one of the popup, the hover-over, or the slide out comprises an informational content that is hyperlinked, wherein the informational content leads to the second drawing based on the alphanumeric content when the informational content is activated. ### Claim 2 (depends on 1) The method of claim 1, wherein the processor is of a server, wherein the processor of the server is programmed to present the second drawing to a browser of a client based on the informational content being activated via the browser. ### Claim 3 (depends on 1) The method of claim 1, wherein the callout includes a shape that is closed, wherein the alphanumeric content is a second alphanumeric content, wherein the callout includes a first alphanumeric content, wherein the second alphanumeric content is identified based on matching the first alphanumeric content. ### Claim 4 (depends on 2) The method of claim 2, wherein the shape is color-filled before the callout is activated such that the shape is visually distinct relative to the first blueprint content. ### Claim 5 (depends on 1) The method of claim 1, wherein the second blueprint content includes the alphanumeric content. ### Claim 6 (depends on 1) The method of claim 1, wherein the second blueprint content is a sub-content of the first blueprint content. ### Claim 7 (depends on 1) The method of claim 1, wherein the alphanumeric content is a second alphanumeric content, wherein the callout includes a first alphanumeric content, wherein the second alphanumeric content is identified in the second drawing based on forming, via the processor, a copy of the first alphanumeric content, searching, via the processor, the second drawing for the copy, locating, via the processor, a match between the second alphanumeric content and the copy. ### Claim 8 (depends on 7) The method of claim 7, wherein the match is a partial match. ### Claim 9 (depends on 7) The method of claim 7, wherein the match is a full match. ### Claim 10 (depends on 1) The method of claim 1, wherein the first drawing is not scanned. ### Claim 11 (depends on 1) The method of claim 1, wherein the second drawing is not scanned. ### Claim 12 (depends on 1) The method of claim 1, wherein the alphanumeric content is a second alphanumeric content, wherein the callout includes a first alphanumeric content, wherein the processor is programmed to present a closed shape about the first alphanumeric content after the callout is hyperlinked. ### Claim 13 (depends on 12) The method of claim 12, wherein the closed shape is colored internally such that the closed shape is visually distinct relative to the first blueprint content. ### Claim 14 (depends on 1) The method of claim 1, wherein the popup is displayed when the callout is activated. ### Claim 15 (depends on 1) The method of claim 1, wherein the hover-over is displayed when the callout is activated. ### Claim 16 (depends on 1) The method of claim 1, wherein the slide out is displayed when the callout is activated. ### Claim 17 (depends on 1) The method of claim 1, wherein the informational content includes a text. ### Claim 18 (depends on 1) The method of claim 1, wherein the informational content includes an image. ### Claim 19 A method comprising: receiving, via a server, a first page from a client, wherein the first page includes a first blueprint content and a first region, wherein the first region is external to the first blueprint content, wherein the first region contains a first alphanumeric character; storing, via the server, the first page in a directory; receiving, via the server, an input from the client after the first page is stored in the directory, wherein the input selects the first region; performing, via the server, a first OCR technique on the first region based on the input such that the first alphanumeric character is recognized while the first page is stored in the directory; receiving, via the server, a second page from the client, wherein the second page includes a second blueprint content and a second region, wherein the second region is external to the second blueprint content, wherein the second region contains a second alphanumeric character; storing, via the server, the second page in the directory; performing, via the server, a second OCR technique on the second region based on the input such that the second alphanumeric character is recognized while the second page is stored in the directory; and presenting, via the server, the first alphanumeric character and the second alphanumeric character to the client after the second OCR technique is performed while the first drawing is stored in the directory and the second drawing is stored in the directory. ### Claim 20 (depends on 19) The method of claim 19, wherein the first page is included in a PDF file.