# US 2017/0286378 A1 · Inserting text and graphics using hand markup > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0286378 A1 - Document ID: US20170286378A1 - Status: Published application - Kind: A1 - Application number: 15/087,596 - Filed: 2016-03-31 - Published: 2017-10-05 - Earliest claimed: 2016-03-31 - Assignees: Konica Minolta Laboratory U.S.A., Inc. - Applicants: Konica Minolta Laboratory U.S.A., Inc. - Inventors: Stuart Guarnieri; William John Briggs - Web page: https://patentgrep.com/patent/US20170286378A1 ## CPC - G06F 40/171: by use of digital ink - G06V 30/226: of cursive writing - G06V 30/40: Document-oriented image-based pattern recognition - G06V 30/10: Character recognition - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method may include obtaining an image that includes a first graphics element and a second graphics element, determining that the first graphics element corresponds to a command and that the second graphics element is a non-command, and generating an electronic document by executing the command. The electronic document may include a revised version of the second graphics element, but not the first graphics element. The electronic document may be generated in response to the first graphics element corresponding to the command. ## Claims ### Claim 1 A method for image processing, comprising: obtaining an image comprising a first graphics element and a second graphics element comprising a hand-drawn character; determining that the first graphics element corresponds to a command associated with a font and that the second graphics element is a non-command; and generating an electronic document comprising a text character corresponding to the hand-drawn character and in the font. ### Claim 2 (depends on 1) The method of claim 1, wherein determining that the first graphics element corresponds to the command comprises: extracting a plurality of characters from the first graphics element by executing intelligent character recognition (ICR) on the image, wherein the first graphics element is a hand-written string; identifying a command-invoking character within the plurality of characters; and mapping a subset of the plurality of characters to the command. ### Claim 3 (depends on 1) The method of claim 1, further comprising: identifying a third graphics element in the image, wherein the third graphics element corresponds to a command to insert a logo into the electronic document; and retrieving the logo from a repository external to the image in response to identifying the third graphics element, wherein the image does not include the logo, and wherein the electronic document comprises the logo. ### Claim 4 (depends on 1) The method of claim 1, further comprising: identifying a third graphics element in the image, wherein the third graphics element corresponds to a command to calculate a plurality of page numbers for the electronic document and calculating the plurality of page numbers for the electronic document in response to identifying the third graphics element, wherein the electronic document comprises the plurality of page numbers. ### Claim 5 (depends on 1) The method of claim 1, further comprising: identifying a third graphics element in the image, wherein the third graphics element corresponds to a command to insert a text string into the electronic document; and retrieving the text string from a repository external to the image in response to identifying the third graphics element, wherein the electronic document comprises the text string, wherein the text string exists before the image is obtained, and wherein the image does not include the text string. ### Claim 6 (depends on 1) The method of claim 1, further comprising: identifying a third graphics element in the image, wherein the third graphics element corresponds to a command associated with a document setting selected from a group consisting of a margin of the electronic document, a page size of the electronic document, and a background color of the electronic document; and modifying the electronic document based on the document setting. ### Claim 7 (depends on 1) The method of claim 1, wherein the command identifies a configuration file specifying a plurality of document settings including the font, and wherein the plurality of document settings in the configuration file is applied to the electronic document. ### Claim 8 (depends on 1) The method of claim 1, wherein the first graphics element is hand-drawn in the image on a writing board. ### Claim 9 A system for image processing, comprising: a memory storing an image comprising a first graphics element and a second graphics element comprising a hand-drawn character; and a processor connected to the memory that: determines that the first graphics element corresponds to a command associated with a font and that the second graphics element is a non-command; and generates an electronic document comprising a text character corresponding to the hand-drawn character and in the font. ### Claim 10 (depends on 9) The system of claim 9, wherein the command engine also: extracts a plurality of characters from the first graphics element by executing ICR on the image, wherein the first graphics element is a hand-written string on a writing board; identifies a command-invoking character within the plurality of characters; and maps a subset of the plurality of characters to the command. ### Claim 11 (depends on 9) The system of claim 9, wherein the processor also: identifies a third graphics element in the image, wherein the third graphics element corresponds to a command to insert a logo into the electronic document; and retrieves the logo from a repository external to the image in response to identifying the third graphics element. wherein the image does not include the logo, and wherein the electronic document comprises the logo. ### Claim 12 (depends on 9) The system of claim 9, wherein the processor also: identifies a third graphics element in the image, wherein the third graphics element corresponds to a command to calculate a plurality of page numbers for the electronic document; and calculates plurality of page numbers for the electronic document in response to identifying the third graphics elements, and wherein the electronic document comprises the plurality of page numbers. ### Claim 13 (depends on 9) The system of claim 9, wherein the processor also: identifies a third graphics element in the image, wherein the third graphics element corresponds to a command to insert a text string into the electronic document; and retrieves the text string from a repository in response to identifying the third graphics element, wherein the electronic document comprises the text string, and wherein the image does not include the text string. ### Claim 14 (depends on 9) The system of claim 9, further comprising a repository storing a configuration file specifying a plurality of document settings including the font, wherein the plurality of document settings in the configuration file is applied to the electronic document. ### Claim 15 A non-transitory computer readable medium storing computer readable program code embodied therein that: obtains an image comprising a first graphics element and a second graphics element comprising a hand-drawn character; determines that the first graphics element corresponds to a command associated with a font and that the second graphics element is a non-command; and generates an electronic document comprising a text character corresponding to the hand-drawn character and in the font. ### Claim 16 (depends on 15) The non-transitory computer readable medium of claim 15, wherein determining that the first graphics element corresponds to the command comprises: extracting a plurality of characters from the first graphics element by executing ICR on the image, wherein the first graphics element is a hand-written string on a writing board; identifying a command-invoking character within the plurality of characters; and mapping a subset of the plurality of characters to the command. ### Claim 17 (depends on 15) The non-transitory computer readable medium of claim 15, wherein the computer readable program code also: identifies a third graphics element in the image, wherein the third graphics element corresponds to a command to insert a logo into the electronic document; and retrieves the logo from a repository external to the image in response to identifying the third graphics element, wherein the image does not include the logo, and wherein the electronic document comprises the logo. ### Claim 18 (depends on 15) The non-transitory computer readable medium of claim 15, wherein the computer readable program code also: identifies a third graphics element in the image, wherein the third graphics element corresponds to a command to calculate a plurality of page numbers for the electronic document; and calculates a plurality of page numbers for the electronic document in response to identifying the third graphics element, wherein the electronic document comprises the plurality of page numbers. ### Claim 19 (depends on 15) The non-transitory computer readable medium of claim 15, wherein the computer readable program code also: identifies a third graphics element in the image, wherein the third graphics element corresponds to a command to insert a text string into the electronic document; and retrieves the text string from a repository in response to identifying the third graphics element, wherein the image does not include the text string, and wherein the electronic document comprises the text string. ### Claim 20 (depends on 15) The non-transitory computer readable medium of claim 15, wherein the command identifies a configuration file specifying a plurality of document settings including the font, and wherein the plurality of document settings in the configuration file is applied to the electronic document.