# US 9,323,431 B2 · User interface for drawing with electronic devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,323,431 B2 - Document ID: US9323431B2 - Status: Granted - Kind: B2 - Application number: 14/348,045 - Filed: 2012-05-31 - Published: 2014-09-11 - Granted: 2016-04-26 - Earliest claimed: 2012-05-31 - Assignees: Multitouch Oy - Applicants: Oliver Farshi; Tommi Ilmonen - Inventors: Oliver Farshi; Tommi Ilmonen - Web page: https://patentgrep.com/patent/US9323431B2 ## CPC - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 11/23: using straight lines or curves - G06T 11/60: Creating or editing images; Combining images with text - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method, apparatus and computer program for forming graphics in a drawing area based on user instructions. In response to addition or changing of a first graphical object, an interaction zone is formed around the first graphical object for a given continuation period. It is detected if a second graphical object is drawn starting from the interaction zone during the continuation period and if yes, the first graphical object is changed by merging the second graphical object with the first graphical object. ## Claims ### Claim 1 An apparatus, comprising: an input module configured to receive user instructions for forming graphics in a drawing area based on the user instructions; a processor configured to cause: in response to addition or changing of a first graphical object, forming an interaction zone around the first graphical object and activating a timer for a predetermined continuation period; detecting if a second graphical object is drawn starting from within the interaction zone during the continuation period and merging the second graphical object with the first graphical object, in response to positive detection; and, upon expiration of the timer, disabling the interaction zone. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the processor is configured to form the interaction zone dynamically during the addition or changing of the first graphical object. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein the processor is configured to form the interaction zone dynamically on drawing a line as if using a pen or a brush. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein the processor is configured to form the interaction zone when the first graphical object is completely added or changed. ### Claim 5 (depends on 4) The apparatus of claim 4, wherein the processor is configured to determine the completion of the adding or changing of the first graphical object in response to a pause signal being received from a user. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the processor is further configured to cause displaying of the interaction zone. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the processor is configured to form again the interaction zone around the first graphical object in response to detecting a user pointing at the first graphical object. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the processor is configured to require a further command for the forming again of the interaction zone. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein the processor is configured to operate in parallel with a plurality of first graphical objects. ### Claim 10 (depends on 1) The apparatus of claim 1, wherein the processor is configured to again invoke the interaction zone in response to detecting a re-invoking command and erasing a portion of the first graphical object in response to detecting drawing of a scribble over the first graphical object. ### Claim 11 (depends on 1) An apparatus as claimed in claim 1, wherein the timer is restarted in response to positive detection that the second graphical object is drawn starting from the interaction zone during the continuation period. ### Claim 12 A method for forming graphics in a drawing area based on user instructions, comprising: in response to addition or changing of a first graphical object, forming an interaction zone around the first graphical object and activating a timer for a predetermined continuation period; and detecting if a second graphical object is drawn starting from the interaction zone during the continuation period and merging the second graphical object with the first graphical object, in response to positive detection; and, upon expiration of the timer, disabling the interaction zone. ### Claim 13 (depends on 12) The method of claim 12, further comprising causing drawing of a new second graphical object starting from the interaction zone. ### Claim 14 (depends on 12) The method of claim 12, wherein the interaction zone is formed dynamically during the addition or changing of the first graphical object. ### Claim 15 (depends on 12) The method of claim 12, wherein the interaction zone is formed when the first graphical object is completely added or changed. ### Claim 16 (depends on 12) The method of claim 12, further comprising causing displaying of the interaction zone. ### Claim 17 (depends on 12) The method of claim 12, wherein the method further comprises forming again the interaction zone around the first graphical object in response to detecting a user pointing at the first graphical object. ### Claim 18 (depends on 12) The method of claim 12, wherein the method is applied in parallel for a plurality of first graphical objects. ### Claim 19 (depends on 12) The method of claim 12, further comprising subsequently again invoking the interaction zone in response to detecting a re-invoking command and erasing a portion of the first graphical object in response to detecting drawing of a scribble over the first graphical object. ### Claim 20 (depends on 19) The method of claim 19, wherein the detecting of the drawing of the scribble comprises determining at least two lines being drawn in opposing directions over the first graphical object. ### Claim 21 (depends on 12) A method as claimed in claim 12 further comprising restarting the timer in response to the positive detection the second graphical object is drawn starting from the interaction zone during the continuation period. ### Claim 22 A computer program stored in a non-transitory computer readable memory medium, comprising computer executable program code which when executed by at least one processor causes an apparatus to perform: in response to addition or changing of a first graphical object, forming an interaction zone around the first graphical object and activating a timer for a predetermined continuation period; detecting if a second graphical object is drawn starting from the interaction zone during the continuation period and if yes, merging the second graphical object with the first graphical object; and, upon expiration of the timer, disabling the interaction zone. ### Claim 23 (depends on 22) The computer program as claimed in claim 22, wherein upon detection that the second graphical object is drawn starting from the interaction zone during the continuation period, the timer is restarted.