# US 2012/0236019 A1 · Structure-Preserving Clone Brush > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2012/0236019 A1 - Document ID: US20120236019A1 - Status: Published application - Kind: A1 - Application number: 13/445,700 - Filed: 2012-04-12 - Published: 2012-09-20 - Earliest claimed: 2003-04-30 - Assignees: EveryScape, Inc. - Inventors: Byong Mok Oh; Fredo Durand - Web page: https://patentgrep.com/patent/US20120236019A1 ## CPC - G06T 11/60: Creating or editing images; Combining images with text - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The invention provides tools and techniques for clone brushing pixels in an image while accounting for inconsistencies in apparent depth and orientation within the image. The techniques do not require any depth information to be present in the image, and the data structure of the image is preserved. The techniques allow for color compensation between source and destination regions. A snapping technique is also provided to facilitate increased accuracy in selecting source and destination positions. ## Claims ### Claim at position 1 1-20. (canceled) ### Claim 21 A method for clone-brushing in a 2D image comprising a) specifying a first world plane in the 2D image; b) providing a source position and a destination position in the 2D image; c) identifying a destination region in the 2D image relative to the destination position; d) determining a source region in the 2D image relative to the first world plane and corresponding to the destination region, using the source position and the destination position; e) transforming 2D image information of the source region to 2D image information of the destination region such that the perspective of the 2D image relative to the first world plane in the destination region is maintained; and f) copying the transformed 2D image information to the destination region. ### Claim 22 (depends on 21) The method of claim 21, wherein specifying a first world plane in the 2D image comprises specifying two sets of parallel lines. ### Claim 23 (depends on 21) The method of claim 21, wherein transforming 2D image information of the source region further comprises a bilinear interpolation of 2D image information in the source region relative to the first world plane. ### Claim 24 (depends on 21) The method of claim 21 further comprising: providing a first color sample region for the source region; providing a second sample color region for the destination region; and computing a color ratio between the second color sample region and the first color sample region, wherein transforming 2D image information of the source region relative to the first world plane further comprises applying the color ratio to the 2D image information of the source region. ### Claim 25 (depends on 24) The method of claim 24, wherein the color ratio is computed using Gaussian weighted averages of the first and second sample color regions. ### Claim 26 (depends on 24) The method of claim 24, wherein the first color sample region is provided with respect to the first world plane. ### Claim 27 A computer program product for clone-brushing in a 2D image, the computer program product comprising a non-transitory computer readable medium having computer readable program code stored thereon, the computer readable program code including program code for: a) specifying a first world plane in the 2D image; b) providing a source position and a destination position in the 2D image; c) identifying a destination region in the 2D image relative to the destination position; d) determining a source region in the 2D image relative to the first world plane and corresponding to the destination region, using the source position and the destination position; e) transforming 2D image information of the source region to 2D image information of the destination region such that the perspective of the 2D image in the destination region relative to the first world plane is maintained; and f) copying the transformed 2D image information to the destination region. ### Claim 28 (depends on 27) The computer program product of claim 27, wherein specifying a first world plane in the 2D image comprises specifying two sets of parallel lines. ### Claim 29 (depends on 27) The computer program product of claim 27, wherein transforming 2D image information of the source region further comprises a bilinear interpolation of 2D image information in the source region relative to the first world plane. ### Claim 30 (depends on 27) The computer program product of claim 27 further comprising program code for: providing a first color sample region for the source region; providing a second sample color region for the destination region; and computing a color ratio between the second color sample region and the first color sample region, wherein transforming 2D image information of the source region relative to the first world plane further comprises applying the color ratio to the 2D image information of the source region. ### Claim 31 (depends on 30) The computer program product of claim 30, wherein the color ratio is computed using Gaussian weighted averages of the first and second sample color regions. ### Claim 32 (depends on 30) The computer program product of claim 30, wherein the first color sample region is provided with respect to the first world plane. ### Claim 33 A system for editing a 2D image, the system comprising: a computer comprising a processor, memory, and a display, the memory containing instructions that, when executed by the processor, cause the computer to: receive an input 2D image; interact with a user to specify a first world plane in the 2D image; interact with a user to provide a source position and a destination position in the 2D image; interact with a user to identifying a destination region in the 2D image relative to the destination position; determine a source region in the 2D image relative to the first world plane and corresponding to the destination region, using the source position and the destination position; transform 2D image information of the source region to 2D image information of the destination region such that the perspective of the 2D image relative to the first world plane in the destination region is maintained; and copy the transformed 2D image information to the destination region. ### Claim 34 (depends on 33) The system of claim 33, wherein the instructions, when executed by the processor, further cause the computer to interact with the user to specify a world plane by drawing two sets of parallel lines. ### Claim 35 (depends on 33) The system of claim 33, wherein the instructions, when executed by the processor, further cause the computer to interact with the user to: provide a first color sample region for the source region; provide a second sample color region for the destination region; and compute a color ratio between the second color sample region and the first color sample region, wherein the color ratio is applied to the 2D image information of the source region when the 2D information of the source region is transformed to 2D image information of the destination region.