# US 10,504,264 B1 · Method and system for combining images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,264 B1 - Document ID: US10504264B1 - Status: Granted - Kind: B1 - Application number: 16/181,355 - Filed: 2018-11-06 - Granted: 2019-12-10 - Earliest claimed: 2018-11-06 - Applicants: Eric Koenig - Inventors: Eric Koenig - Web page: https://patentgrep.com/patent/US10504264B1 ## CPC - G06T 11/60: Creating or editing images; Combining images with text - G06T 7/74: {involving reference images or patches} - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06Q 30/0639: {Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/20092: Interactive image processing based on input by user - G06T 2207/20221: Image fusion; Image merging - G06T 2207/30196: Human being; Person - G06T 2219/2004: Aligning objects, relative positioning of parts - G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes - G06T 2219/2016: Rotation, translation, scaling - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract Disclosed are methods and systems for merging of one or more objects from various images into a single image. An example method of combining images comprises obtaining a reference image and obtaining at least one further image. The reference image and the further image have a substantially common background. The further image also includes at least one object such as an individual. The method also includes analyzing the reference image to determine positions of the object for having the object correctly placed in a combined image. Next, the images can be seamlessly merged into a combined image by placing the object from the further image into the reference image according the determined positions. Thereafter, digital filters and beautification techniques can be applied to the combined image. ## Claims ### Claim 1 A method of combining images, the method comprising: obtaining a reference image including a first background and at least one first object; obtaining a view intended for capturing in at least one further image, the view including a second background and at least one second object; automatically analyzing the reference image to determine positions for the at least one second object from the view for combining into a combined image; presenting, on one or more Augmented Reality (AR) overlays on a screen, an AR guide to guide a user on merging the reference image and the at least one further image, the AR guide depicting, on the second background, a representation of the at least one first object and the at least one second object in the positions with respect to the at least one first object; obtaining the at least one further image, the at least one further image being captured by the user upon selecting, by the user, the at least one second object in one of the positions depicted by the AR guide; automatically adjusting lighting parameters of the at least one further image to match lighting parameters of the reference image; placing the at least one second object on the at least one further image according to the one of the positions and storing the at least one further image with the at least one second object placed in the one of the positions; and seamlessly merging the reference image and the at least one further image into the combined image by placing the at least one second object into the reference image according to the one of the positions. ### Claim 2 (depends on 1) The method of claim 1, wherein the obtaining of the reference image includes generating the reference image in real time or selecting the reference image from a library. ### Claim 3 (depends on 1) The method of claim 1, wherein the obtaining of the at least one further image includes generating the at least one further image in real time. ### Claim 4 (depends on 1) The method of claim 1, wherein the at least one second object includes an individual. ### Claim 5 (depends on 1) The method of claim 1, further comprising selecting the at least one second object from the at least one further image. ### Claim 6 (depends on 5) The method of claim 5, wherein the selecting is performed automatically or based on an input of the user. ### Claim 7 (depends on 1) The method of claim 1, wherein the at least one further image includes one of the following: a two-dimensional (2D) model, a three-dimensional (3D) model, an Augmented Reality (AR) image, and an AR video content. ### Claim 8 (depends on 7) The method of claim 7, further comprising: receiving, from the user, a selection of parameters of the 2D model or the 3D model, the parameters including one or more of the following: a body type, a face, a skin tone, a pose, and an apparel; and modifying the 2D model or the 3D model based on the parameters to obtain a modified 2D model or a modified 3D model, wherein the seamless merging of the reference image and the at least one further image includes placing the modified 2D model or the modified 3D model onto the reference image to obtain the combined image. ### Claim 9 (depends on 7) The method of claim 7, wherein the 2D model or the 3D model is associated with at least one item, the method further comprising: receiving, from the user, a request to buy the at least one item associated with the 2D model or the 3D model; based on the request, directing the user to a store selling the at least one item. ### Claim 10 (depends on 1) The method of claim 1, further comprising providing guidance to the user to assist the user with the placing of the at least one second object into the reference image. ### Claim 11 (depends on 1) The method of claim 1, further comprising presenting the reference image or the at least one further image to the user using one or more AR overlays on a screen. ### Claim 12 (depends on 1) The method of claim 1, further comprising automatically analyzing distance data of two or more objects present in the reference image, selecting an AR user guide based on the analysis of the distance data, and presenting the selected AR user guide to the user. ### Claim 13 (depends on 1) The method of claim 1, further comprising modifying the at least one further image based on an input of the user, wherein the modifying of the at least one further image includes scaling, rotating, cropping, or repositioning of the at least one further image. ### Claim 14 (depends on 1) The method of claim 1, further comprising creating or updating a library with one or more of the following: the combined image, the reference image, and the at least one further image. ### Claim 15 (depends on 1) The method of claim 1, further comprising applying one or more digital filters to the at least object second in the combined image. ### Claim 16 (depends on 15) The method of claim 15, wherein the applying of the one or more digital filters is to adjust highlights in one or more areas of the at least one further image. ### Claim 17 (depends on 1) The method of claim 1, wherein the automatically modifying lighting parameters of the at least one further image is performed automatically by obtaining and analyzing depth and perspective data of the reference image and the at least one further image, and by obtaining and analyzing light and shadow data of the reference image and the at least one further image. ### Claim 18 (depends on 1) The method of claim 1, further comprising automatically analyzing ambient light data of the reference image, selecting a light filter based on the analyzing of the ambient light data of the reference image, and applying the light filter to the at least one further image. ### Claim 19 A system of combining images, the system comprising at least one processor and a memory storing processor-executable codes, wherein the at least one processor is configured to implement the following operations upon executing the processor-executable codes: obtain a reference image including a first background and at least one first object; obtain a view intended for capturing in at least one further image, the view including a second background and at least one second object; automatically analyze the reference image to determine positions for the at least one second object from the view for combining into a combined image; present, on one or more Augmented Reality (AR) overlays on a screen, an AR guide to guide a user on merging the reference image and the at least one further image, the AR guide depicting, on the second background, a representation of the at least one first object and the at least one second object in the positions with respect to the at least one first object; obtain the at least one further image, the at least one further image being captured by the user upon selecting, by the user, the at least one second object in one of the positions depicted by the AR guide; automatically adjust lighting parameters of the at least one further image to match lighting parameters of the reference image; place the at least one second object on the at least one further image according to the one of the positions and storing the at least one further image with the at least one second object placed in the one of the positions; and seamlessly merge the reference image and the at least one further image into the combined image by placing the at least one second object into the reference image according to the one of the positions. ### Claim 20 A non-transitory processor-readable medium having instructions stored thereon, which when executed by one or more computers, cause the one or more computers to implement a method of combining images, the method comprising: obtaining a reference image including a first background and at least one first object; obtaining a view intended for capturing in at least one further image, the view including a second background and at least one second object; automatically analyzing the reference image to determine positions for the at least one second object from the view for combining into a combined image; presenting, on one or more Augmented Reality (AR) overlays on a screen, an AR guide to guide a user on merging the reference image and the at least one further image, the AR guide depicting, on the second background, a representation of the at least one first object and the at least one second object in the positions with respect to the at least one first object; obtaining the at least one further image, the at least one further image being captured by the user upon selecting, by the user, the at least one second object in one of the positions depicted by the AR guide; automatically adjusting lighting parameters of the at least one further image to match lighting parameters of the reference image; placing the at least one second object on the at least one further image according to the one of the positions and storing the at least one further image with the at least one second object placed in the one of the positions; and seamlessly merging the reference image and the at least one further image into the combined image by placing the at least one second object into the reference image according to the one of the positions.