# US 2019/0378249 A1 · Recolored collage generation based on color hue distances > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0378249 A1 - Document ID: US20190378249A1 - Status: Published application - Kind: A1 - Application number: 16/001,829 - Filed: 2018-06-06 - Published: 2019-12-12 - Earliest claimed: 2018-06-06 - Assignees: Adobe Inc. - Applicants: Adobe Inc. - Inventors: Shailendra Singh Rathore; Anmol Dhawan; Anant Jain - Web page: https://patentgrep.com/patent/US20190378249A1 ## CPC - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06F 18/23213: with fixed number of clusters, e.g. K-means clustering - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/77: Retouching; Inpainting; Scratch removal - G06T 7/90: Determination of colour characteristics - G06T 11/60: Creating or editing images; Combining images with text - G06V 10/56: relating to colour - G06V 10/763: {Non-hierarchical techniques, e.g. based on statistics of modelling distributions} - G06T 2207/10024: Color image - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Certain embodiments involve generating recolored collages. For example, a method includes receiving a first image from and a second image. The method also includes grouping color hues within the first image into a first color hue cluster, and grouping color hues within the second image into a second color hue cluster. Further, the method includes determining that a first hue center of the first color hue cluster is within a distance range of a second hue center of the second color hue cluster. Additionally, the method includes generating a first recolored image by recoloring pixels of the first image having color hues outside the first color hue cluster and generating a second recolored image by recoloring pixels of the second image having color hues outside the second color hue cluster. Moreover, the method includes outputting a recolored collage including the first recolored image and the second recolored image. ## Claims ### Claim 1 A method for modifying image content based on color information computed for a set of collage images, wherein the method includes one or more processing devices performing operations comprising: receiving a first image from the set of collage images and a second image from the set of collage images; grouping (i) color hues within the first image into a first color hue cluster and (ii) color hues within the second image into a second color hue cluster; determining that a first hue center of the first color hue cluster is within a distance range of a second hue center of the second color hue cluster; generating (i) a first recolored image by recoloring pixels of the first image having color hues outside the first color hue cluster and (ii) a second recolored image by recoloring pixels of the second image having color hues outside the second color hue cluster; and outputting a recolored collage comprising the first recolored image and the second recolored image. ### Claim 2 (depends on 1) The method of claim 1, the operations further comprising: converting the set of collage images to a hue, saturation, lightness (HSL) color space; and flattening the set of collage images in the HSL color space to remove saturation and lightness components. ### Claim 3 (depends on 1) The method of claim 1, wherein the first color hue cluster, the second color hue cluster, the first hue center, and the second hue center are computed using a k-means clustering operation. ### Claim 4 (depends on 3) The method of claim 3, wherein the k-means clustering operation comprises clustering the pixels of the first image into three different color hue clusters representing three ranges of color hues. ### Claim 5 (depends on 1) The method of claim 1, comprising: determining a collage layout grammar from a set of collage layout grammars that displays a largest portion of remaining original color hues located in the first recolored image and the second recolored image; and placing the first recolored image and the second recolored image in the collage layout grammar. ### Claim 6 (depends on 1) The method of claim 1, comprising: identifying a salient area of the first image; and grouping the color hues within the salient area of the first image into the first color hue cluster. ### Claim 7 (depends on 1) The method of claim 1, comprising: grouping (i) additional color hues within the first image into a third color hue cluster and (ii) additional color hues within the second image into a fourth color hue cluster; determining that a third hue center of the third color hue cluster is within a distance range of a fourth hue center of the fourth color hue cluster; generating (i) a third recolored image by recoloring the pixels of the first image having color hues outside the third color hue cluster and (ii) a fourth recolored image by recoloring the pixels of the second image having color hues outside the fourth color hue cluster; and outputting an additional recolored collage comprising the third recolored image and the fourth recolored image, wherein the additional recolored collage comprises a smaller portion of remaining original color hues of the first image and the second image than the recolored collage. ### Claim 8 (depends on 1) The method of claim 1, wherein the distance range comprises a 20 degree interval on a hue, saturation, lightness (HSL) color wheel. ### Claim 9 A computing system comprising: means for receiving a first image from a set of collage images and a second image from the set of collage images; means for grouping (i) color hues within the first image into a first color hue cluster and (ii) color hues within the second image into a second color hue cluster; means for determining that a first hue center of the first color hue cluster is within a distance range of a second hue center of the second color hue cluster; means for generating (i) a first recolored image by recoloring pixels of the first image having color hues outside the first color hue cluster and (ii) a second recolored image by recoloring pixels of the second image having color hues outside the second color hue cluster; and means for outputting a recolored collage comprising the first recolored image and the second recolored image. ### Claim 10 (depends on 9) The computing system of claim 9, comprising: means for converting the set of collage images to a hue, saturation, lightness (HSL) color space; and means for flattening the set of collage images in the HSL color space to remove saturation and lightness components. ### Claim 11 (depends on 9) The computing system of claim 9, wherein the first color hue cluster, the second color hue cluster, the first hue center, and the second hue center are computed using a k-means clustering operation, and wherein the k-means clustering operation comprises clustering the pixels of the first image into three different color hue clusters representing three ranges of color hues. ### Claim 12 (depends on 9) The computing system of claim 9, comprising: means for determining a collage layout grammar from a set of collage layout grammars that displays a largest portion of remaining original color hues located in the first recolored image and the second recolored image; and means for placing the first recolored image and the second recolored image in the collage layout grammar. ### Claim 13 (depends on 9) The computing system of claim 9, comprising: means for identifying a salient area of the first image; and means for grouping the color hues within the salient area of the first image into the first color hue cluster. ### Claim 14 (depends on 9) The computing system of claim 9, comprising: means for grouping (i) additional color hues within the first image into a third color hue cluster and (ii) additional color hues within the second image into a fourth color hue cluster; means for determining that a third hue center of the third color hue cluster is within a distance range of a fourth hue center of the fourth color hue cluster; means for generating (i) a third recolored image by recoloring the pixels of the first image having color hues outside the third color hue cluster and (ii) a fourth recolored image by recoloring the pixels of the second image having color hues outside the fourth color hue cluster; and means for outputting an additional recolored collage comprising the third recolored image and the fourth recolored image, wherein the additional recolored collage comprises a smaller portion of remaining original color hues of the first image and the second image than the recolored collage. ### Claim 15 (depends on 9) The computing system of claim 9, wherein the distance range comprises a 20 degree interval on a hue, saturation, lightness (HSL) color wheel. ### Claim 16 A non-transitory computer-readable medium having instructions stored thereon, the instructions executable by a processing device to perform operations comprising: receiving a first image from a set of collage images and a second image from the set of collage images; grouping (i) color hues within the first image into a first color hue cluster and (ii) color hues within the second image into a second color hue cluster; determining that a first hue center of the first color hue cluster is within a distance range of a second hue center of the second color hue cluster; generating (i) a first recolored image by recoloring pixels of the first image having color hues outside the first color hue cluster and (ii) a second recolored image by recoloring pixels of the second image having color hues outside the second color hue cluster; and outputting a recolored collage comprising the first recolored image and the second recolored image. ### Claim 17 (depends on 16) The non-transitory computer-readable medium of claim 16, the instructions further executable by the processing device to perform operations comprising: converting the set of collage images to a hue, saturation, lightness (HSL) color space; and flattening the set of collage images in the HSL color space to remove saturation and lightness components, wherein the distance range comprises a 20 degree interval in the HSL color space. ### Claim 18 (depends on 16) The non-transitory computer-readable medium of claim 16, wherein the first color hue cluster, the second color hue cluster, the first hue center, and the second hue center are computed using a k-means clustering operation, and wherein the k-means clustering operation comprises clustering the pixels of the first image into three different color hue clusters representing three ranges of color hues. ### Claim 19 (depends on 16) The non-transitory computer-readable medium of claim 16, the instructions further executable by the processing device to perform operations comprising: determining a collage layout grammar from a set of collage layout grammars that displays a largest portion of remaining original color hues located in the first recolored image and the second recolored image; and placing the first recolored image and the second recolored image in the collage layout grammar. ### Claim 20 (depends on 16) The non-transitory computer-readable medium of claim 16, the instructions further executable by the processing device to perform operations comprising: grouping (i) additional color hues within the first image into a third color hue cluster and (ii) additional color hues within the second image into a fourth color hue cluster; determining that a third hue center of the third color hue cluster is within a distance range of a fourth hue center of the fourth color hue cluster; generating (i) a third recolored image by recoloring the pixels of the first image having color hues outside the third color hue cluster and (ii) a fourth recolored image by recoloring the pixels of the second image having color hues outside the fourth color hue cluster; and outputting an additional recolored collage comprising the third recolored image and the fourth recolored image, wherein the additional recolored collage comprises a smaller portion of remaining original color hues of the first image and the second image than the recolored collage.