# US 2012/0075329 A1 · System and method for image color transfer based on target concepts

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0075329 A1
- Document ID: US20120075329A1
- Status: Published application
- Kind: A1
- Application number: 12/890,049
- Filed: 2010-09-24
- Published: 2012-03-29
- Earliest claimed: 2010-09-24
- Assignees: Xerox Corporation
- Inventors: Sandra Skaff; Naila Murray; Luca Marchesotti; Florent Perronnin
- Web page: https://patentgrep.com/patent/US20120075329A1

## CPC

- G09G 5/06: using colour palettes, e.g. look-up tables
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G09G 2320/0606: Manual adjustment
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A system and method for color transfer are provided. The method includes retrieving a concept color palette from computer memory corresponding to a concept selected by a user. The concept color palette includes a first set of colors, which may be statistically representative of colors of a set of predefined color palettes which have been associated with the concept. The method further includes computing an image color palette for an input image. The image color palette includes a second set of colors that are representative of pixels of the input image. Colors of the image color palette are mapped to colors of the concept color palette to identify, for colors of the image color palette, a corresponding color in the concept color palette. A transformation is computed based on the mapping. For pixels of the input image, modified color values are computed, based on the computed transformation, to generate a modified image.

## Claims

### Claim 1

A method for color transfer comprising:
retrieving a concept color palette from computer memory corresponding to a user-selected concept, the concept color palette comprising a first set of colors;
computing an image color palette for an input image, the image color palette comprising a second set of colors that are representative of pixels of the input image;
mapping colors of the image color palette to colors of the concept color palette to identify, for colors of the image color palette, a corresponding color in the concept color palette;
computing a transformation based on the mapping; and
for pixels of the input image, computing modified color values based on the computed transformation, to generate a modified image.

### Claim 2 (depends on 1)

The method of claim 1, wherein at least one of the computing of the image color palette, the mapping of colors, the computing of the transformation, and the computing of the modified color values is performed with a computer processor.

### Claim 3 (depends on 1)

The method of claim 1, wherein the computing of the image color palette comprises computing a Gaussian mixture model (GMM) wherein means of Gaussian functions in the GMM comprise the second set of colors.

### Claim 4 (depends on 3)

The method of claim 3, wherein the GMM is learned through Maximum Likelihood Estimation (MLE).

### Claim 5 (depends on 4)

The method of claim 4, wherein observations for learning the GMM comprise color values for pixels in the image.

### Claim 6 (depends on 3)

The method of claim 3, wherein the GMM is initialized with the first set of colors and corresponding weights.

### Claim 7 (depends on 1)

The method of claim 1 wherein the computing of the image color palette comprises adaptation of the concept palette to colors of the pixels of the image which provides the mapping of the colors of the image color palette to colors of the concept color palette.

### Claim 8 (depends on 1)

The method of claim 1, wherein the concept palette colors are learned from a set of predefined color palettes associated with the concept.

### Claim 9 (depends on 1)

The method of claim 1, further comprising, for each of a set of concepts, learning a concept palette based on colors of a set of predefined color palettes associated with the concept, each predefined color palette comprising a set of colors.

### Claim 10 (depends on 9)

The method of claim 9, wherein the learning of the concept palette comprises learning a GMM, wherein colors of the concept palette are means of the GMM.

### Claim 11 (depends on 10)

The method of claim 10, wherein observations for learning the GMM for the concept palette are colors of the predefined color palettes.

### Claim 12 (depends on 1)

The method of claim 1, wherein each of a set of concept palettes is statistically representative of colors in a set of predefined color palettes and is associated with a respective description and wherein the retrieving of the concept palette includes retrieving a concept palette from the set of concept palettes which has a description which matches a description selected by a user.

### Claim 13 (depends on 1)

The method of claim 1, wherein the concept palette includes at least eight colors.

### Claim 14 (depends on 1)

The method of claim 1, wherein the image palette includes at least eight colors.

### Claim 15 (depends on 1)

The method of claim 1, wherein the image palette includes at least a any colors as the concept palette.

### Claim 16 (depends on 1)

The method of claim 1, wherein the mapping includes identifying a color of the concept palette for each color of the image palette, whereby each image palette color is associated with a single concept palette color.

### Claim 17 (depends on 1)

The method of claim 1, wherein the method includes providing for displaying a set of concept descriptions on a graphical user interface whereby a concept description is selectable by a user.

### Claim 18 (depends on 1)

The method of claim 1, further comprising outputting the modified image.

### Claim 19 (depends on 1)

The method of claim 1, further comprising providing for displaying at least one of the image palette, concept palette, and modified image.

### Claim 20 (depends on 1)

The method of claim 1, wherein the computing of the transformation comprises computing an affine transformation between the image palette and the concept palette.

### Claim 21 (depends on 1)

The method of claim 1, further comprising providing for a user to select a degree of transfer whereby the transformation is adjustable.

### Claim 22 (depends on 1)

A computer program product comprising a tangible recording media encoding instructions, which when executed by a computer, perform the method of claim 1.

### Claim 23 (depends on 1)

An apparatus for performing the method of claim 1 comprising memory which stores instructions for performing the method and which stores a set of concept palettes, and a processor in communication with the memory for executing the instructions.

### Claim 24

An image adjustment apparatus comprising:
memory which stores a set of concept palettes, each concept palette comprising a respective set of colors and being associated in the memory with a respective natural language description;
instructions stored in memory for:
retrieving one of the concept color palettes from the memory corresponding to a user-selected concept, the concept color palette comprising a first set of colors,
receiving a user-selected input image and computing an image color palette for the input image, the image color palette comprising a second set of colors,
mapping colors of the image color palette to colors of the concept color palette to identify, for each of the colors of the image color palette, a corresponding color in the concept color palette,
computing a transformation based on the mapping, and
for pixels of the input image, computing modified color values based on the computed transformation to transform the input image; and
a processor in communication with the memory which executes the instructions.

### Claim 25 (depends on 24)

The apparatus of claim 24, further comprising a graphical user interface in communication with the processor for displaying the retrieved concept palette, modified image, and optionally a modified image color palette.

### Claim 26

A graphical user interface implemented by a processor executing instructions stored in memory, the graphical user interface being configured to display an input image and a set of concepts for selection of one of the concepts by a user, the graphical user interface further configured for displaying a modified image whose colors have been transformed based on a stored concept palette corresponding to the user-selected one of the concepts.

### Claim 27 (depends on 26)

The graphical user interface of claim 26, wherein the graphical user interface is further configured for displaying a selector whereby a user selects a degree of transfer, whereby the transformation is adjustable.
