# US 2018/0322662 A1 · Method for transfer of a style of a reference visual object to another visual object, and corresponding electronic device, computer readable program products and computer readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322662 A1
- Document ID: US20180322662A1
- Status: Published application
- Kind: A1
- Application number: 15/774,003
- Filed: 2016-11-07
- Published: 2018-11-08
- Earliest claimed: 2015-11-06
- Assignees: Thomson Licensing
- Applicants: THOMSON Licensing
- Inventors: Pierre HELLIER; Oriel FRIGO; Neus SABATER; Julie DELON
- Web page: https://patentgrep.com/patent/US20180322662A1

## CPC

- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The disclosure relates to a method for transferring a style of a reference visual object to an input visual object. According to an embodiment, the method includes finding a correspondence map assigning to a point in the input visual objet a corresponding point in the reference visual object, the finding of a correspondence map comprising spatially adaptive partitioning of the input visual object into a plurality of regions, the partitioning depending on the reference and input visual objects. The disclosure also relates to corresponding electronic device, computer readable program product and computer readable storage medium.

## Claims

### Claim 1

A method for transferring a style of a reference visual object (E) to an input visual object (I), wherein the method comprises finding a correspondence map ϕ assigning to at least one pixel x in the input visual object a corresponding pixel ϕ(x) in the reference visual object, said finding of a correspondence map ϕ comprising:
quadtree splitting of said input visual object (I) into a plurality of regions Ri, delivering, for at least one region Ri, a set of K candidate labels Li, representing region correspondences between said input visual object (I) and said reference visual object (E); and
obtaining a reduced set of K candidate labels ̂L by using an inference model of Markov Random fields (MRF) type, wherein said MRF inference model is solved by approximating a Maximum a Posteriori using a loopy belief propagation type method, delivering the approximate marginal probabilities for at least one variable of the MRF model.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The method of claim 1, wherein the stopping criteria for said quadtree splitting depends on a region similarity between the input and reference visual objects.

### Claim 4

(canceled)

### Claim 5 (depends on 3)

The method of claim 3, wherein said region similarity is computed according to a distance between vector representation of a region in the input visual object and vector representation of a region in the reference visual object.

### Claim 6 (depends on 3)

The method of claim 3, wherein, for a region Ri for which the stopping criteria is verified, a set of candidate labels is selected by computing the K-nearest neighbors of a region in said reference visual object E corresponding to said region Ri.

### Claim 7

(canceled)

### Claim 8 (depends on 1)

The method of claim 1, wherein finding a correspondence map ϕ comprises replacing at least one region Ri of the input visual object by an corresponding region of said reference visual object, delivering at least one replaced quadtree region Ri.

### Claim 9 (depends on 1)

The method of claim 1, wherein finding a correspondence map ϕ comprises applying a bilinear blending on at least one of said replaced quadtree region.

### Claim 10 (depends on 9)

The method of claim 9, wherein bilinear blending comprises, for a replaced quadtree region:
obtaining an overlapping quadtree by increasing the size of said replaced quadtree region by an overlap ratio;
computing a blended pixel u′(x) in the output visual object as a linear combination of at least two overlapping intensities at x.

### Claim 11 (depends on 1)

The method of claim 1, wherein finding a correspondence map ϕ comprises, for at least one region Ri, selecting (532) corresponding region of said reference visual object, wherein said selecting (532) takes into account the size, the color and/or the shape of said region Ri of said input visual object and/or the size, the color and/or the shape of the corresponding region of said reference visual object.

### Claim 12 (depends on 1)

The method of claim 1, wherein a visual object corresponds to an image or a part of an image or a video or a part of a video.

### Claim 13

An electronic device comprising at least one memory and one or several processors configured for collectively transferring a style of a reference visual object to an input visual object, wherein said one or several processors are configured for collectively:
finding a correspondence map ϕ assigning to at least one pixel x in the input visual objet a corresponding pixel ϕ(x) in the reference visual object, said finding of a correspondence map ϕ comprising:
quadtree splitting of said input visual object (I) into a plurality of regions Ri, delivering, for at least one region Ri, a set of K candidate labels Li, representing region correspondences between said input visual object (I) and said reference visual object (E); and
obtaining a reduced set of K candidate labels AL by using an inference model of Markov Random fields (MRF) type, wherein said MRF inference model is solved by approximating a Maximum a Posteriori using a loopy belief propagation type method, delivering the approximate marginal probabilities for at least one variable of the MRF model.

### Claim 14

A non-transitory computer readable program product, comprising program code instructions for performing, when said non-transitory software program is executed by a computer, a method for transferring a style of a reference visual object (E) to an input visual object (I), wherein the method comprises finding a correspondence map ϕ assigning to at least one paint pixel x in the input visual object a corresponding pixel ϕ(x) in the reference visual object, said finding of a correspondence map ϕ comprising:
obtaining a reduced set of K candidate labels ̂L by using an inference model of Markov Random fields (MRF) type, wherein said MRF inference model is solved by approximating a Maximum a Posteriori using a loopy belief propagation type method, delivering the approximate marginal probabilities for at least one variable of the MRF model.

### Claim 15 (depends on 1)

A computer readable storage medium carrying a software program comprising program code instructions for performing, when said non-transitory software program is executed by a computer, a method according to claim 1.

### Claim 16 (depends on 13)

The electronic device of claim 13, wherein the stopping criteria for said quadtree splitting depends on a region similarity between the input and reference visual objects.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein said region similarity is computed according to a distance between vector representation of a region in the input visual object and vector representation of a region in the reference visual object.

### Claim 18 (depends on 16)

The electronic device of claim 16, wherein, for a region Ri for which the stopping criteria is verified, a set of candidate labels is selected by computing the K-nearest neighbors of a region in said reference visual object E corresponding to said region Ri.

### Claim 19 (depends on 13)

The electronic device of claim 13, wherein finding a correspondence map ϕ comprises replacing at least one region Ri of the input visual object by a corresponding region of said reference visual object, delivering at least one replaced quadtree region Ri.

### Claim 20 (depends on 13)

The electronic device of claim 13, wherein finding a correspondence map ϕ comprises applying a bilinear blending on at least one of said replaced quadtree region.

### Claim 21 (depends on 13)

The electronic device of claim 13 wherein bilinear blending comprises, for a replaced quadtree region:
obtaining an overlapping quadtree by increasing the size of said replaced quadtree region by an overlap ratio;
computing a blended pixel u′(x) in the output visual object as a linear combination of at least two overlapping intensities at x.

### Claim 22 (depends on 13)

The electronic device of claim 13, wherein finding a correspondence map ϕ comprises, for at least one region Ri, selecting a corresponding region of said reference visual object, wherein said selecting takes into account the size, the color and/or the shape of said region Ri of said input visual object and/or the size, the color and/or the shape of the corresponding region of said reference visual object.

### Claim 23 (depends on 13)

The electronic device of claim 13 wherein a visual object corresponds to an image or a part of an image or a video or a part of a video.
