# US 2008/0303840 A1 · Mesh Quilting for Geometric Texture Synthesis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0303840 A1
- Document ID: US20080303840A1
- Status: Published application
- Kind: A1
- Application number: 11/760,607
- Filed: 2007-06-08
- Published: 2008-12-11
- Earliest claimed: 2007-06-08
- Assignees: Microsoft Corporation
- Inventors: Kun Zhou; Xin Huang; Xi Wang; Baining Guo; Heung-Yeung Shum
- Web page: https://patentgrep.com/patent/US20080303840A1

## CPC

- G06T 15/04: Texture mapping
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Mesh quilting for geometric texture synthesis involves synthesizing a geometric texture by quilting a mesh texture swatch. In an example embodiment, geometry is matched between a mesh texture swatch and a portion of a synthesized geometric texture. Correspondences are ascertained between elements of the mesh texture swatch and the portion of the synthesized geometric texture. The ascertained corresponding elements of the mesh texture swatch and the portion of the synthesized geometric texture are aligned via local deformation to create a new patch. The new patch is merged into an output texture space to grow the synthesized geometric texture.

## Claims

### Claim 1

A method comprising:
matching geometry between a mesh texture swatch and a portion of a synthesized geometric texture;
ascertaining correspondences between elements of the mesh texture swatch and the portion of the synthesized geometric texture;
aligning ascertained corresponding elements of the mesh texture swatch and the portion of the synthesized geometric texture via local deformation to create a new patch; and
merging the new patch into an output texture space to grow the synthesized geometric texture.

### Claim 2 (depends on 1)

The method as recited in claim 1, wherein the portion of the synthesized geometric texture comprises a seed region; and wherein the method further comprises:
finding the seed region in the synthesized geometric texture responsive to a cell of a grid with the cell having at least one adjacent cell in which the synthesized geometric texture has already been grown using the mesh texture swatch.

### Claim 3 (depends on 1)

The method as recited in claim 1, wherein the mesh texture swatch comprises a set of vertex positions and a set of triangles.

### Claim 4 (depends on 1)

The method as recited in claim 1, wherein the matching comprises:
determining multiple matching costs that are respectively associated with multiple translations of the mesh texture swatch; and
selecting a translation of the multiple translations that is associated with a lowest matching cost of the multiple matching costs.

### Claim 5 (depends on 4)

The method as recited in claim 4, wherein the determining comprises:
determining a distance between an output vertex of the synthesized geometric texture and an input face of the mesh texture swatch for each input face of the mesh texture swatch, the distance comprising a combination of geometric distance and normal distance.

### Claim 6 (depends on 1)

The method as recited in claim 1, wherein the ascertaining comprises:
determining if input elements of the mesh texture swatch are related to output elements of the synthesized geometric texture based on an analysis involving at least one criterion.

### Claim 7 (depends on 6)

The method as recited in claim 6, wherein the at least one criterion involves vertex-face pairs with vertices being from the synthesized geometric texture and faces being from the mesh texture swatch.

### Claim 8 (depends on 6)

The method as recited in claim 6, wherein the determining comprises:
determining a nearest input face of the mesh texture swatch for each output vertex of the synthesized geometric texture within an overlapping region to collect a set of vertex-face pairs; and
tagging a given output element of the synthesized geometric texture as being related to a particular input element of the mesh texture swatch if there exists a vertex-face pair in the collected set of vertex-face pairs such that an output vertex of the vertex-face pair is part of the given output element and an input face of the vertex-face pair is part of the particular input element.

### Claim 9 (depends on 1)

The method as recited in claim 1, wherein the aligning comprises:
deforming an input element of the mesh texture swatch and a corresponding output element of the synthesized geometric texture while attempting to satisfy position constraints and attempting to preserve local geometry details.

### Claim 10 (depends on 9)

The method as recited in claim 9, wherein the position constraints are reflected responsive to average points of vertex-face pairs, and the local geometry details are reflected responsive to Laplacian coordinates.

### Claim 11 (depends on 1)

The method as recited in claim 1, wherein the merging comprises:
for each input element of the mesh texture swatch or output element of the synthesized geometric texture that lacks a corresponding output element or input element, respectively, adding the input element and the output element to the synthesized geometric texture.

### Claim 12 (depends on 1)

The method as recited in claim 1, wherein the merging comprises:
for each input element of the mesh texture swatch or output element of the synthesized geometric texture that has a corresponding output element or input element, respectively:
adding the input element to the synthesized geometric texture if its corresponding output element is entirely within an overlapping region; and
adding the output element to the synthesized geometric texture if its corresponding input element is entirely within the overlapping region.

### Claim 13 (depends on 1)

The method as recited in claim 1, wherein the merging comprises:
for each input element of the mesh texture swatch and its corresponding output element of the synthesized geometric texture that are both partially within an overlapping region:
stitching the input element and the corresponding output element together into a combined element; and
adding the combined element to the synthesized geometric texture.

### Claim 14 (depends on 13)

The method as recited in claim 13, wherein the stitching comprises:
using a graph cut algorithm on an undirected flow network graph representing a dual graph adjacency between triangles.

### Claim 15 (depends on 1)

The method as recited in claim 1, wherein the output texture space is associated with a three-dimensional (3D) base mesh over which the synthesized geometric texture is grown.

### Claim 16 (depends on 15)

The method as recited in claim 15, further comprising:
building a texture atlas for the 3D base mesh; and
converting local representations of vertex positions for the synthesized geometric texture into locations in a geometry texture space.

### Claim 17 (depends on 15)

The method as recited in claim 15, further comprising:
reducing a stretching of the synthesized geometric texture, which is induced from a shell mapping between a shell space around the 3D base mesh and the output texture space, responsive to a stretch metric on tetrahedra.

### Claim 18 (depends on 17)

The method as recited in claim 17, wherein the reducing comprises:
minimizing a value of the stretch metric that is derived from a tetrahedron associated with the shell space and a tetrahedron associated with the output texture space.

### Claim 19

A device comprising:
a geometry matcher to match geometry between a mesh texture swatch and a portion of a synthesized geometric texture;
a corresponding elements ascertainer to ascertain correspondences between elements of the mesh texture swatch and the portion of the synthesized geometric texture;
a corresponding elements aligner to align ascertained corresponding elements of the mesh texture swatch and the portion of the synthesized geometric texture via local deformation to create a new patch; and
a patch merger to merge the new patch into an output texture space to grow the synthesized geometric texture.

### Claim 20

One or more processor-accessible media comprising processor-executable instructions that, when executed, direct a device to perform acts comprising:
matching geometry between a mesh texture swatch and a portion of a synthesized geometric texture;
ascertaining correspondences between elements of the mesh texture swatch and the portion of the synthesized geometric texture;
aligning ascertained corresponding elements of the mesh texture swatch and the portion of the synthesized geometric texture via local deformation to create a new patch; and
merging the new patch into an output texture space to grow the synthesized geometric texture.
