# US 2024/0202809 A1 · Outfit simulation using layer mask

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202809 A1
- Document ID: US20240202809A1
- Status: Published application
- Kind: A1
- Application number: 18/067,597
- Filed: 2022-12-16
- Published: 2024-06-20
- Earliest claimed: 2022-12-16
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Benjamin James BIGGS; Philip PINETTE; Charu KOTHARI; Caitlin Isaac CAGAMPAN; Gerard Guy MEDIONI; Achal Dushyant DAVE; Scott Chenghui SUN
- Web page: https://patentgrep.com/patent/US20240202809A1

## CPC

- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06Q 30/0629: {by pre-processing results, e.g. ranking or ordering results}
- G06T 15/10: Geometric effects
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06V 10/82: using neural networks
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2210/16: Cloth
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06V 10/22: by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method includes generating a virtual model of a human body based at least in part on a selected image of the human body and generating a segment of an article of clothing based at least in part on a selected image of the article of clothing. The method also includes generating a layer mask indicating whether a plurality of output pixels of an output image should be produced according to the image of the human body, the image of the shirt, or the image of the pair of pants and producing the plurality of output pixels of the output image according to the layer mask. The output image shows the article of clothing on the human body in the selected image of the human body.

## Claims

### Claim 1

A method comprising:
generating a virtual model of a human body based at least in part on an image of the human body;
generating segment features of a first article of clothing based at least in part on an image of the first article of clothing;
generating segment features of a second article of clothing based at least in part on an image of the second article of clothing;
reposing the segment features of the first article of clothing based at least in part on the virtual model of the human body;
reposing the segment features of the second article of clothing based at least in part on the virtual model of the human body;
generating, based at least in part on the virtual model of the human body, the reposed segment features of the first article of clothing, and the reposed segment features of the second article of clothing, a layer mask indicating whether a plurality of output pixels of an output image should be produced according to the image of the human body, the image of the first article of clothing, or the image of the second article of clothing;
generating texture features of the human body based at least in part on the image of the human body;
generating texture features of the first article of clothing based at least in part on the image of the first article of clothing;
generating texture features of the second article of clothing based at least in part on the image of the second article of clothing;
reposing the texture features of the first article of clothing based at least in part on the virtual model of the human body;
reposing the texture features of the second article of clothing based at least in part on the virtual model of the human body;
sampling the texture features of the human body, the reposed texture features of the first article of clothing, and the reposed texture features of the second article of clothing according to the layer mask; and
producing the plurality of output pixels of the output image based at least in part on the sampled texture features of the human body, the sampled reposed texture features of the first article of clothing, and the sampled reposed texture features of the second article of clothing, wherein the output image shows the first article of clothing and the second article of clothing on the human body in the image of the human body.

### Claim 2 (depends on 1)

The method of claim 1, wherein generating the layer mask comprises:
generating a segment of the first article of clothing based at least in part on the reposed segment features of the first article of clothing; and
generating a segment of the second article of clothing based at least in part on the reposed segment features of the second article of clothing, wherein the layer mask is generated based at least in part on the segment of the first article of clothing and the segment of the second article of clothing.

### Claim 3 (depends on 1)

The method of claim 1, wherein reposing the texture features of the first article of clothing comprises resizing or reorienting the texture features of the first article of clothing to fit onto the virtual model of the human body.

### Claim 4 (depends on 1)

The method of claim 1, wherein producing the plurality of output pixels of the output image comprises altering colors of the sampled texture features of the human body, the sampled reposed texture features of the first article of clothing, and the sampled reposed texture features of the second article of clothing.

### Claim 5

A method comprising:
generating a virtual model of a human body based at least in part on an image of the human body;
generating segment features of a first article of clothing based at least in part on an image of the first article of clothing;
generating segment features of a second article of clothing based at least in part on an image of the second article of clothing;
generating, based at least in part on the virtual model of the human body, the segment features of the first article of clothing, and the segment features of the second article of clothing a layer mask indicating whether a plurality of output pixels of an output image should be produced according to the image of the human body, the image of the first article of clothing, or the image of the second article of clothing; and
producing the plurality of output pixels of the output image according to the layer mask, wherein the output image shows the first article of clothing and the second article of clothing on the human body in the image of the human body.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
reposing the segment features of the first article of clothing based at least in part on the virtual model of the human body; and
reposing the segment features of the second article of clothing based at least in part on the virtual model of the human body.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
generating a segment of the first article of clothing based at least in part on the reposed segment features of the first article of clothing; and
generating a segment of the second article of clothing based at least in part on the reposed segment features of the second article of clothing.

### Claim 8 (depends on 7)

The method of claim 7, wherein the layer mask is generated based at least in part on the segment of the first article of clothing and the segment of the second article of clothing.

### Claim 9 (depends on 6)

The method of claim 6, wherein reposing the segment features of the first article of clothing comprises resizing or reorienting the segment features of the first article of clothing to fit onto the virtual model of the human body.

### Claim 10 (depends on 5)

The method of claim 5, further comprising:
generating texture features of the human body based at least in part on the image of the human body;
generating texture features of the first article of clothing based at least in part on the image of the first article of clothing;
generating texture features of the second article of clothing based at least in part on the image of the second article of clothing;
reposing the texture features of the first article of clothing based at least in part on the virtual model of the human body; and
reposing the texture features of the second article of clothing based at least in part on the virtual model of the human body, wherein producing the plurality of output pixels of the output image comprises sampling the texture features of the human body, the reposed texture features of the first article of clothing, and the reposed texture features of the second article of clothing according to the layer mask.

### Claim 11 (depends on 10)

The method of claim 10, further comprising generating the output image based at least in part on the sampled texture features of the human body, the sampled reposed texture features of the first article of clothing, and the sampled reposed texture features of the second article of clothing.

### Claim 12 (depends on 11)

The method of claim 11, wherein generating the output image comprises altering colors of the sampled texture features of the human body, the sampled reposed texture features of the first article of clothing, and the sampled reposed texture features of the second article of clothing.

### Claim 13

A system comprising:
a memory; and
a processor communicatively coupled to the memory, the processor configured to:
generate a virtual model of a human body based at least in part on an image of the human body;
generate segment features of a first article of clothing based at least in part on an image of the first article of clothing;
generate segment features of a second article of clothing based at least in part on an image of the second article of clothing;
generate, based at least in part on the virtual model of the human body, the segment features of the first article of clothing, and the segment features of the second article of clothing a layer mask indicating whether a plurality of output pixels of an output image should be produced according to the image of the human body, the image of the first article of clothing, or the image of the second article of clothing; and
produce the plurality of output pixels of the output image according to the layer mask, wherein the output image shows the first article of clothing and the second article of clothing on the human body in the image of the human body.

### Claim 14 (depends on 13)

The system of claim 13, wherein the processor is further configured to:
repose the segment features of the first article of clothing based at least in part on the virtual model of the human body; and
repose the segment features of the second article of clothing based at least in part on the virtual model of the human body.

### Claim 15 (depends on 14)

The system of claim 14, wherein the processor is further configured to:
generate a segment of the first article of clothing based at least in part on the reposed segment features of the first article of clothing; and
generate a segment of the second article of clothing based at least in part on the reposed segment features of the second article of clothing.

### Claim 16 (depends on 15)

The system of claim 15, wherein the layer mask is generated based at least in part on the segment of the first article of clothing and the segment of the second article of clothing.

### Claim 17 (depends on 14)

The system of claim 14, wherein reposing the segment features of the first article of clothing comprises resizing or reorienting the segment features of the first article of clothing to fit onto the virtual model of the human body.

### Claim 18 (depends on 14)

The system of claim 14, wherein the processor is further configured to:
generate texture features of the human body based at least in part on the image of the human body;
generate texture features of the first article of clothing based at least in part on the image of the first article of clothing;
generate texture features of the second article of clothing based at least in part on the image of the second article of clothing;
repose the texture features of the first article of clothing based at least in part on the virtual model of the human body; and
repose the texture features of the second article of clothing based at least in part on the virtual model of the human body, wherein producing the plurality of output pixels of the output image comprises sampling the texture features of the human body, the reposed texture features of the first article of clothing, and the reposed texture features of the second article of clothing according to the layer mask.

### Claim 19 (depends on 18)

The system of claim 18, wherein the processor is further configured to generate the output image based at least in part on the sampled texture features of the human body, the sampled reposed texture features of the first article of clothing, and the sampled reposed texture features of the second article of clothing.

### Claim 20 (depends on 19)

The system of claim 19, wherein generating the output image comprises altering colors of the sampled texture features of the human body, the sampled reposed texture features of the first article of clothing, and the sampled reposed texture features of the second article of clothing.
