US 12,602,850 B2 · Generative AI virtual clothing try-on

Abstract

An artificial intelligence (AI) network or neural network is trained, using a relatively small number of reference images of a target garment, to enable virtual clothing try-ons of the target garment. Example methods include determining a pose for a person depicted in an input image, determining an area of the input image to replace with a target garment, changing values of pixels within the area, and inputting the pose, the area, and a text prompt describing the target garment, into a neural network, to generate an output image, wherein the neural network is trained to generate the target garment. Example methods include training the neural network with images of clothing in a same class or category as the target garment to teach the neural network to shape the target garment in accordance with a pose of the person and to preserve other clothing and the background.

Claims20

Dependent claims

A computing device comprising:

one or more processors;
and
one or more memories storing instructions that, when executed by the one or more processors, configure the one or more processors to perform operations comprising:
determining a pose for a person depicted in an input image;
determining body part masks for the input image;
determining a bounding box for the input image, the bounding box comprising the person depicted within the input image;
determining clothing masks for clothing to be preserved;
determining an area, of the input image to replace with a target garment, as the clothing masks and the body part masks subtracted from the bounding box;
changing values of pixels within the area;
inputting the pose, the area, and a text prompt describing the target garment, into a neural network, to generate an output image, wherein the neural network is trained to generate the target garment within the area;
and
blending the body part masks with the output image.

9 more elements

A non-transitory computer-readable storage medium including instructions that, when processed by one or more processors, configure the one or more processors to perform operations comprising:

determining a pose for a person depicted in an input image;
determining body part masks for the input image;
determining a bounding box for the input image, the bounding box comprising the person depicted within the input image;
determining clothing masks for clothing to be preserved;
determining an area, of the input image to replace with a target garment, as the clothing masks and the body part masks subtracted from the bounding box;
changing values of pixels within the area;
inputting the pose, the area, and a text prompt describing the target garment, into a neural network, to generate an output image, wherein the neural network is trained to generate the target garment within the area;
and
blending the body part masks with the output image.

6 more elements

Dependencies are inferred from the claim text.

Generative AI virtual clothing try-on

Life of this patent

Generative AI virtual clothing try-on

Life of this patent

Abstract

Claims20