Virtual try-on system, virtual try-on method, computer program product, and information processing device

A virtual try-on method implemented by a computer, the method comprising:

• photographing, by a photographing unit, a try-on person image;
• acquiring, by a first acquisition unit of the computer, the try-on person image photographed by the photographing unit;
• acquiring, by a second acquisition unit of the computer configured to perform further photographing, three-dimensional data of a try-on person by the further photographing;
• learning, by machine learning using the three-dimensional data of the try-on person acquired by the second acquisition unit, a learning model using the try-on person image acquired by the first acquisition unit as input data of a teacher try-on person image, and using a body shape parameter indicating a body shape of the try-on person represented by the teacher try-on person image and compositing position information indicating a compositing position of a clothing image in the teacher try-on person image as output data;
• deriving the output data including the compositing position information and the body shape parameter corresponding to the try-on person represented by the try-on person image using the try-on person image and the learning model;
• and
• generating a virtual try-on image by compositing the try-on person image and the clothing image using the derived output data, wherein
• the photographing unit and the second acquisition unit are controlled to perform photographing in synchronization with each other to acquire the try-on person image by the first acquisition unit and acquire the three-dimensional data by the second acquisition unit.

A virtual try-on computer program product having a non-transitory computer readable medium including instructions stored thereon, and operating with a photographing unit configured to photograph a try-on person image, wherein the instructions, when executed by a computer, cause the computer to perform:

• acquiring, by a first acquisition unit of the computer, the try-on person image photographed by the photographing unit;
• acquiring, by a second acquisition unit of the computer configured to perform further photographing, three-dimensional data of a try-on person by the further photographing;
• learning, by machine learning using three-dimensional data of a try-on person, a learning model using the try-on person image acquired by the first acquisition unit as input data of a teacher try-on person image, and using a body shape parameter indicating a body shape of the try-on person represented by the teacher try-on person image and compositing position information indicating a compositing position of a clothing image in the teacher try-on person image as output data;
• deriving the output data including the compositing position information and the body shape parameter corresponding to the try-on person represented by the try-on person image using the try-on person image and the learning model;
• and
• generating a virtual try-on image by compositing the try-on person image and the clothing image using the derived output data, wherein
• the photographing unit and the second acquisition unit are controlled to perform photographing in synchronization with each other to acquire the try-on person image by the first acquisition unit and acquire the three-dimensional data by the second acquisition unit.

An information processing device comprising:

• a photographing unit configured to photograph a try-on person image;
• a first acquisition unit configured to acquire the try-on person image photographed by the photographing unit;
• a second acquisition unit configured to perform photographing and configured to acquire three-dimensional data of a try-on person by the photographing;
• a learning unit configured to learn, by machine learning using three-dimensional data of a try-on person, a learning model using the try-on person image acquired by the first acquisition unit as input data of a teacher try-on person image, and using a body shape parameter indicating a body shape of the try-on person represented by the teacher try-on person image and compositing position information indicating a compositing position of a clothing image in the teacher try-on person image as output data;
• a deriving unit configured to derive the output data including the compositing position information and the body shape parameter corresponding to the try-on person represented by the try-on person image using the try-on person image and the learning model;
• and
• a generation unit configured to generate a virtual try-on image by compositing the try-on person image and the clothing image using the derived output data, wherein
• the photographing unit and the second acquisition unit are controlled to perform photographing in synchronization with each other to acquire the try-on person image by the first acquisition unit and acquire the three-dimensional data by the second acquisition unit.