US 7,308,332 B2Granted

Virtual clothing modeling apparatus and method

AssigneeKabushiki Kaisha Toshiba

InventorsRyuzo Okada, Nobuhiro Kondo

Life of this patent

Estimating the term…

Loading patent…

Abstract

Trying on the clothes is simulated by processing an image sequence by using a posture dictionary, and a three-dimensional figure, obtained in advance, of a person who wishes to try on clothing. The process includes estimating the posture of the person, and simulating the motions of the clothes, in agreement with estimated time series posture data. A virtual modeling apparatus comprises an imaging device configured to take an image sequence, a posture-estimator which estimates the posture of a person in the image sequence from the three-dimensional figure data of the person and from data for various postures, a posture corrector which generates smooth and natural posture time series data from the time series of estimated postures, a clothes simulator which calculates the motions of the clothing being modeled, and a display device which displays images of the person as if they were actually wearing the clothing.

Claims10

Dependent claims

A virtual clothing modeling apparatus comprising:

a camera to obtain an image sequence including a plurality of images of a person who tries on clothing;
a storage unit to store clothes data including three-dimensional figures of clothes and patterns thereof, three-dimensional figure data of the person, and posture data of the person;
a posture-estimating unit to estimate the posture of the person in the images within the image sequence by using the image sequence and the stored posture data;
a time series posture data generating unit to generate time series posture data by using the estimated posture data of the person;
a clothes-simulating unit to estimate the motions of the clothes tried on by the person by using the three-dimensional figure data of the person, the clothes data, and the time series posture data;
a clothes image-generating unit to generate images of the clothes based on the estimated motions of the clothes;
and
a synthesizing unit to synthesize images of the clothes on the person in the image sequence by using the estimated motions of the clothes and the clothes data;
wherein the posture-estimating unit includes:
a candidate mode selecting unit to select posture data for a plurality of posture candidates which are similar to the previously estimated posture data of the person;
a candidate model generating unit to generate a plurality of candidate models by forming three-dimensional figure data using a plurality of posture data candidates;
and
a present posture-estimating unit to estimate the present posture of the person based on evaluation values which indicate similarities between the person in the images and the candidate models;
wherein the previously estimated posture data is selected from posture data representing a plurality of postures;
and
wherein the posture data candidates selected by the candidate mode selecting unit are candidates whose similarities exceed a threshold.

13 more elements

A virtual clothing modeling apparatus comprising:

a camera to obtain an image sequence including a plurality of images of a person who tries on clothing;
a storage unit to store clothes data including three-dimensional figures of clothes and patterns thereof, three-dimensional figure data of the person, and posture data of the person;
a posture-estimating unit to estimate the posture of the person in the images within the image sequence by using the image sequence and the stored posture data;
a time series posture data generating unit to generate time series posture data by using the estimated posture data of the person;
a clothes-simulating unit to estimate the motions of the clothes tried on by the person by using the three-dimensional figure data of the person, the clothes data, and the time series posture data;
a clothes image-generating unit to generate images of the clothes based on the estimated motions of the clothes;
and
a synthesizing unit to synthesize images of the clothes on the person in the image sequence by using the estimated motions of the clothes and the clothes data;
wherein the storage unit further stores preset time series posture data including time series posture data for the person, and the time series posture data generating unit includes:
a speed-setting unit to set a range of speed for motions that can be expressed based on the preset time series posture data;
a data set selecting unit to select a set of posture data for the present frame in the image sequence from the preset time series posture data, based upon the posture data of the person in the image one frame before the present frame of the image sequence, and based upon the speed range;
and
a correction data selecting unit to select, from the set of posture data, correction data which is posture data having similarities to the posture data of the person;
wherein the correction data includes those postures determined by the posture-estimating unit to have similarities to the posture data of the person that are higher than a threshold;
and
wherein the time series posture data-generating unit generates the time series posture data by correcting the posture data of the person with the correction data.

13 more elements

A virtual clothing modeling apparatus comprising:

a camera to obtain an image sequence including a plurality of images of a person who tries on clothing;
a storage unit to store clothes data including three-dimensional figures of clothes and patterns thereof, three-dimensional figure data of the person, and posture data of the person;
a posture-estimating unit to estimate the posture of the person in the images within the image sequence by using the image sequence and the stored posture data;
a time series posture data generating unit to generate time series posture data by using the estimated posture data of the person;
a clothes-simulating unit to estimate the motions of the clothes tried on by the person by using the three-dimensional figure data of the person, the clothes data, and the time series posture data;
a clothes image-generating unit to generate images of the clothes based on the estimated motions of the clothes;
a synthesizing unit to synthesize images of the clothes on the person in the image sequence by using the estimated motions of the clothes and the clothes data;
a texture-obtaining unit to obtain texture data of the person from the image of the present frame in the image sequence;
a data input unit to input modification data for modifying the three-dimensional figure data of the person;
a figure-modifying unit to modify the three-dimensional figure data of the person based on the modification data;
and
a modified figure image-generating unit to generate a modified figure image, which is an image of the person after the figure is modified by using the modified three-dimensional figure data of the person and the texture data of the person;
wherein the storage unit further stores a background image obtained in advance;
wherein the clothes-simulating unit estimates the motions of the clothes by using the modified three-dimensional figure data of the person;
and
wherein the synthesizing unit synthesizes the modified figure image and the images of the clothes on the background image.

13 more elements

Dependencies are inferred from the claim text.

Facts

Application: 11/372,035Filed 10 Mar 2006
Priority: JP P2005-06958111 Mar 2005
Published: US 2006/0202986 A114 Sep 2006
Granted: 11 Dec 2007
Term ends: Not estimatedThe source records don’t support an estimate.

Classification10 codes

G06T 19/00
Manipulating three-dimensional [3d] models or images for computer graphics
G06F 30/20
Computer-aided design [CAD]: design optimisation, verification or simulation
G06T 13/20
Animation: three-dimensional [3D] animation
G06T 19/006
Manipulating three-dimensional [3D] models or images for computer graphics: mixed reality