Virtual shoe try-on
AssigneeAmazon Technologies, Inc.
InventorsYuelong Li, Sunil Sharadchandra Hadap, Miriam Bellver Bueno
Life of this patent
Estimating the term…
Abstract
According to an embodiment, a method includes estimating, based at least in part on a first location of a bounding box for a foot in a first frame of a sequence of frames and a second location of the bounding box in a second frame of the sequence of frames, a smoothing transformation that characterizes a movement of the foot in the sequence of frames and smoothing, based at least in part on the smoothing transformation, a movement of a structure of the foot from a first location of the structure in the first frame to a second location of the structure in the second frame. The method also includes superimposing a model of a shoe onto the foot in the sequence of frames based at least in part on the smoothed movement.
Claims20
A method for fitting a virtual shoe onto a foot, the method comprising:
- capturing a video comprising a sequence of frames of a foot;
- predicting a first location of a bounding box for the foot in a first frame of the sequence of frames and a second location of the bounding box for the foot in a second frame of the sequence of frames;
- predicting a first location of a structure of the foot in the first frame and a second location of the structure in the second frame;
- estimating, based at least in part on the first location of the bounding box in the first frame, the second location of the bounding box in the second frame, and a movement of content in a pixel of the first frame to the second frame, a two-dimensional (2D) affine transformation that characterizes a movement of the foot in the sequence of frames;
- smoothing, based at least in part on the 2D affine transformation, a movement of the structure from the first location of the structure to the second location of the structure;
- and
- superimposing a model of a shoe onto the foot in the sequence of frames based at least in part on the smoothed movement of the structure from the first location of the structure to the second location of the structure.
A method comprising:
- estimating, based at least in part on a first location of a bounding box for a foot in a first frame of a sequence of frames and a second location of the bounding box in a second frame of the sequence of frames, a smoothing transformation that characterizes a movement of the foot in the sequence of frames;
- smoothing, based at least in part on the smoothing transformation, a movement of a structure of the foot from a first location of the structure in the first frame to a second location of the structure in the second frame;
- and
- superimposing a model of a shoe onto the foot in the sequence of frames based at least in part on the smoothed movement of the structure from the first location of the structure to the second location of the structure.
An apparatus comprising:
- a memory;
- and
- a processor communicatively coupled to the memory, the processor configured to:
- estimate, based at least in part on a first location of a bounding box for a foot in a first frame of a sequence of frames and a second location of the bounding box in a second frame of the sequence of frames, a smoothing transformation that characterizes a movement of the foot in the sequence of frames;
- smooth, based at least in part on the smoothing transformation, a movement of a structure of the foot from a first location of the structure in the first frame to a second location of the structure in the second frame;
- and
- superimpose a model of a shoe onto the foot in the sequence of frames based at least in part on the smoothed movement of the structure from the first location of the structure to the second location of the structure.
Dependencies are inferred from the claim text.