Interactive fashion with music ar
AssigneeSnap Inc.
InventorsItamar Berger, Gal Dudovitch, Gal Sasson, Ma'ayan Mishin Shuvi, Matan Zohar
Life of this patent
Estimating the term…
Abstract
Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a person wearing an article of clothing; generating a segmentation of the article of clothing worn by the person in the monocular image; obtaining one or more audio-track related augmented reality elements; and applying the one or more audio-track related augmented reality elements to the article of clothing worn by the person based on the segmentation of the article of clothing worn by the person.
Claims20
A method comprising:
- receiving, by one or more processors of a device, an image that includes a depiction of a person wearing an article of clothing;
- determining that a music file is being played on the device during capture of the image;
- generating, by the one or more processors, a segmentation of the article of clothing worn by the person in the image;
- obtaining lyrics associated with the music file;
- and
- generating, as one or more audio-track related augmented reality elements applied to the article of clothing based on the segmentation, a portion of the lyrics associated with the music file being played on the device.
A system comprising:
- at least one processor of a device;
- and
- a memory component having instructions stored thereon, when executed by the at least one processor, causes the at least one processor to perform operations comprising:
- receiving an image that includes a depiction of a person wearing an article of clothing;
- determining that a music file is being played on the device during capture of the image;
- generating a segmentation of the article of clothing worn by the person in the image;
- obtaining lyrics associated with the music file;
- and
- generating, as one or more audio-track related augmented reality elements applied to the article of clothing based on the segmentation, a portion of the lyrics associated with the music file being played on the device.
A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by at least one processor of a device, cause the at least one processor to perform operations comprising:
- receiving an image that includes a depiction of a person wearing an article of clothing;
- determining that a music file is being played on the device during capture of the image;
- generating a segmentation of the article of clothing worn by the person in the image;
- obtaining lyrics associated with the music file;
- and
- generating, as one or more audio-track related augmented reality elements applied to the article of clothing based on the segmentation, a portion of the lyrics associated with the music file being played on the device.
Dependencies are inferred from the claim text.