Back to results
US 12,499,483 B2Granted
Adaptive zoom try-on experience
AssigneeSnap Inc.
InventorsMatan Zohar, Omri Berg, Gal Sasson, Itamar Berger
Life of this patent
Estimating the term…
Abstract
Aspects of the present disclosure involve a system for automatically zooming in on objects in an image. The system accesses a video comprising a frame depicting a person and detects a fashion item being worn by the person in the frame of the video. The system, in response to detecting the fashion item being worn by the person, extracts, from the frame, a portion comprising a depiction of the fashion item being worn by the person. The system generates a focus image of the fashion item using the portion extracted from the frame and presents the focus image of the fashion item together with the video comprising the frame depicting the person.
Claims20
A method comprising:
- accessing, by one or more processors of a device using a video access module, a video comprising a frame depicting a person;
- calculating, by an augmentation system via an application programming interface (API) server, characteristic points for a set of elements of the person to generate a mesh based on the calculated characteristic points;
- generating, by the augmentation system, one or more areas on the mesh of the person;
- aligning, by the augmentation system, the one or more areas of the person with one or more elements of a first augmented reality representation of a fashion item with a position;
- modifying, by the augmentation system, one or more visual properties of the one or more areas to cause the device to display the first augmented reality representation of the fashion item within the frame of the video at an individual display position relative to the display position of the person;
- detecting, by a fashion item detection module, the augmented reality representation of the fashion item being worn by the person in the frame of the video;
- in response to detecting the augmented reality representation of the fashion item being worn by the person, extracting, from the frame, a portion comprising a depiction of the augmented reality representation of the fashion item being worn by the person;
- generating, by a focus image generation module, a focus image of the augmented reality representation of the fashion item using the portion extracted from the frame to increase a size of the augmented reality representation of the fashion item in the focus image relative to the augmented reality representation of the fashion item depicted in the frame of the video, the focus image comprising a magnified view of the portion extracted from the frame comprising the depiction of the augmented reality representation of the fashion item being worn by the person;
- and
- presenting, by an image display module, the focus image of the augmented reality representation of the fashion item together with the video comprising the frame depicting the person.
7 more elements
A system comprising:
- at least one processor of a device configured to perform operations comprising:
- accessing using a video access module a video comprising a frame depicting a person;
- calculating, by an augmentation system via an application programming interface (API) server, characteristic points for a set of elements of the person to generate a mesh based on the calculated characteristic points;
- generating, by the augmentation system, one or more areas on the mesh of the person;
- aligning, by the augmentation system, the one or more areas of the person with one or more elements of a first augmented reality representation of a fashion item with a position;
- and
- modifying, by the augmentation system, one or more visual properties of the one or more areas to cause the device to display the first augmented reality representation of the fashion item within the frame of the video at an individual display position relative to the display position of the person;
- detecting, by a fashion item detection module, the augmented reality representation of the fashion item being worn by the person in the frame of the video;
- in response to detecting the augmented reality representation of the fashion item being worn by the person, extracting, from the frame, a portion comprising a depiction of the augmented reality representation of the fashion item being worn by the person;
- generating, by a focus image generation module, a focus image of the augmented reality representation of the fashion item using the portion extracted from the frame to increase a size of the augmented reality representation of the fashion item in the focus image relative to the augmented reality representation of the fashion item depicted in the frame of the video, the focus image comprising a magnified view of the portion extracted from the frame comprising the depiction of the augmented reality representation of the fashion item being worn by the person;
- and
- presenting, by an image display module, the focus image of the augmented reality representation of the fashion item together with the video comprising the frame depicting the person.
9 more elements
A non-transitory machine-readable storage medium that includes instructions that, when executed by one or more processors of a device, cause the device to perform operations comprising:
- accessing using a video access module a video comprising a frame depicting a person;
- calculating, by an augmentation system via an application programming interface (API) server, characteristic points for a set of elements of the person to generate a mesh based on the calculated characteristic points;
- generating, by the augmentation system, one or more areas on the mesh of the person;
- aligning, by the augmentation system, the one or more areas of the person with one or more elements of a first augmented reality representation of a fashion item with a position;
- and
- modifying, by the augmentation system, one or more visual properties of the one or more areas to cause the device to display the first augmented reality representation of the fashion item within the frame of the video at an individual display position relative to the display position of the person;
- detecting, by a fashion item detection module, the augmented reality representation of the fashion item being worn by the person in the frame of the video;
- in response to detecting the augmented reality representation of the fashion item being worn by the person, extracting, from the frame, a portion comprising a depiction of the augmented reality representation of the fashion item being worn by the person;
- generating, by a focus image generation module, a focus image of the augmented reality representation of the fashion item using the portion extracted from the frame to increase a size of the augmented reality representation of the fashion item in the focus image relative to the augmented reality representation of the fashion item depicted in the frame of the video, the focus image comprising a magnified view of the portion extracted from the frame comprising the depiction of the augmented reality representation of the fashion item being worn by the person;
- and
- presenting, by an image display module, the focus image of the augmented reality representation of the fashion item together with the video comprising the frame depicting the person.
8 more elements
Dependencies are inferred from the claim text.