Similar content augmentations system
AssigneeSnap Inc.
InventorsKevin Sarabia Dela Rosa, Hao Hu, Yanjia Li
Life of this patent
Estimating the term…
Abstract
Described is a system for identifying content augmentations based on an interaction function initiated by a user by determining an initiation of an interaction function from a first user of an interaction system, processing data associated with the interaction function using a first machine learning model to generate a feature vector, and identifying at least one recommended content augmentation based on a comparison of the feature vector for the interaction function to a feature vector for the at least one recommended content augmentation. The system then displays the at least one recommended content augmentation to the first user with a corresponding selectable user interface element for individual recommended content augmentations.
Claims20
A system comprising:
- at least one processor;
- at least one memory component storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
- detecting an initiation of an interaction function via a computing device, the interaction function including a user selection of a real-world object from a camera feed of a camera system;
- analyzing data associated with an image of the real-world object using a first machine learning model to generate a feature vector for the image of the real-world object, wherein the feature vector comprises a set of features indicative of characteristics for the real-world object;
- comparing the set of features to features corresponding to each of a plurality of content augmentations;
- identifying at least one recommended content augmentation based on the comparison with the set of features associated with the image of the real-world object that indicates a similarity match between the recommended content augmentation and the real-world object;
- and
- displaying the at least one recommended content augmentation by applying a visual effect onto at least the real-world object via a display of the computing device.
A method comprising:
- detecting an initiation of an interaction function via a computing device, the interaction function including a user selection of a real-world object from a camera feed of a camera system;
- analyzing data associated with an image of the real-world object using a first machine learning model to generate a feature vector for the image of the real-world object, wherein the feature vector comprises a set of features indicative of characteristics for the real-world object;
- comparing the set of features to features corresponding to each of a plurality of content augmentations;
- identifying at least one recommended content augmentation based on the comparison with the set of features associated with the image of the real-world object that indicates a similarity match between the recommended content augmentation and the real-world object;
- and
- displaying the at least one recommended content augmentation by applying a visual effect onto at least the real-world object via a display of the computing device.
A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:
- detecting an initiation of an interaction function via a computing device, the interaction function including a user selection of a real-world object from a camera feed of a camera system;
- analyzing data associated with an image of the real-world object using a first machine learning model to generate a feature vector for the image of the real-world object, wherein the feature vector comprises a set of features indicative of characteristics for the real-world object;
- comparing the set of features to features corresponding to each of a plurality of content augmentations;
- identifying at least one recommended content augmentation based on the comparison with the set of features associated with the image of the real-world object that indicates a similarity match between the recommended content augmentation and the real-world object;
- and
- displaying the at least one recommended content augmentation by applying a visual effect onto at least the real-world object via a display of the computing device.
Dependencies are inferred from the claim text.