Visual matching with a messaging application
AssigneeSnap Inc.
InventorsHao Hu, Kevin Sarabia Dela Rosa
Life of this patent
Estimating the term…
Abstract
Aspects of the present disclosure involve a system and a method for performing operations comprising: identifying a plurality of features for an image received by a messaging application server; assigning a first of the plurality of features and a second of the plurality of features respectively to a first nearest visual codebook cluster and a second nearest visual codebook cluster; applying the first and second nearest visual codebook clusters to a visual search database to identify a plurality of candidate matching images; selecting a given matching image based on a geometric verification of the plurality of matching images and the received image; and accessing an augmented reality experience corresponding to the given matching image.
Claims20
A method comprising:
- identifying a plurality of features for an image received by a messaging application server;
- assigning a first of the plurality of features and a second of the plurality of features respectively to a first nearest visual codebook cluster and a second nearest visual codebook cluster;
- applying the first and second nearest visual codebook clusters to a visual search database to identify a plurality of candidate matching images;
- selecting a given matching image based on a geometric verification of the plurality of matching images and the received image;
- and
- accessing an augmented reality experience corresponding to the given matching image.
A system comprising:
- a processor configured to perform operations comprising:
- identifying a plurality of features for an image received by a messaging application server;
- assigning a first of the plurality of features and a second of the plurality of features respectively to a first nearest visual codebook cluster and a second nearest visual codebook cluster;
- applying the first and second nearest visual codebook clusters to a visual search database to identify a plurality of candidate matching images;
- selecting a given matching image based on a geometric verification of the plurality of matching images and the received image;
- and
- accessing an augmented reality experience corresponding to the given matching image.
A non-transitory machine-readable storage medium that includes instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
- identifying a plurality of features for an image received by a messaging application server;
- assigning a first of the plurality of features and a second of the plurality of features respectively to a first nearest visual codebook cluster and a second nearest visual codebook cluster;
- applying the first and second nearest visual codebook clusters to a visual search database to identify a plurality of candidate matching images;
- selecting a given matching image based on a geometric verification of the plurality of matching images and the received image;
- and
- accessing an augmented reality experience corresponding to the given matching image.
Dependencies are inferred from the claim text.