Redirection to digital content based on image-search
AssigneeSnap Inc.
InventorsKirk Ouimet, Rong Yan, Yantao Zheng, Timothy Michael Sehn, Evan Spiegel
Life of this patent
Estimating the term…
Abstract
In other embodiments, a method to perform image-based searching may include receiving a group of images from a content owner; creating an index using the group of images; receiving a further image from a mobile computing device of a user; determining a correlation between the further image and the index; and/or directing the mobile computing device of the user to content of the content owner, responsive to the determining of the correlation.
Claims15
A method to perform image-based searching, the method comprising:
- for each of a plurality of visitor destinations at respective sub-locations of a real-world physical establishment:
- receiving from a content owner associated with the establishment image data specific to the respective sub-location;
- receiving from the content owner audio index data comprising a plurality of recordings made at the respective sub-location;
- and
- receiving from the content owner location index data specific to the respective visitor destination;
- in an automated procedure performed using one or more computer processor devices configured for performance of the automated procedure, compiling and storing on a machine-readable memory a respective index specific to each visitor destination, thereby provisioning a plurality of indexes corresponding to the plurality of visitor destinations, each index being provided by a respective data structure that is specific to the corresponding visitor destination and that comprises:
- the image data of the respective visitor destination,
- the location index data of the respective sub-location,
- the audio index data associated with the respective sub-location, and
- text index data that includes words that are frequently spoken by guides or visitors in proximity to the respective sub-location and that pertain to subject matter available for visitor consumption at the corresponding visitor destination;
- receiving from a mobile computing device of a user a search query comprising one or more query items selected from:
- a query image, textual query data, and audio data associated with the query image;
- in an automated operation based at least in part on the plurality of indexes and performed using one or more computer processor devices configured for performance of the automated operation, identifying as a target visitor destination at the establishment one of the plurality of visitor destinations at the respective sub-locations of the establishment based at least in part on determining a correlation between the search query and the index specific to the target visitor destination;
- and
- responsive to determining of the correlation, based at least in part on the determining of the correlation and based at least in part on associated map information, directing the mobile computing device of the user to the sub-location of the identified target visitor destination situated within the establishment.
A system comprising:
- at least one processor;
- and
- at least one memory storing instructions that, when executed by the at least one processor, configure the system to:
- for each of a plurality of visitor destinations at respective sub-locations of a real-world physical establishment:
- receiving from a content owner associated with the establishment image data specific to the respective sub-location;
- receiving from the content owner audio index data comprising a plurality of recordings made at the respective sub-location;
- and
- receiving from the content owner location index data specific to the respective visitor destination;
- in an automated procedure, compiling and storing on a machine-readable memory a respective index specific to each visitor destination, thereby provisioning a plurality of indexes corresponding to the plurality of visitor destinations, each index being provided by a respective data structure that is specific to the corresponding visitor destination and that comprises:
- the image data of the respective visitor destination,
- the location index data of the respective sub-location,
- the audio index data associated with the respective sub-location, and
- text index data that includes words that are frequently spoken by guides or visitors in proximity to the respective sub-location and that pertain to subject matter available for visitor consumption at the corresponding visitor destination;
- receiving from a mobile computing device of a user a search query comprising one or more query items selected from:
- a query image, textual query data, and audio data associated with the query image;
- in an automated operation based at least in part on the plurality of indexes, identifying as a target visitor destination at the establishment one of the plurality of visitor destinations at the respective sub-locations of the establishment based at least in part on determining a correlation between the search query and the index specific to the target visitor destination;
- and
- responsive to the determining of the correlation, based at least in part on the determining of the correlation and based at least in part on associated map information, directing the mobile computing device of the user to the sub-location of the identified target visitor destination situated within the establishment.
A non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium including instructions that when executed by a computer, cause the computer to:
- for each of a plurality of visitor destinations at respective sub-locations of a real-world physical establishment:
- receiving from a content owner associated with the establishment image data specific to the respective sub-location;
- receiving from the content owner audio index data comprising a plurality of recordings made at the respective sub-location;
- and
- receiving from the content owner location index data specific to the respective visitor destination;
- in an automated procedure, compiling and storing on a machine-readable memory a respective index specific to each visitor destination, thereby provisioning a plurality of indexes corresponding to the plurality of visitor destinations, each index being provided by a respective data structure that is specific to the corresponding visitor destination and that comprises:
- the image data of the respective visitor destination,
- the location index data of the respective sub-location,
- the audio index data associated with the respective sub-location, and
- text index data that includes words that are frequently spoken by guides or visitors in proximity to the respective sub-location and that pertain to subject matter available for visitor consumption at the corresponding visitor destination;
- receiving from a mobile computing device of a user a search query comprising one or more query items selected from:
- a query image, textual query data, and audio data associated with the query image;
- in an automated operation based at least in part on the plurality of indexes, identifying as a target visitor destination at the establishment one of the plurality of visitor destinations at the respective sub-locations of the establishment based at least in part on determining a correlation between the search query and the index specific to the target visitor destination;
- and
- responsive to the determining of the correlation, based at least in part on the determining of the correlation and based at least in part on associated map information, directing the mobile computing device of the user to the sub-location of the identified target visitor destination situated within the establishment.
Dependencies are inferred from the claim text.