Identifying and evaluating online references
AssigneeBrightedge Technologies, Inc.
InventorsLemuel S. Park, Jimmy Yu
Life of this patent
Estimating the term…
Abstract
One example embodiment includes a method for indexing online references of an entity. The method includes identifying one or more channels of the Internet to be searched for references to an entity and identifying one or more signals to be evaluated within each of the one or more channels. The method also includes crawling the Internet for online references to the entity, wherein crawling the Internet comprises searching the one or more channels of the Internet for references to the entity and evaluating the one or more signals. The method further includes constructing a reverse index of the references, wherein the reverse index is based on each channel in which a reference is found and the one or more signals evaluated for the reference.
Claims48
A method of indexing online references of an entity, the method comprising:
- identifying an entity, wherein the entity is an individual, corporation, brand, or product;
- crawling the Internet for online references to the entity after identifying the entity, wherein crawling the Internet comprises:
- querying a first search engine for a first search results page using a keyword;
- parsing the first search result pages into organic search results;
- identifying an organic online reference to the entity based on the organic search results;
- parsing the organic search results to identify one or more organic signals that include information about the organic online reference to the entity;
- searching social networks for social network search results that refer to the entity;
- identifying a social online reference to the entity based on the social network search results;
- parsing the social network search results to identify one or more social signals that include information about the social online reference to the entity;
- evaluating the social signals and organic signals;
- and
- constructing, using a processor, a reverse index of the online references based on the evaluated social signals and the evaluated organic signals.
A method of indexing online references of an entity, the method comprising, by a system comprising a plurality of worker nodes:
- crawling the Internet for the online references to the entity by querying, using a keyword, one or more search engines to retrieve search results pages,
- wherein the entity is an individual, corporation, brand, or product,
- wherein the search results pages comprise one or more search results identified by the respective search engine as responsive to the keyword, and
- wherein the worker nodes are configured to simulate activities of a human user of the Internet by providing the one or more search engines with information that affects how the search results would be presented to the human user;
- parsing the search results pages to identify organic search results, wherein the organic search results appear in the search results pages based on relevance of webpages corresponding to the organic search results to the keyword;
- parsing the organic search results to identify organic online references to entities in the organic search results and one or more signals to be evaluated that include information about the organic online references;
- evaluating the signals to identify relevance of the organic online references to the entities in the organic search results;
- constructing a reverse index of the online references based on the evaluated signals;
- in response to receiving a query related to the entity, computing, using the reverse index, statistics regarding the organic online references to the identified entity, wherein computing the statistics comprises attributing an organic online reference to the identified entity identified via a first search engine of the one or more search engines with a weight greater than an organic online reference to the entity identified via a second search engine;
- and
- presenting the computed statistics regarding the organic online references to the identified entity.
A method of indexing online references of an entity, the method comprising, by a system comprising a plurality of worker nodes:
- crawling the Internet for the online references to the entity by querying, using a keyword, one or more search engines to retrieve search results pages,
- wherein the entity is an individual, corporation, brand, or product,
- wherein the search results pages comprise one or more search results identified by the respective search engine as responsive to the keyword, and
- wherein the worker nodes are configured to simulate the activities of a human user of the Internet by providing the one or more search engines with information that affects how the search results would be presented to the human user;
- parsing the search results pages to identify paid content based on placement or inclusion;
- parsing the paid content to identify paid online references to entities and one or more signals to be evaluated that include information about the paid online references;
- evaluating the signals to identify relevance of the paid online references to the entities;
- constructing a reverse index of the online references based on the evaluated signals;
- in response to receiving a query related to the entity, computing, using the reverse index, statistics regarding the paid online references to the identified entity, wherein computing the statistics comprises attributing a paid online reference to the identified entity identified via a first search engine of the one or more search engines with a weight greater than a paid online reference to the entity identified via a second search engine;
- and
- presenting the computed statistics regarding the paid online references to the identified entity.
A method of indexing online references of an entity, the method comprising, by a system comprising a plurality of worker nodes:
- crawling the Internet for the online references to the entity by querying, using a keyword, one or more search engines to retrieve search results pages,
- wherein the entity is an individual, corporation, brand, or product,
- wherein the search results pages comprise one or more search results identified by the respective search engine as responsive to the keyword, and
- wherein the worker nodes are configured to simulate the activities of a human user of the Internet by providing the one or more search engines with information that affects how the search results would be presented to the human user;
- parsing the search results pages to identify organic search results and paid content, wherein the organic search results appear in the search results pages based on relevance of webpages corresponding to the organic search results to the keyword, and wherein the paid content appears in the search results pages based on placement or inclusion;
- parsing the organic search results to identify organic online references to entities in the organic search results and one or more organic signals to be evaluated that include information about the organic online references;
- parsing the paid content to identify paid online references to entities and one or more paid signals to be evaluated that include information about the paid online references;
- evaluating the organic signals and the paid signals to identify relevance of the organic online references and relevance of the paid online references to the entities in the search results;
- constructing a reverse index of the online references based on the evaluated signals;
- in response to receiving a query related to the entity, computing, using the reverse index, statistics regarding the organic online references to the identified entity and statistics regarding the paid online references to the identified entity,
- wherein computing the statistics regarding the organic online references comprises attributing an organic online reference to the identified entity identified via a first search engine of the one or more search engines with a first weight greater than an organic online reference to the entity identified via a second search engine, and
- wherein computing the statistics regarding the paid online references comprises attributing a paid online reference to the identified entity identified via the first search engine of the one or more search engines with a second weight greater than a paid online reference to the entity identified via the second search engine;
- and
- presenting the computed statistics regarding the organic online references to the identified entity and the computed statistics regarding the paid online references to the identified entity.
Dependencies are inferred from the claim text.