Universal concept graph for a social networking service

A system comprising:

• one or more hardware processors;
• and
• a non-transitory machine-readable medium for storing instructions that, when executed by the one or more hardware processors, cause the system to perform operations comprising:
• generating an internal set of concept phrases based on an internal dataset that includes content from one or more internal documents associated with a social networking service (SNS), the concept phrases included in the internal set of concept phrases being one or more terms extracted from the one or more internal documents;
• generating an external set of concept phrases based on an external dataset that includes content from one or more external documents, the one or more external documents accessed from one or more sources that are external to the SNS, the concept phrases included in the external set of concept phrases being one or more terms extracted from the one or more external documents, the generating of the external set of concept phrases including:
• identifying one or more titles of the one or more external documents included in the external dataset, and
• generating one or more tokens for each of the one or more titles, the generating of the one or more tokens comprising:
• parsing the one or more titles of the one or more external documents, extracting the one or more terms from the one or more parsed titles of the one or more external documents, and identifying the one or more terms as the one or more tokens;
• generating a set of nodes for a universal concept graph based on performing a union operation of the internal set of concept phrases and the external set of concept phrases, each node corresponding to a particular concept phrase;
• generating a set of edges among a plurality of nodes of the set of nodes based on one or more relationship indicators for pairs of nodes of the set of nodes;
• generating the universal concept graph based on the set of nodes and the set of edges among the plurality of nodes;
• and
• causing presentation of at least a portion of the universal concept graph in a user interface of a device associated with a user, the causing presentation of the at least the portion of the universal concept graph including causing display of one or more user interface elements for receiving input data pertaining to one or more nodes or one or more edges of the universal concept graph, a receiving of the input data via the one or more user interface elements causing generation and association of metadata with the one or more nodes or the one or more edges of the universal concept graph based on the input data received via the one or more user interface elements.

A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

• generating an internal set of concept phrases based on an internal dataset that includes content from one or more internal documents associated with a social networking service (SNS), the concept phrases included in the internal set of concept phrases being one or more terms extracted from the one or more internal documents;
• generating an external set of concept phrases based on an external dataset that includes content from one or more external documents, the one or more external documents accessed from one or more sources that are external to the SNS, the concept phrases included in the external set of concept phrases being one or more terms extracted from the one or more external documents, the generating of the external set of concept phrases including:
• identifying one or more titles of the one or more external documents included in the external dataset and
• generating one or more tokens for each of the one or more titles, the generating of the one or more tokens comprising:
• parsing the one or more titles of the one or more external documents, extracting the one or more terms from the one or more parsed titles of the one or more external documents, and identifying the one or more terms as the one or more tokens;
• generating a set of nodes for a universal concept graph based on performing a union operation of the internal set of concept phrases and the external set of concept phrases, each node corresponding to a particular concept phrase;
• generating a set of edges among a plurality of nodes of the set of nodes based on one or more relationship indicators for pairs of nodes of the set of nodes;
• generating the universal concept graph based on the set of nodes and the set of edges among the plurality of nodes;
• and
• causing presentation of at least a portion of the universal concept graph in a user interface of a device associated with a user, the causing presentation of the at least the portion of the universal concept graph including causing display of one or more user interface elements for receiving input data pertaining to one or more nodes or one or more edges of the universal concept graph, a receiving of the input data via the one or more user interface elements causing generation and association of metadata with the one or more nodes or the one or more edges of the universal concept graph based on the input data received via the one or more user interface elements.