Indexing and mining content of multiple data sources

A system for indexing and mining content of multiple data sources, comprising:

• a processor and a memory configured to provide computer program instructions to the processor to execute the function of the components;
• a database of learned content of multiple data sources learned using text analysis, the learned content identifying one or more concepts to which a data source relates, wherein the concepts are cognitively associated with the data source and include concepts not explicitly referenced in the data source such that, at least some of the concepts are inferred notwithstanding whether those inferred concepts are explicitly mentioned in the data source;
• an indexing component for providing an index of the learned content including associations between concepts with mappings between concepts and the multiple data sources;
• a mining component for receiving input of a query from a user on an interface and using the text analysis to analyze the query to determine one or more query concepts to which the query relates, wherein using the text analysis to analyze the query to determine the one or more query concepts includes analyzing words of a sentence of the query input by the user, in aggregate, to determine one or more concepts covered by the sentence prior to searching for the query concepts in the database notwithstanding whether the query concepts are identical to the words used in the sentence;
• and, responsive to determining the query concepts, for mining the indexed concepts in response to the query concepts to return a list of referenced data sources on the interface, wherein returning the list of referenced data sources includes returning the list of referenced data sources in order of a relevancy score of each of the referenced data sources, and wherein the referenced data sources are returned on the list, according to the relevancy score, notwithstanding whether the query included a search for any individual concept inside the referenced data sources;
• an interface component for presenting the returned list of referenced data sources indexed by concept on the interface to the user, wherein returning the list of reference data sources indexed by concept includes presenting additional data sources of suggested concepts of which are tightly related to the one or more query concepts yet were not included in the query by the user, wherein the suggested concepts are identified by first identifying the one or more query concepts by searching the indexed concepts using keywords included in the query, and using the one or more query concepts as input to an additional search to the indexed concepts by performing a concept search that does not use keywords as input, and wherein as the user navigates through respective concepts returned by the query on the interface in a hierarchal manner, the returned list of referenced data sources presented on the interface is continually refreshed in real-time according to updated relevancy scores of each of the referenced data sources as necessitated by the navigation of the user through the respective concepts;
• and
• a feedback component for enabling receiving user input for customized concepts in response to providing top level navigation concepts to the user;
• wherein the top level navigation concepts are determined by tracking the most common concepts of the multiple data sources as identified during ingestion of the learned content using the text analysis prior to receiving the user input such that the top level navigation concepts comprise the most common concepts.

A computer program product for indexing and mining content of multiple data sources, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

• provide a database of learned content of multiple data sources learned using text analysis, the learned content identifying one or more concepts to which a data source relates, wherein the concepts are cognitively associated with the data source and include concepts not explicitly referenced in the data source such that, at least some of the concepts are inferred notwithstanding whether those inferred concepts are explicitly mentioned in the data source;
• provide an index of the learned content including associations between concepts with mappings between concepts and the multiple data sources;
• receive input of a query from a user on an interface and using the text analysis to analyze the query to determine one or more query concepts to which the query relates, wherein using the text analysis to analyze the query to determine the one or more query concepts includes analyzing words of a sentence of the query input by the user, in aggregate, to determine one or more concepts covered by the sentence prior to searching for the query concepts in the database notwithstanding whether the query concepts are identical to the words used in the sentence;
• responsive to determining the query concepts, mine the indexed concepts in response to the query concepts to return a list of referenced data sources, wherein returning the list of referenced data sources includes returning the list of referenced data sources in order of a relevancy score of each of the referenced data sources on the interface, and wherein the referenced data sources are returned on the list, according to the relevancy score, notwithstanding whether the query included a search for any individual concept inside the referenced data sources;
• present the returned list of referenced data sources indexed by concept on the interface to the user, wherein returning the list of reference data sources indexed by concept includes presenting additional data sources of suggested concepts of which are tightly related to the one or more query concepts yet were not included in the query by the user, wherein the suggested concepts are identified by first identifying the one or more query concepts by searching the indexed concepts using keywords included in the query, and using the one or more query concepts as input to an additional search to the indexed concepts by performing a concept search that does not use keywords as input, and wherein as the user navigates through respective concepts returned by the query on the interface in a hierarchal manner, the returned list of referenced data sources presented on the interface is continually refreshed in real-time according to updated relevancy scores of each of the referenced data sources as necessitated by the navigation of the user through the respective concepts;
• and
• provide, via the index of the learned content, top level navigation concepts to the user enabling receiving user input for customized concepts;
• wherein the top level navigation concepts are determined by tracking the most common concepts of the multiple data sources as identified during ingestion of the learned content using the text analysis prior to receiving the user input such that the top level navigation concepts comprise the most common concepts.