Information uniqueness assessment using string-based collection frequency

An apparatus comprising:

• at least one processing device comprising a processor coupled to a memory;
• the at least one processing device being configured to implement the following steps:
• obtaining a plurality of documents from at least one data source;
• evaluating the plurality of documents for a given level, of a plurality of levels, to identify a plurality of collections of documents, wherein the given level is a level of interest to a given user;
• determining a collection frequency, within the given level, for a given character string based at least in part on:
• (i) a number of the collections of documents within the given level comprising the given character string, wherein an existence of the given character string in one or more of the collections of documents, of the plurality of collections of documents, within the given level has a count of one for each collection of documents comprising one or more instances of the given character string, relative to (ii) a total number of the collections of documents within the given level in the plurality of collections;
• assigning a uniqueness rating to the given character string for the given level based at least in part on a comparison of:
• (a) the collection frequency of the given character string within the given level, to (b) a collection frequency of one or more additional character strings within the given level in one or more of the plurality of collections;
• and
• performing at least one automated action using the given character string based at least in part on the assigned uniqueness rating.

A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform the following steps:

• obtaining a plurality of documents from at least one data source;
• evaluating the plurality of documents for a given level, of a plurality of levels, to identify a plurality of collections of documents, wherein the given level is a level of interest to a given user;
• determining a collection frequency, within the given level, for a given character string based at least in part on:
• (i) a number of the collections of documents within the given level comprising the given character string, wherein an existence of the given character string in one or more of the collections of documents, of the plurality of collections of documents, within the given level has a count of one for each collection of documents comprising one or more instances of the given character string, relative to (ii) a total number of the collections of documents within the given level in the plurality of collections;
• assigning a uniqueness rating to the given character string for the given level based at least in part on a comparison of:
• (a) the collection frequency of the given character string within the given level, to (b) a collection frequency of one or more additional character strings within the given level in one or more of the plurality of collections;
• and
• performing at least one automated action using the given character string based at least in part on the assigned uniqueness rating.