Agent-based file repository indexing and full-text faceted search system

A computing device, the computing device comprising:

• a processor;
• and
• a memory, comprising instructions, which when executed by the processor, cause the processor to perform operations to configure the device to:
• retrieve a tenant identifier of a plurality of tenant identifiers, each of the plurality of tenant identifiers identifying a set of users with authorized access to one or more data repositories of a plurality of data repositories;
• configure an indexing agent associated with the tenant identifier based on indexing configuration information, the indexing configuration information including at least an identifier of the one or more data repositories, location information for accessing the one or more data repositories, and one or more file patterns;
• retrieve indexed data associated with the tenant identifier from an indexing server executing the indexing agent, the indexed data including text data obtained by the indexing agent during indexing using at least one data file associated with the one or more file patterns and stored in the one or more data repositories, and a cryptographic hash of the at least one data file;
• in response to validating a received search query is associated with a user of the set of users authorized to access the one or more data repositories and a tenant selection received with the search query matches the tenant identifier, determine search results based on applying the search query to the retrieved indexed data;
• and
• provide an output of the search results, the search results including at least an indication of duplicate files within the one or more data repositories based on the cryptographic hash.

A non-transitory computer-readable storage medium that stores instructions for execution by one or more processors of a computing device, the instructions to configure the one or more processors to:

• retrieve a tenant identifier of a plurality of tenant identifiers, each of the plurality of tenant identifiers identifying a set of users with authorized access to one or more data repositories of a plurality of data repositories;
• configure an indexing agent associated with the tenant identifier based on indexing configuration information, the indexing configuration information including at least an identifier of the one or more data repositories, location information for accessing the one or more data repositories, and one or more file patterns;
• retrieve indexed data associated with the tenant identifier from an indexing server executing the indexing agent, the indexed data including text data obtained by the indexing agent during indexing using at least one data file associated with the one or more file patterns and stored in the one or more data repositories, and a cryptographic hash of the at least one data file;
• in response to validating a received search query is associated with a user of the set of users authorized to access the one or more data repositories and a tenant selection received with the search query matches the tenant identifier, determine search results based on applying the search query to the retrieved indexed data;
• and
• provide an output of the search results, the search results including at least an indication of duplicate files within the one or more data repositories based on the cryptographic hash.