Data allocation based on secure information retrieval

A method for data allocation based on secure information retrieval, the method comprising:

• receiving, from a query processor, a request for identification of a target dataset to be associated with a query term, the request including a hash length and a hash number;
• generating a random permutation based on the hash length;
• receiving, from the query processor, a secure version of the query term, the secure version based on the hash number and the permutation;
• receiving, from each of the plurality of data processors associated with a plurality of datasets, secure versions of a collection of candidate terms, wherein each candidate term represents a cluster of similar terms in the associated dataset, and wherein the secure versions are based on the hash number and the permutation;
• determining similarity scores between the secure version of the query term and secure versions of the candidate terms;
• selecting, for each of the plurality of data processors, a representative term of the collection of candidate terms;
• receiving, from each of the plurality of data processors, a comparative statistic between the representative term and its cluster of similar terms;
• and
• identifying the target dataset of the plurality of datasets based on the comparative statistic.

A non-transitory computer readable medium comprising executable instructions to:

• receive, from a query processor, a request for identification of a target dataset to be associated with a query term, the request including a hash length and a hash number;
• generate a random permutation based on the hash length;
• receive, from the query processor, a secure version of the query term, the secure version based on the hash number and the permutation;
• receive, from each of the plurality of data processors associated with a plurality of datasets, secure versions of a collection of candidate terms, wherein each candidate term represents a cluster of similar terms in the associated dataset, and wherein the secure versions are based on the hash number and the permutation;
• determine similarity scores between the secure version of the query term and secure versions of the candidate terms;
• identify the target dataset of the plurality of datasets based on the determined similarity scores;
• and
• provide the query term to the identified target dataset.