Secure Broker-Mediated Data Analysis and Prediction

A non-transitory, computer-readable medium with instructions stored thereon, wherein the instructions are executable by a processor to perform a method, comprising:

• receiving a plurality of datasets, wherein each dataset of the plurality of datasets is received from a respective client computing device of a plurality of client computing devices, wherein each dataset corresponds to a set of recorded values, and wherein each dataset comprises objects;
• determining a respective list of identifiers for each dataset and a composite list of identifiers comprising a combination of the lists of identifiers of each dataset of the plurality of datasets;
• determining a list of unique objects from among the plurality of datasets;
• selecting a subset of identifiers from the composite list of identifiers;
• determining a subset of the list of unique objects corresponding to each identifier in the subset of identifiers;
• computing a shared representation of the datasets based on the subset of the list of unique objects and a shared function having one or more shared parameters;
• determining, by the managing computing device, a sublist of objects for the respective dataset of each client computing device based on an intersection of the subset of identifiers with the list of identifiers for the respective dataset;
• determining, by the managing computing device, a partial representation for the respective dataset of each client computing device based on the sublist of objects for the respective dataset and the shared representation;
• transmitting to each of the client computing devices:
• the sublist of objects for the respective dataset;
• and
• the partial representation for the respective dataset;
• receiving one or more feedback values from at least one of the client computing devices,
• wherein the one or more feedback values are determined by the client computing devices by:
• determining, by the respective client computing device, a set of predicted values corresponding to the respective dataset, wherein the set of predicted values is based on the partial representation and an individual function with one or more individual parameters corresponding to the respective dataset;
• determining, by the respective client computing device, an error for the respective dataset based on an individual loss function for the respective dataset, the set of predicted values corresponding to the respective dataset, the sublist of objects, and non-empty entries in the set of recorded values corresponding to the respective dataset;
• updating, by the respective client computing device, the one or more individual parameters for the respective dataset;
• and
• determining, by the respective client computing device, the one or more feedback values, wherein the one or more feedback values are used to determine a change in the partial representation that corresponds to an improvement in the set of predicted values;
• determining based on the sublists of objects and the one or more feedback values from the client computing devices, one or more aggregated feedback values;
• and
• updating the one or more shared parameters based on the one or more aggregated feedback values.

A memory with a model stored thereon, wherein the model is generated according to a method, comprising:

• receiving, by a managing computing device, a plurality of datasets, wherein each dataset of the plurality of datasets is received from a respective client computing device of a plurality of client computing devices, wherein each dataset corresponds to a set of recorded values, and wherein each dataset comprises objects;
• determining, by the managing computing device, a respective list of identifiers for each dataset and a composite list of identifiers comprising a combination of the lists of identifiers of each dataset of the plurality of datasets;
• determining, by the managing computing device, a list of unique objects from among the plurality of datasets;
• selecting, by the managing computing device, a subset of identifiers from the composite list of identifiers;
• determining, by the managing computing device, a subset of the list of unique objects corresponding to each identifier in the subset of identifiers;
• computing, by the managing computing device, a shared representation of the datasets based on the subset of the list of unique objects and a shared function having one or more shared parameters;
• determining, by the managing computing device, a sublist of objects for the respective dataset of each client computing device based on an intersection of the subset of identifiers with the list of identifiers for the respective dataset;
• determining, by the managing computing device, a partial representation for the respective dataset of each client computing device based on the sublist of objects for the respective dataset and the shared representation;
• transmitting, by the managing computing device, to each of the client computing devices:
• the sublist of objects for the respective dataset;
• and
• the partial representation for the respective dataset;
• receiving, by the managing computing device, one or more feedback values from at least one of the client computing devices, wherein the one or more feedback values are determined by the client computing devices by:
• determining, by the respective client computing device, a set of predicted values corresponding to the respective dataset, wherein the set of predicted values is based on the partial representation and an individual function with one or more individual parameters corresponding to the respective dataset;
• determining, by the respective client computing device, an error for the respective dataset based on an individual loss function for the respective dataset, the set of predicted values corresponding to the respective dataset, the sublist of objects, and non-empty entries in the set of recorded values corresponding to the respective dataset;
• updating, by the respective client computing device, the one or more individual parameters for the respective dataset;
• and
• determining, by the respective client computing device, the one or more feedback values, wherein the one or more feedback values are used to determine a change in the partial representation that corresponds to an improvement in the set of predicted values;
• determining, by the managing computing device, based on the sublists of objects and the one or more feedback values from the client computing devices, one or more aggregated feedback values;
• updating, by the managing computing device, the one or more shared parameters based on the one or more aggregated feedback values;
• and
• storing, by the managing computing device, the shared representation, the shared function, and the one or more shared parameters on the memory.