Distributed privacy-preserving computing on protected data

A system comprising:

• one or more data processors;
• and
• a non-transitory computer readable storage medium containing instructions which, when executed on the one or more data processors, cause the one or more data processors to perform actions including:
• identifying an algorithm, wherein the algorithm is provided by an algorithm developer and integrated into a secure capsule computing framework, wherein the secure capsule computing framework serves the algorithm to validation data assets within a data storage structure in a secure manner that preserves privacy of the validation data assets and the algorithm;
• executing a validation workflow on the algorithm, wherein the validation workflow takes as input the validation data assets, finds patterns in the validation data assets using learned parameters, and outputs an inference;
• calculating performance of the algorithm in providing the inference, wherein the performance is calculated based on gold standard labels;
• determining whether the performance of the algorithm satisfies validation criteria defined by an algorithm developer;
• when the performance of the algorithm does not satisfy the validation criteria, optimizing one or more hyperparameters of the algorithm and re-executing the validation workflow on the algorithm with the optimized one or more hyperparameters;
• and
• when the performance of the algorithm does satisfy the validation criteria, providing the performance of the algorithm and the one or more hyperparameters to the algorithm developer.

A method comprising:

• receiving, at a data processing system, an algorithm and input data requirements associated with the algorithm, wherein the input data requirements include validation selection criteria for data assets to be run on the algorithm;
• identifying, by the data processing system, the data assets as being available from a data host based on the validation selection criteria for the data assets;
• curating, by the data processing system, the data assets within a data storage structure within infrastructure of the data host;
• preparing, by the data processing system, the data assets within the data storage structure for processing by the algorithm;
• integrating, by the data processing system, the algorithm into a secure capsule computing framework, wherein the secure capsule computing framework serves the algorithm to the data assets within the data storage structure in a secure manner that preserves privacy of the data assets and the algorithm;
• and
• executing, by the data processing system, a validation workflow on the algorithm, wherein the validation workflow takes as input the data assets, finds patterns in the data assets using learned parameters, and outputs an inference;
• calculating, by the data processing system, performance of the algorithm in providing the inference, wherein the performance is calculated based on gold standard labels;
• and
• providing, by the data processing system, the performance of the algorithm to the algorithm developer.