Distributed computation of machine learning model performance metrics
AssigneeOracle International Corporation
InventorsAmit Kumar Prajapati, Furqan Abdul Samad Shaikh, Antariksha Bhaduri
Life of this patent
Estimating the term…
Loading patent…
AssigneeOracle International Corporation
InventorsAmit Kumar Prajapati, Furqan Abdul Samad Shaikh, Antariksha Bhaduri
Estimating the term…
Techniques are described for determining at least one performance metric of a machine learning model. The techniques including, obtaining a dataset generated by at least using output of the machine learning model, partitioning the dataset into two or more partitions that include one or more elements from the dataset; and generating, for each respective partition, a respective first quantile sketch and a respective second quantile sketch based at least in part on each element in the respective partition. The techniques further including generating a first merged quantile sketch by merging each respective first quantile sketch, generating a second merged quantile sketch by merging each respective second quantile sketch, and determining the at least one performance metric of the machine learning model using the first merged quantile sketch and the second merged quantile sketch.
A computer-implemented method of determining at least one performance metric of a machine learning model, the method comprising:
A non-transitory computer-readable storage medium storing a plurality of instructions executable by one or more processors of a system to determine at least one performance metric of a machine learning model, the plurality of instructions cause, when executed by the one or more processors of the system, the one or more processors to perform operations comprising:
A system for determining at least one performance metric of a machine learning model, comprising:
Dependencies are inferred from the claim text.