Methods and apparatus to analyze uncertainty in machine learning models
AssigneeIntel Corporation
InventorsAnthony Rhodes, Sangita Ravi Sharma, Lama Nachman, Giuseppe Raffa
Life of this patent
Estimating the term…
Loading patent…
AssigneeIntel Corporation
InventorsAnthony Rhodes, Sangita Ravi Sharma, Lama Nachman, Giuseppe Raffa
Estimating the term…
Quantification of uncertainty in multi-modal machine learning systems is disclosed. The approach involves generation of uncertainty estimates for individual modalities and the overall system prediction using a multi-modal fusion architecture and dropout analysis. The approach employs parallel model streams to independently process each modality, followed by a fusion layer and a final system prediction. Uncertainty quantification is then achieved through a statistical measure of dispersion (e.g., standard deviation) calculated from Monte Carlo Dropout samples. Furthermore, the approach determines modality importance using two novel metrics: Model Predictive Importance (MPI) and Uncertainty-based Modality Importance (UMI). MPI assesses similarity between modality predictions and the system-level prediction, while UMI quantifies the gradient of model variance with respect to internal layers within the fusion module. Finally, the generated uncertainty measures are combined to provide an assessment of uncertainty within the multi-modal system. The system enables robust uncertainty quantification for improved system classification performance.
A non-transitory machine readable storage medium comprising instructions to cause programmable circuitry to at least:
An apparatus comprising:
A system comprising:
Dependencies are inferred from the claim text.