Configuring a Machine Learning Pipeline Based on Patch Context Robustness Indexes

One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:

• generating a first patch context robustness index (PCRI) value that quantifies, for a first computer vision model (CVM), a first sensitivity of the first CVM to contextual noise, at least by:
• determining a first performance metric at least by applying the first CVM to a first whole image;
• determining a second performance metric at least by applying the first CVM to a first plurality of patches of the first whole image at a first granularity;
• determining the first PCRI value as a function of at least the first performance metric and the second performance metric;
• determining if the first PCRI value satisfies a criterion for deploying the first CVM to an ML pipeline;
• and
• responsive to determining that the first PCRI value satisfies the criterion for deploying the first CVM to the ML pipeline:
• deploying the first CVM to the ML pipeline.

A system, comprising:

• one or more hardware processors;
• one or more non-transitory computer-readable media;
• and
• program instructions stored on the one or more non-transitory computer-readable media which, when executed by the one or more hardware processors, cause the system to perform operations comprising:
• generating a first patch context robustness index (PCRI) value that quantifies, for a first computer vision model (CVM), a first sensitivity of the first CVM to contextual noise, at least by:
• determining a first performance metric at least by applying the first CVM to a first whole image;
• determining a second performance metric at least by applying the first CVM to a first plurality of patches of the first whole image at a first granularity;
• determining the first PCRI value as a function of at least the first performance metric and the second performance metric;
• determining if the first PCRI value satisfies a criterion for deploying the first CVM to an ML pipeline;
• and
• responsive to determining that the first PCRI value satisfies the criterion for deploying the first CVM to the ML pipeline:
• deploying the first CVM to the ML pipeline.