Identifying and quantifying confounding bias based on expert knowledge

A system comprising:

• one or more processors;
• and
• one or more computer-readable storage media storing instructions that, in response to being executed by the one or more processors cause the system to perform operations, the operations comprising:
• obtaining a machine-learning model trained with respect to a subject, the machine-learning model being based on a plurality of factors that correspond to the subject;
• obtaining human provided expert information regarding the subject, the expert information indicating relationships between the plurality of factors with respect to how the plurality of factors affect each other;
• generating a structural causal model that represents the relationships between the plurality of factors based on the expert information;
• identifying, as a confounding factor and based on the structural causal model, a factor of the plurality of factors that causes a confounding bias in the machine-learning model;
• and
• estimating the confounding bias based on the identified confounding factor.

One or more computer-readable storage media storing instructions that, in response to being executed by one or more processors cause a system to perform operations, the operations comprising:

• obtaining a machine-learning model trained with respect to a subject, the machine-learning model being based on a plurality of factors that correspond to the subject;
• obtaining human provided expert information regarding the subject, the expert information indicating relationships between the plurality of factors with respect to how the plurality of factors affect each other;
• generating a structural causal model that represents the relationships between the plurality of factors based on the expert information;
• identifying, as a confounding factor and based on the structural causal model, a factor of the plurality of factors that causes a confounding bias in the machine-learning model;
• and
• estimating the confounding bias based on the identified confounding factor.