Systems and methods for weakly supervised unit test quality scoring

A system comprising:

• an electronic device comprising:
• a computer processor;
• and
• a memory storing a generative model computer program and a unit test scoring program;
• a code repository storing code;
• and
• a labelling function repository comprising a plurality of binary labelling functions;
• wherein:
• the generative model computer program parses a plurality of code snippets from the code repository using an abstract syntax tree;
• the generative model computer program receives a plurality of binary labelling functions from a labelling function repository;
• the generative model computer program creates a labelling matrix by applying the labelling functions to the parsed code snippets;
• the generative model computer program trains a probabilistic generative model using the labelling matrix resulting in a vector of pseudo-labels;
• the unit test scoring computer program builds a discriminative model, wherein the discriminative model receives an array of real value inputs;
• and
• the unit test scoring computer program trains, the discriminative model using the parsed code snippets, the vector of pseudo labels, and the abstract syntax tree.

A non-transitory computer readable storage medium, including instructions stored thereon, which when read and executed by one or more computer processors, cause the one or more computer processors to perform steps comprising:

• parse a plurality of code snippets in a repository using an abstract syntax tree;
• receive a plurality of binary labelling functions from a labelling function repository;
• create a labelling matrix by applying the binary labelling functions to the parsed code snippets;
• train a probabilistic generative model using the labelling matrix resulting in a vector of pseudo-labels;
• build a discriminative model, wherein the discriminative model receives an array of real value inputs;
• and
• train the discriminative model using the parsed code snippets, the vector of pseudo labels, and the abstract syntax tree.