Accelerating machine learning inference with probabilistic predicates

A system comprising:

• a memory comprising instructions;
• and
• one or more computer processors, wherein the instructions, when executed by the one or more computer processors, cause the one or more computer processors to perform operations comprising:
• receiving a query to search a database, the query comprising a predicate for filtering blobs in the database utilizing a user-defined-function (UDF), the filtering requiring analysis of the blobs by the UDF to determine if the blobs pass the filtering specified by the predicate;
• determining a PP sequence of one or more probabilistic predicates (PP) based on the predicate, each PP being a binary classifier associated with a respective clause, the PP calculating a PP-blob probability that each blob satisfies the clause, the PP sequence defining an expression to combine the PPs of the PP sequence based on the predicate;
• performing the PP sequence to determine a blob probability that the blob satisfies the expression, the blob probability based on the PP-blob probabilities and the expression;
• determining which blobs have a blob probability greater than or equal to an accuracy threshold;
• discarding, from the search, the blobs with the blob probability less than the accuracy threshold;
• executing the database query over the blobs that have not been discarded, the database search utilizing the UDF;
• and
• providing results of the database search.

A non-transitory machine-readable storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:

• receiving a query to search a database, the query comprising a predicate for filtering blobs in the database utilizing a user-defined-function (UDF), the filtering requiring analysis of the blobs by the UDF to determine if the blobs pass the filtering specified by the predicate;
• determining a PP sequence of one or more probabilistic predicates (PP) based on the predicate, each PP being a binary classifier associated with a respective clause, the PP calculating a PP-blob probability that each blob satisfies the clause, the PP sequence defining an expression to combine the PPs of the PP sequence based on the predicate;
• performing the PP sequence to determine a blob probability that the blob satisfies the expression, the blob probability based on the PP-blob probabilities and the expression;
• determining which blobs have a blob probability greater than or equal to an accuracy threshold;
• discarding, from the search, the blobs with the blob probability less than the accuracy threshold;
• executing the database query over the blobs that have not been discarded, the database search utilizing the UDF;
• and
• providing results of the database search.