Task agnostic embedding based labeling escalation on fly

A system comprising a memory, computer readable instructions, and one or more circuitry for executing the computer readable instructions, the computer readable instructions controlling the one or more circuitry to perform operations comprising:

• receive a request corresponding to a task;
• generate, by a first pass system, a first decision for the task, the first pass system comprising a first pass model having a first complexity;
• passing the first decision to a classifier configured to determine a class of the first decision;
• responsive to the class, determining that the task should be checked for on-the-fly escalation to a second pass system comprising a second pass model having a second complexity that is higher than the first complexity of the first pass system;
• receiving, for the task, a task embedding in an embedding space;
• determining, in the embedding space, a top K subspace comprising K embeddings having K closest distances to the task embedding;
• determining embedding labels for the K embeddings in the top K subspace;
• and
• responsive to determining the embedding labels, returning a response comprising the first decision for the task.

A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by one or more processors to cause the one or more processors to perform operations comprising:

• receive a request corresponding to a task;
• generate, by a first pass system, a first decision for the task, the first pass system comprising a first pass model having a first complexity;
• passing the first decision to a classifier configured to determine a class of the first decision;
• responsive to the class, determining whether the task should be checked for on-the-fly escalation to a second pass system comprising a second pass model having a second complexity that is higher than the first complexity of the first pass system;
• determining, by the classifier, that the first decision belongs to a predetermined class;
• responsive to determining the predetermined class, bypassing on-the-fly escalation and passing the task to the second pass system;
• generating, by the second pass system, a second decision for the task;
• and
• returning, responsive to receiving the request, a response comprising the second decision for the task.