Machine learning worker node architecture

A computer-implemented method comprising:

• determining, by an update thread executing on a computing device, that a look-up set table has expired, wherein the look-up set table is related to a machine learning (ML) model trained to calculate paragraph vectors of incident reports, wherein the paragraph vectors map one or more text fields of the incident reports into a semantically encoded vector space, wherein the look-up set table contains a list of paragraph vectors and respective associations between each paragraph vector in the list and sets of the incident reports, and wherein the incident reports referenced by the look-up set table each contain a timestamp that is within a sliding time window of a pre-determined length;
• updating, by the update thread, the look-up set table by:
• (i) adding a first set of incident reports received since a most recent update of the look-up set table, and (ii) removing a second set of incident reports containing timestamps that are no longer within the sliding time window;
• storing, by the update thread and in a database, the look-up set table as updated;
• and
• transmitting, by the update thread and to one or more ML worker nodes, respective indications that the look-up set table has been updated, wherein reception of the respective indications causes the ML worker nodes that were notified to retrieve, from the database, the look-up set table as updated.

An article of manufacture including a non-transitory computer-readable medium, having stored thereon program instructions that, upon execution by a computing system, cause the computing system to perform operations comprising:

• determining, by an update thread executing on the computing system, that a look-up set table has expired, wherein the look-up set table is related to a machine learning (ML) model trained to calculate paragraph vectors of incident reports, wherein the paragraph vectors map one or more text fields of the incident reports into a semantically encoded vector space, wherein the look-up set table contains a list of paragraph vectors and respective associations between each paragraph vector in the list and sets of the incident reports, and wherein the incident reports referenced by the look-up set table each contain a timestamp that is within a sliding time window of a pre-determined length;
• updating, by the update thread, the look-up set table by:
• (i) adding a first set of incident reports received since a most recent update of the look-up set table, and (ii) removing a second set of incident reports containing timestamps that are no longer within the sliding time window;
• storing, by the update thread and in a database, the look-up set table as updated;
• and
• transmitting, by the update thread and to one or more ML worker nodes, respective indications that the look-up set table has been updated, wherein reception of the respective indications causes the ML worker nodes that were notified to retrieve, from the database, the look-up set table as updated.