System and method for anomaly detection and deduplication of electronic data feeds

A method, comprising:

• receiving an electronic feed inventory file;
• creating a feed message based on the feed inventory file, wherein:
• the feed message includes a batch of inventory messages having a batch identification;
• each of the inventory messages corresponds to one stock keeping unit (SKU) of a batch of SKUs;
• and
• the inventory message corresponding to the one SKU includes inventory update information of the one SKU and lead days of the one SKU;
• placing the feed message in a message queue;
• performing validation one each of the inventory messages;
• generating a response to each of inventory messages that are invalidated;
• generating a first batch of response message including the responses to the inventory messages that are invalidated, the first batch of response message having the batch identification;
• publishing the first batch of response message to the message queue;
• updating a first database based on inventory messages that are validated;
• generating a response to each of the inventory messages that are validated;
• generating a second batch of response message including the responses to the inventory messages that are validated, the second batch of response message having the batch identification;
• publishing the second batch of response message to the message queue;
• and
• updating a second database based on the first batch of response and second batch of response messages.

A non-transitory computer-readable storage medium having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

• receiving an electronic feed inventory file;
• creating a feed message based on the feed inventory file, wherein:
• the feed message includes a batch of inventory messages having a batch identification;
• each of the inventory messages corresponds to one stock keeping unit (SKU) of a batch of SKUs;
• and
• the inventory message corresponding to the one SKU includes inventory update information of the one SKU and lead days of the one SKU;
• placing the feed message in a message queue;
• performing validation one each of the inventory messages;
• generating a response to each of inventory messages that are invalidated;
• generating a first batch of response message including the responses to the inventory messages that are invalidated, the first batch of response message having the batch identification;
• publishing the first batch of response message to the message queue;
• updating a first database based on inventory messages that are validated;
• generating a response to each of the inventory messages that are validated;
• generating a second batch of response message including the responses to the inventory messages that are validated, the second batch of response message having the batch identification;
• publishing the second batch of response message to the message queue;
• and
• updating a second database based on the first batch of response and second batch of response messages.