Intelligent data flow control valve
AssigneeOracle International Corporation
InventorsMahesh Muthulankkat, Prabakar Paulsami
Life of this patent
Estimating the term…
Abstract
A system for intelligent data flow control monitors an activity stream of an integration layer that processes events from an upstream system and transmits data to a downstream system. Upon detecting a recoverable error between the integration layer and the downstream system, the system instructs the upstream system to pause sending additional events. The system continues monitoring the activity stream to detect when the recoverable error is fixed. Once the error is resolved, the system instructs the upstream system to resume sending events to the integration layer. This approach prevents data loss during temporary system disruptions while maintaining efficient event processing flow.
Claims20
One or more non-transitory computer-readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:
- monitoring an activity stream of an integration layer that is configured to (a) receive events from an upstream system, via an event queue of the upstream system that buffers the events before transmission to the integration layer, and (b) transmit data to a downstream system responsive to the events;
- detecting, while monitoring the activity stream, a recoverable error between the integration layer and the downstream system;
- responsive to detecting the recoverable error:
- instructing the upstream system to pause sending additional events to the integration layer, causing the upstream system to retain a paused event in the event queue of the upstream system;
- storing, in a failed events queue of the integration layer, a failed event attributable to the recoverable error;
- after instructing the upstream system to pause sending additional events to the integration layer:
- attempting reprocessing of the failed event from the failed events queue of the integration layer;
- detecting that reprocessing of the failed event was successful;
- based at least in part on detecting that reprocessing of the failed event was successful, detecting that the recoverable error is fixed;
- and
- responsive to detecting that the recoverable error is fixed:
- instructing the upstream system to resume sending additional events to the integration layer, causing the upstream system to release the paused event from the event queue of the upstream system to the integration layer.
A method comprising:
- monitoring an activity stream of an integration layer that is configured to (a) receive events from an upstream system, via an event queue of the upstream system that buffers the events before transmission to the integration layer, and (b) transmit data to a downstream system responsive to the events;
- detecting, while monitoring the activity stream, a recoverable error between the integration layer and the downstream system;
- responsive to detecting the recoverable error:
- instructing the upstream system to pause sending additional events to the integration layer, causing the upstream system to retain a paused event in the event queue of the upstream system;
- storing, in a failed events queue of the integration layer, a failed event attributable to the recoverable error;
- after instructing the upstream system to pause sending additional events to the integration layer:
- attempting reprocessing of the failed event from the failed events queue of the integration layer;
- detecting that reprocessing of the failed event was successful;
- based at least in part on detecting that reprocessing of the failed event was successful, detecting that the recoverable error is fixed;
- and
- responsive to detecting that the recoverable error is fixed:
- instructing the upstream system to resume sending additional events to the integration layer, causing the upstream system to release the paused event from the event queue of the upstream system to the integration layer;
- wherein the method is performed by at least one device including a hardware processor.
A system comprising:
- at least one device including a hardware processor;
- the system being configured to perform operations comprising:
- monitoring an activity stream of an integration layer that is configured to (a) receive events from an upstream system, via an event queue of the upstream system that buffers the events before transmission to the integration layer, and (b) transmit data to a downstream system responsive to the events;
- detecting, while monitoring the activity stream, a recoverable error between the integration layer and the downstream system;
- responsive to detecting the recoverable error:
- instructing the upstream system to pause sending additional events to the integration layer, causing the upstream system to retain a paused event in the event queue of the upstream system;
- storing, in a failed events queue of the integration layer, a failed event attributable to the recoverable error;
- after instructing the upstream system to pause sending additional events to the integration layer:
- attempting reprocessing of the failed event from the failed events queue of the integration layer;
- detecting that reprocessing of the failed event was successful;
- based at least in part on detecting that reprocessing of the failed event was successful, detecting that the recoverable error is fixed;
- and
- responsive to detecting that the recoverable error is fixed:
- instructing the upstream system to resume sending additional events to the integration layer, causing the upstream system to release the paused event from the event queue of the upstream system to the integration layer.
Dependencies are inferred from the claim text.