Back to results
US 12,748,776 B1Granted
Active-active mirrored artificial intelligence architecture
AssigneeCitibank, N.A.
InventorsGanesh Prasad Bhat, James Randolph Myers
Life of this patent
Estimating the term…
Loading patent…
Loading patent…
AssigneeCitibank, N.A.
InventorsGanesh Prasad Bhat, James Randolph Myers
Estimating the term…
Systems and methods for an active-active mirrored artificial intelligence architecture are disclosed. In some implementations, the system identifies, for an inference request from a user, at least two geographically separate compute clusters configured to handle the inference request, each compute cluster storing a version of an artificial intelligence model for processing the inference request. The system determines, from the inference request, a data consistency requirement mapping the inference request to one or more data consistency types. The system determines, for each compute cluster, a composite metric based on, among other things, a consistency freshness score of the compute cluster. The system routes the inference request to a selected compute cluster having a lowest composite metric subject to a constraint that the consistency freshness score for the compute cluster satisfies the data consistency requirement for the inference request. The system returns an inference response for the inference request to the user.
One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations that respond to an inference request, the operations comprising:
A method for responding to an inference request, the method comprising:
A system comprising at least one processor and one or more non-transitory computer-readable media having instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
Dependencies are inferred from the claim text.