Utilizing a vision-language model for mobile deposit decisioning

A non-transitory computer-readable medium storing instructions that, when executed by at least one processing device, cause a computing device to:

• generating, by one or more servers in response to a deposit request comprising a check image from a client device, a machine learning model prompt comprising the check image and instructions for extracting features of the check image;
• extracting, by the one or more servers utilizing a vision-language model, the features of the check image indicated in the instructions of the machine learning model prompt;
• determining, by the one or more servers utilizing a deposit decision model comprising a set of check deposit rules, a transaction decision indicating to accept or reject the deposit request according to the extracted features of the check image;
• and
• causing, by the one or more servers, a transaction system to accept or reject the deposit request based on the transaction decision.

A system comprising:

• at least one processing device;
• and
• at least one non-transitory computer-readable storage medium storing instructions that, when executed by the at least one processing device, cause the system to:
• generating, by one or more servers in response to a deposit request comprising a check image from a client device, a machine learning model prompt comprising the check image and instructions for extracting features of the check image;
• extracting, by the one or more servers utilizing a vision-language model, the features of the check image indicated in the instructions of the machine learning model prompt;
• determining, by the one or more servers utilizing a deposit decision model comprising a set of check deposit rules, a transaction decision indicating to accept or reject the deposit request according to the extracted features of the check image;
• and
• causing, by the one or more servers, a transaction system to accept or reject the deposit request based on the transaction decision.