Machine learning based vehicle title validation

A non-transitory computer-readable storage medium storing executable instructions that, when executed by a hardware processor of an online system, cause the hardware processor to perform steps comprising:

• transmitting instructions for presenting a user interface on a client device, the user interface allowing a user of the client device to input a request associated with a vehicle;
• receiving the request via the user interface presented on the client device, the request including an image of a physical vehicle title document captured by a camera of the client device;
• executing text extraction on the image to generate OCR text output;
• constructing a multi-modal input tensor comprising the image, the OCR text output, and one or more schema-based structured data templates representing expected field formats for information to be extracted from the image;
• providing the multi-modal input tensor to a machine-learned model configured to output a structured data object comprising title information, vehicle information, and ownership information associated with the vehicle;
• retrieving reference title metadata associated with the vehicle in response to an application programming interface (API) request transmitted to an external database system configured to maintain vehicle title records;
• validating information included in the structured data object based on the reference title metadata and a predetermined set of rules;
• and
• executing a predetermined action based on the validation.

An online system, comprising:

• a hardware processor;
• and
• a non-transitory computer-readable storage medium storing executable instructions that, when executed by the hardware processor, cause the hardware processor to perform steps comprising:
• transmitting instructions for presenting a user interface on a client device, the user interface allowing a user of the client device to input a request associated with a vehicle;
• receiving the request via the user interface presented on the client device, the request including an image of a physical vehicle title document captured by a camera of the client device;
• executing text extraction on the image to generate OCR text output;
• constructing a multi-modal input tensor comprising the image, the OCR text output, and one or more schema-based structured data templates representing expected field formats for information to be extracted from the image;
• providing the multi-modal input tensor to a machine-learned model configured to output a structured data object comprising title information, vehicle information, and ownership information associated with the vehicle;
• retrieving reference title metadata associated with the vehicle in response to an application programming interface (API) request transmitted to an external database system configured to maintain vehicle title records;
• validating information included in the structured data object based on the reference title metadata and a predetermined set of rules;
• and
• executing a predetermined action based on the validation.