Systems and methods for generating document numerical representations

A method comprising:

• determining a plurality of example documents, each example document being a unique example document associated with a set of attributes;
• for each of the example documents:
• extracting the image data and the character data from the document;
• providing, to an image-based numerical representation generation model, the image data;
• generating, by the image-based numerical representation generation model, an image-based numerical representation of the image data;
• providing, to a character-based numerical representation generation model, the character data;
• generating, by the character-based numerical representation generation model, a character-based numerical representation of the character data;
• providing, to a consolidated image-character based numerical representation generation model, the image-based numerical representation and the character-based numerical representation;
• generating, by the consolidated image-character based numerical representation generation model, a combined image-character based numerical representation of the document;
• and
• labelling the combined image-character based numerical representation of the document with the at least first attribute;
• and
• collating the combined image-character based numerical representations for the plurality of example documents into an index of numerical representations;
• wherein the respective document of each combined image-character based numerical representation of the index has a second attribute value, and wherein associating the candidate document with the first attribute value of the determined combined image-character based numerical representation of the index further comprises associating the candidate document with the second attribute value of the determined combined image-character based numerical representation of the index.

A system comprising:

• one or more processors;
• and
• memory comprising computer executable instructions, which when executed by the one or more processors, cause the system to:
• determine a candidate document comprising image data and character data;
• extract the image data and the character data from the candidate document;
• provide, to an image-based numerical representation generation model, the image data;
• generate, by the image-based numerical representation generation model, an image-based numerical representation of the image data;
• provide, to a character-based numerical representation generation model, the character data;
• generate, by the character-based numerical representation generation model, a character-based numerical representation of the character data;
• provide, to a consolidated image-character based numerical representation generation model, the image-based numerical representation and the character-based numerical representation;
• generate, by the consolidated image-character based numerical representation generation model, a combined image-character based numerical representation of the candidate document;
• compare the combined image-character based numerical representation of the candidate document with an index of combined image-character based numerical representations, each combined image-character based numerical representations of the index being indicative of a respective document having a first attribute value;
• determine a combined image-character based numerical representation of the index that substantially corresponds with the combined image-character based numerical representation of the candidate document;
• and
• associate the candidate document with the first attribute value of the determined combined image-character based numerical representation of the index
• wherein the respective document of each combined image-character based numerical representation of the index has a second attribute value, and wherein associating the candidate document with the first attribute value of the determined combined image-character based numerical representation of the index further comprises associating the candidate document with the second attribute value of the determined combined image-character based numerical representation of the index.

A non-transitory computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform operations including:

• determining a candidate document comprising image data and character data;
• extracting the image data and the character data from the candidate document;
• providing, to an image-based numerical representation generation model, the image data;
• generating, by the image-based numerical representation generation model, an image-based numerical representation of the image data;
• providing, to a character-based numerical representation generation model, the character data;
• generating, by the character-based numerical representation generation model, a character-based numerical representation of the character data;
• providing, to a consolidated image-character based numerical representation generation model, the image-based numerical representation and the character-based numerical representation;
• generating, by the consolidated image-character based numerical representation generation model, a combined image-character based numerical representation of the candidate document;
• comparing the combined image-character based numerical representation of the candidate document with an index of combined image-character based numerical representations, each combined image-character based numerical representations of the index being indicative of a respective document having a first attribute value;
• determining a combined image-character based numerical representation of the index that substantially corresponds with the combined image-character based numerical representation of the candidate document;
• and
• associating the candidate document with the first attribute value of the determined combined image-character based numerical representation of the index;
• wherein the respective document of each combined image-character based numerical representation of the index has a second attribute value, and wherein associating the candidate document with the first attribute value of the determined combined image-character based numerical representation of the index further comprises associating the candidate document with the second attribute value of the determined combined image-character based numerical representation of the index.

A system comprising:

• one or more processors;
• and
• memory comprising computer executable instructions, which when executed by the one or more processors, cause the system to:
• determine a plurality of example documents, each example document being a unique example document associated with a set of attributes;
• for each of the example documents:
• extract the image data and the character data from the document;
• provide, to an image-based numerical representation generation model, the image data;
• generate, by the image-based numerical representation generation model, an image-based numerical representation of the image data;
• provide, to a character-based numerical representation generation model, the character data;
• generate, by the character-based numerical representation generation model, a character-based numerical representation of the character data;
• provide, to a consolidated image-character based numerical representation generation model, the image-based numerical representation and the character-based numerical representation;
• generate, by the consolidated image-character based numerical representation generation model, a combined image-character based numerical representation of the document;
• and
• label the combined image-character based numerical representation of the document with the at least first attribute;
• and
• collate the combined image-character based numerical representations for the plurality of example documents into an index of numerical representations;
• wherein the respective document of each combined image-character based numerical representation of the index has a second attribute value, and wherein associating the candidate document with the first attribute value of the determined combined image-character based numerical representation of the index further comprises associating the candidate document with the second attribute value of the determined combined image-character based numerical representation of the index.

A computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform operations including:

• determining a plurality of example documents, each example document being a unique example document associated with a set of attributes;
• for each of the example documents:
• extracting the image data and the character data from the document;
• providing, to an image-based numerical representation generation model, the image data;
• generating, by the image-based numerical representation generation model, an image-based numerical representation of the image data;
• providing, to a character-based numerical representation generation model, the character data;
• generating, by the character-based numerical representation generation model, a character-based numerical representation of the character data;
• providing, to a consolidated image-character based numerical representation generation model, the image-based numerical representation and the character-based numerical representation;
• generating, by the consolidated image-character based numerical representation generation model, a combined image-character based numerical representation of the document;
• and
• labelling the combined image-character based numerical representation of the document with the at least first attribute;
• and
• collating the combined image-character based numerical representations for the plurality of example documents into an index of numerical representations;
• wherein the respective document of each combined image-character based numerical representation of the index has a second attribute value, and wherein associating the candidate document with the first attribute value of the determined combined image-character based numerical representation of the index further comprises associating the candidate document with the second attribute value of the determined combined image-character based numerical representation of the index.