# US 2021/0342901 A1 · Systems and methods for machine-assisted document input

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342901 A1
- Document ID: US20210342901A1
- Status: Published application
- Kind: A1
- Application number: 17/243,289
- Filed: 2021-04-28
- Published: 2021-11-04
- Earliest claimed: 2020-04-29
- Applicants: Jpmorgan Chase Bank, N.A.
- Inventors: Jiangling WANG; Song Ting CENG; Hong JI; Somnath CHOUDHURI; Michael K. O'LEARY; Riti SINGHAL; Sandeep KOLLA; Syed Mohammed Abbas UBAISE; Michael HORGAN
- Web page: https://patentgrep.com/patent/US20210342901A1

## CPC

- G06Q 30/04: Billing or invoicing
- G06F 40/174: Form filling; Merging
- G06F 40/205: Parsing
- G06F 40/279: Recognition of textual entities
- G06F 40/295: Named entity recognition
- G06N 20/00: Machine learning
- G06Q 10/107: Computer-aided management of electronic mailing [e-mailing]
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- G06Q 40/12: Accounting
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems and methods for machine-assisted document input are disclosed. In one embodiment, a method may include a data extraction application executed by a computer processor: receiving an image of a document/email; generating a transcript of the document/email, wherein the transcript comprises a plurality of text groups from the document/email and a location for each text group in the document/email; identifying a vendor associated with the document/email based on contents of one of the text groups and/or one of the locations of the one of one of the text groups; retrieving a vendor-specific machine learning model for the vendor; associating each of the plurality of locations in the document/email with a billing field using the vendor-specific machine learning model; extracting each of the text groups into one of the billing fields based on the association; and transmitting the billing fields with the extracted data to a user electronic device.

## Claims

### Claim 1

A method for machine-assisted document input, comprising:
receiving, at a data extraction application executed by a computer processor, a document or email, wherein the document or email comprises a billing statement;
generating, by the data extraction application, a transcript of the document or email, wherein the transcript comprises a plurality of text groups from the document or email and a location for each text group in the document or email;
identifying, by the data extraction application, a vendor associated with the document or email based on contents of one of the text groups and/or one of the locations of the one of one of the text groups;
retrieving, by the data extraction application, a vendor-specific machine learning model for the vendor;
associating, by the data extraction application, each of the plurality of locations in the document or email with a billing field using the vendor-specific machine learning model;
extracting, by the data extraction application, each of the text groups into one of the billing fields based on the association; and
transmitting, by the data extraction application, the billing fields with the extracted data to a user electronic device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the data extraction application identifies the vendor using a trained vendor identification machine learning model.

### Claim 3 (depends on 1)

The method of claim 1, wherein the vendor-specific machine learning model is trained using a plurality of documents or emails for the vendor.

### Claim 4 (depends on 1)

The method of claim 1, wherein the billing fields comprise a vendor name field, a vendor address billing field, an account number billing field, and an amount billing field.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
applying, by the data extraction application, a pattern matching algorithm to the text groups in the transcript to identify the billing fields.

### Claim 6 (depends on 5)

The method of claim 5, wherein the pattern matching algorithm uses regular expressions to identify the billing fields based on a pattern of the text groups and the locations of the text groups in the document or email.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
classifying, by the data extraction application, contents of one of the text groups using a classification rule.

### Claim 8 (depends on 1)

The method of claim 1, wherein the document or email comprises an image.

### Claim 9

A method for machine-assisted document input, comprising:
receiving, at a data extraction application executed by a computer processor, a document or email, wherein the document or email comprises a billing statement;
generating, by the data extraction application, a transcript of the document or email, wherein the transcript comprises a plurality of text groups from the document or email and a location for each text group in the document or email;
retrieving, by the data extraction application, a vendor-agnostic machine learning model;
associating, by the data extraction application, each of the plurality of locations in the document or email with a billing field using the vendor-agnostic machine learning model;
extracting, by the data extraction application, each of the text groups into one of the billing fields based on the association; and
transmitting, by the data extraction application, the billing fields with the extracted data to a user electronic device.

### Claim 10 (depends on 9)

The method of claim 9, wherein the vendor-agnostic model is trained using a plurality of documents or emails from a plurality of vendors.

### Claim 11 (depends on 9)

The method of claim 9, wherein the billing fields comprise a vendor name field, a vendor address billing field, an account number billing field, and an amount billing field.

### Claim 12 (depends on 9)

The method of claim 9, further comprising:
applying, by the data extraction application, a pattern matching algorithm to the text groups in the transcript to identify the billing fields based on a pattern of the text groups and the locations of the text groups in the document or email.

### Claim 13 (depends on 12)

The method of claim 12, wherein the pattern matching algorithm uses regular expressions to identify the billing fields.

### Claim 14 (depends on 9)

The method of claim 9, further comprising:
classifying, by the data extraction application, contents of one of the text groups using a classification rule.

### Claim 15 (depends on 9)

The method of claim 9, wherein the document or email comprises an image.

### Claim 16

A method for machine-assisted document input, comprising:
receiving, at a data extraction application executed by a computer processor, a document or email, wherein the document or email comprises a billing statement;
generating, by the data extraction application, a transcript of the document or email, wherein the transcript comprises a plurality of text groups from the document or email and a location for each text group in the document or email;
applying, by the data extraction application, a pattern matching algorithm to the text groups in the transcript to identify billing fields based on a pattern of the text groups and locations in the document or email;
extracting, by the data extraction application, each of the text groups into one of the billing fields based on the pattern; and
transmitting, by the data extraction application, the billing fields with the extracted data to a user electronic device.

### Claim 17 (depends on 16)

The method of claim 16, wherein the billing fields comprise a vendor name field, a vendor address billing field, an account number billing field, and an amount billing field.

### Claim 18 (depends on 16)

The method of claim 16, wherein the pattern matching algorithm uses regular expressions to identify the billing fields.

### Claim 19 (depends on 16)

The method of claim 16, further comprising:
classifying, by the data extraction application, contents of one of the text groups using a classification rule.

### Claim 20 (depends on 16)

The method of claim 16, wherein the document or email comprises an image.
