# US 10,043,073 B2 · Document authentication using extracted digital fingerprints

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,043,073 B2
- Document ID: US10043073B2
- Status: Granted
- Kind: B2
- Application number: 15/044,034
- Filed: 2016-02-15
- Published: 2016-06-09
- Granted: 2018-08-07
- Earliest claimed: 2011-03-02
- Assignees: Alitheon, Inc.
- Applicants: Alitheon, Inc.
- Inventors: David Ross; Brian Elmenhurst; Mark Tocci; John Forbes; Heather Wheelock Ross
- Web page: https://patentgrep.com/patent/US10043073B2

## CPC

- G06V 30/424: Postal images, e.g. labels or addresses on parcels or postal envelopes
- B07C 5/3422: {using video scanning devices, e.g. TV-cameras}
- G06F 16/2468: {Fuzzy queries}
- G06F 16/583: using metadata automatically derived from the content
- G06F 16/5846: {using extracted text}
- G06T 7/60: Analysis of geometric attributes
- G06T 7/90: Determination of colour characteristics
- G06V 10/245: {by locating a pattern; Special marks for positioning}
- G06V 30/418: Document matching, e.g. of document images
- H04L 9/3247: {involving digital signatures}
- G06Q 50/60: Business processes related to postal services (shipping G06Q10/083; franking apparatus G07B17/00)
- G06V 30/10: Character recognition
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B07C: POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING (specially adapted for a specific purpose covered by another class, see the relevant place, e.g. A43D33/06, B23Q7/12)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Methods and systems for detecting changes, alterations and forgeries in documents utilize digital fingerprinting. A set of documents of a given type that are known to be altered or forgeries are scanned and “fingerprinted” to build a forgery database. Suspect documents are scanned and the resulting fingerprint data is used to query the forgery database to look for matching records, although a match need not be exact. Matches may be counted and compared to a threshold number to assess a confidence that a document is forged or not. The fingerprinting may be directed to at least one authentication region of a document, and one or more features in a region may be incorporated into a fingerprint of the document.

## Claims

### Claim 1

A method comprising:
acquiring digital image data of an image of at least a selected authentication region of a document, without printing or adding anything on to the document, and wherein the document has been previously forged or altered at least in the authentication region from its original state;
extracting at least one native feature from the acquired digital image data from the authentication region, wherein the at least one native feature describes physical characteristics of the authentication region without recognizing content such as alpha-numeric characters that may appear in the authentication region;
forming a feature vector to represent the at least one native feature in a compact form;
storing the feature vector in a database record as part of a digital fingerprint of the document in a forgery database for use in detecting forged or altered documents among a class of documents to which the forged or altered document belongs;
repeating the foregoing steps over additional documents that have been forged or altered to add, respectively, additional feature vectors in additional database records as part of additional digital fingerprints of the additional documents to the forgery database, the additional feature vectors representing corresponding native features in the additional documents;
acquiring second digital image data of a portion of a suspect document, wherein the portion of the suspect document corresponds to the authentication region used to build the forgery database;
extracting second features from the second digital image data;
forming a second feature vector to represent the second features in the compact form;
querying the forgery database using the second feature vector to obtain a result based on zero or more stored feature vectors that match the second feature vector, each stored feature vector that matches the second feature vector defining a fraud indicator match;
counting a number of the fraud indicator matches;
comparing the number of the fraud indicator matches to a predetermined threshold value to determine a confidence level that the suspect document is forged or altered;
generating a report of the determined confidence level based on the comparison; and
transmitting the report to a user interface.

### Claim 2 (depends on 1)

The method of claim 1 wherein the feature vector comprises an array of color or gray scale numeric values corresponding to a sub-region within the selected authentication region.

### Claim 3 (depends on 2)

The method of claim 2 wherein the numeric values in the array each comprise a mathematical function combining individual values of a corresponding group of pixels forming the sub-region of the authentication region.

### Claim 4 (depends on 3)

The method of claim 3 wherein the mathematical function is selected from a set of functions that includes a sum, maximum, and average of the individual values.

### Claim 5 (depends on 3)

The method of claim 3 wherein extracting the at least one native feature includes selecting the authentication region based on a predetermined template that defines at least one authentication region for the class of documents to which the forged or altered documents belong.

### Claim 6 (depends on 5)

The method of claim 5 wherein at least one of the digital fingerprints in the forgery database corresponds to an original work of art.

### Claim 7 (depends on 3)

The method of claim 3 wherein at least one of the digital fingerprints in the forgery database corresponds to a forged or altered document that comprises a numismatic object.

### Claim 8 (depends on 3)

The method of claim 3 wherein at least one of the digital fingerprints in the forgery database corresponds to a government-issued identification document.

### Claim 9 (depends on 8)

The method of claim 8 wherein the government-issued identification document corresponds to a passport.

### Claim 10 (depends on 3)

The method of claim 3 wherein at least one of the digital fingerprints in the forgery database corresponds to a negotiable instrument as defined in the Uniform Commercial Code.

### Claim 11 (depends on 3)

The method of claim 3 wherein at least one of the digital fingerprints in the forgery database corresponds to a bill of lading or shipping document.

### Claim 12 (depends on 1)

The method of claim 1 including:
acquiring digital image data of multiple different regions of a second document;
processing the acquired digital image data of the multiple different regions by extracting multiple features from the multiple different regions;
including the multiple extracted features in a second digital fingerprint; and
comparing the second digital fingerprint to the digital fingerprints in the forgery database by conducting region-by-region matching to detect what, if any, regions have been changed.

### Claim 13

A system comprising:
an image capture device to acquire digital image data of an image of at least a selected authentication region of a document, without printing or adding anything on to the document, and wherein the document has been previously forged or altered at least in the authentication region from its original state; and
a processor arranged to access the digital image data, the processor coupled to a non-volatile memory storing machine-readable code executable by the processor, wherein the machine-readable code is arranged to cause the processor, upon execution, to:
extract at least one native feature from the acquired digital image data from the authentication region, wherein the at least one native feature describes physical characteristics of the authentication region without recognizing content such as alpha-numeric characters that may appear in the authentication region;
form a feature vector to represent the at least one native feature in a compact form;
store the feature vector in a database record as part of a digital fingerprint of the document in a forgery database for use in detecting forged or altered documents among a class of documents to which the forged or altered document belongs;
repeat the foregoing steps over additional documents that have been forged or altered to add, respectively, additional feature vectors in additional database records as part of additional digital fingerprints of the additional documents to the forgery database, the additional feature vectors representing corresponding native features in the additional documents;
acquire second digital image data of a portion of a suspect document, wherein the portion of the suspect document corresponds to the authentication region used to build the forgery database;
extract second features from the second digital image data;
form a second feature vector to represent the second features in the compact form;
query the forgery database using the second feature vector to obtain a result based on zero or more stored feature vectors that match the second feature vector, each stored feature vector that matches the second feature vector defining a fraud indicator match;
count a number of the fraud indicator matches;
compare the number of the fraud indicator matches to a predetermined threshold value to determine a confidence level that the suspect document is forged or altered;
generate a report of the determined confidence level based on the comparison; and
transmit the report to a user interface.

### Claim 14 (depends on 13)

The system of claim 13 wherein the feature vector comprises an array of color or gray scale numeric values corresponding to a sub-region within the selected authentication region.

### Claim 15 (depends on 14)

The system of claim 14 wherein the numeric values in the array each comprise a mathematical function combining individual values of a corresponding group of pixels forming the sub-region of the authentication region.

### Claim 16 (depends on 15)

The system of claim 15 wherein the mathematical function is selected from a set of functions that includes a sum, maximum, and average of the individual values.

### Claim 17 (depends on 13)

The system of claim 13 wherein extracting the at least one native feature includes selecting the authentication region based on a predetermined template that defines at least one authentication region for the class of documents to which the forged or altered documents belong.

### Claim 18 (depends on 13)

The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to a forged or altered document that comprises a numismatic object.

### Claim 19 (depends on 13)

The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to a government-issued identification document.

### Claim 20 (depends on 13)

The system of claim 13 wherein the government-issued identification document corresponds to a passport.

### Claim 21 (depends on 13)

The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to a negotiable instrument as defined in the Uniform Commercial Code.

### Claim 22 (depends on 13)

The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to a bill of lading or shipping document.

### Claim 23 (depends on 13)

The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to an original work of art.

### Claim 24

A manufacture comprising a non-volatile, computer-readable memory, the memory storing instruction to cause a processor to:
access digital image data, the digital image data acquired from at least a selected authentication region of a document;
extract at least one native feature from the acquired image data from the authentication region, wherein the native feature describes physical characteristics of the authentication region without recognizing content such as alpha-numeric characters that may appear in the authentication region;
form a feature vector to represent the at least one native feature in a compact form;
store the feature vector in a database record as part of a digital fingerprint of the document in a forgery database for use in detecting forged or altered documents among a class of documents to which the forged document belongs;
repeat the foregoing steps over additional documents that have been forged or altered to add additional feature vectors to the forgery database, the feature vectors representing corresponding native features in the additional documents;
acquire second digital image data of a portion of a suspect document, wherein the portion of the suspect document corresponds to the authentication region used to build the forgery database;
extract second features from the second image data;
form a second feature vector to represent the second features in a compact form;
querying the forgery database using the second feature vector to obtain a result based on zero or more stored feature vectors that match the second feature vector, each stored feature vector that matches the second feature vector defining a defining a fraud indicator match;
count a number of the fraud indicator matches;
compare the number of the fraud indicator matches to a predetermined threshold value to determine a confidence level that the suspect document is forged or altered;
generate a report of the determined confidence level based on the comparison; and
transmit the report to a user interface.

### Claim 25 (depends on 24)

The manufacture of claim 24 wherein the feature vector comprises an array of color or gray scale numeric values corresponding to a sub-region within the selected authentication region.

### Claim 26 (depends on 25)

The manufacture of claim 25 wherein the numeric values in the array each comprise a mathematical function combining individual values of a corresponding group of pixels forming the sub-region of the authentication region.

### Claim 27 (depends on 26)

The manufacture of claim 26 wherein the mathematical function is selected from a set of functions that includes a sum, maximum, and average of the individual values.

### Claim 28 (depends on 24)

The manufacture of claim 24 wherein extracting the at least one native feature includes selecting the authentication region based on a predetermined template that defines at least one authentication region for the class of documents to which the forged or altered documents belong.

### Claim 29 (depends on 24)

The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to a forged or altered document that comprises a numismatic object.

### Claim 30 (depends on 24)

The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to a government-issued identification document.

### Claim 31 (depends on 24)

The manufacture of claim 24 wherein the government-issued identification document corresponds to a passport.

### Claim 32 (depends on 24)

The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to a negotiable instrument as defined in the Uniform Commercial Code.

### Claim 33 (depends on 24)

The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to a bill of lading or shipping document.

### Claim 34 (depends on 24)

The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to an original work of art.