# US 2019/0377970 A1 · Digital image generation through an active lighting system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377970 A1
- Document ID: US20190377970A1
- Status: Published application
- Kind: A1
- Application number: 16/437,869
- Filed: 2019-06-11
- Published: 2019-12-12
- Earliest claimed: 2018-06-12
- Assignees: ID Metrics Group Incorporated
- Applicants: ID Metrics Group Incorporated
- Inventors: Richard Austin Huber, JR.; Matthew William Flagg; Satya Prakash Mallick
- Web page: https://patentgrep.com/patent/US20190377970A1

## CPC

- G06T 7/33: using feature-based methods
- G06T 3/18: Image warping, e.g. rearranging pixels individually
- G06T 5/30: Erosion or dilatation, e.g. thinning
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/40: Analysis of texture (depth or shape recovery from texture G06T7/529)
- G06V 30/1431: {Illumination control}
- G06V 30/18143: {Extracting features based on salient regional features, e.g. scale invariant feature transform [SIFT] keypoints}
- G06V 30/19067: {Matching configurations of points or features, e.g. constellation matching}
- G06T 2207/10152: Varying illumination
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30176: Document
- G06V 30/10: Character recognition
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for an active lighting system. In one aspect, a method includes receiving a first image of the physical document having a first glare signature and a second image of the physical document having a second glare signature that is different from the first glare signature; determining a first glare map of the first image and a second glare map of the second image; comparing the first glare map to the second glare map; and generating the digital image based on the comparison of the first and second glare maps.

## Claims

### Claim 1

A computer-implemented method for providing a digital image of a physical document, the method comprising:
receiving a first image of the physical document having a first glare signature and a second image of the physical document having a second glare signature that is different from the first glare signature;
determining a first glare map of the first image and a second glare map of the second image;
comparing the first glare map to the second glare map; and
generating the digital image based on the comparison of the first and second glare maps.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the first image is taken with a flash, and wherein the second image is taken without a flash.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the first image and the second image are taken in succession within a threshold temporal distance.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, compromising:
before determining the first glare map of the first image and the second glare map of the second image, aligning the first image and the second image based on the physical document.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein aligning the first image and the second image includes:
estimating a homography using features from accelerated segment test (FAST) detector and an oriented FAST and rotated Binary Robust Independent Elementary Features (ORB) detector to provide a description of texture around the physical document as depicted in each image; and
warping each pixel in the second image with the first image through a bi-linear interpolation.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein the homography is estimated based on a random sample consensus (RANSAC) algorithm.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein determining the first glare map of the first image includes generating a first greyscale image of the first image, and determining a second glare map of the second image includes generating a second greyscale image of the second image.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the first glare map and the second glare map are each binary images where each pixel represents either glare or no glare.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, further comprising:
before comparing the first glare map to the second glare map, dilating the first glare map and the second glare map to expanded regions of glare represent on each map.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein the digital image is generated by replacing the regions of glare in the first image with respective mapped regions from the second image, wherein the mapped regions from the second image do not include glare.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, wherein the mapped regions from the second image are merged into the first image to form the digital image through Poisson imaging blending.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein gradient information throughout the replaced regions of glare is employed to interpolate a color propagated from a boundary of each replaced glare region in the generated digital image.

### Claim 13 (depends on 10)

The computer-implemented method of claim 10, wherein the mapped regions from the second image are merged into the first image to form the digital image through a Mean Value Coordinates (MVC) for Instant Image Cloning algorithm.

### Claim 14 (depends on 1)

The computer-implemented method of claim 1, wherein the digital image is employed in an analysis of the physical document to identify text or data elements in the physical document.

### Claim 15 (depends on 14)

The computer-implemented method of claim 14, wherein the analysis of the physical document includes at least one of optical character recognition (OCR), optical word recognition (OWR), intelligent character recognition (ICR), intelligent word recognition (IWR), natural language processing (NLP), or machine learning.

### Claim 16 (depends on 1)

The computer-implemented method of claim 1, wherein the digital image is employed in an analysis of the physical document to detect digital tampering or physical tampering.

### Claim 17 (depends on 1)

The computer-implemented method claim 1, wherein the physical document is a professional or government-issued credentials or certifications.

### Claim 18

One or more non-transitory computer-readable storage media coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving a first image of a physical document having a first glare signature and a second image of the physical document having a second glare signature that is different from the first glare signature;
determining a first glare map of the first image and a second glare map of the second image;
comparing the first glare map to the second glare map; and
generating a digital image based on the comparison of the first and second glare maps.

### Claim 19 (depends on 18)

The one or more non-transitory computer-readable storage media of claim 18, wherein the digital image is employed in an analysis of the physical document to identify text or data elements in the physical document or to detect digital tampering or physical tampering, wherein the analysis of the physical document includes at least one of optical character recognition (OCR), optical word recognition (OWR), intelligent character recognition (ICR), intelligent word recognition (IWR), natural language processing (NLP), or machine learning, and wherein the physical document is a professional or government-issued credentials or certifications.

### Claim 20

A system, comprising:
one or more processors; and
a computer-readable storage device coupled to the one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving a first image of a physical document having a first glare signature and a second image of the physical document having a second glare signature that is different from the first glare signature;
aligning the first image and the second image based on the physical document by:
estimating a homography using features from accelerated segment test (FAST) detector and an oriented FAST and rotated Binary Robust Independent Elementary Features (ORB) detector to provide a description of texture around the physical document as depicted in each image; and
warping each pixel in the second image with the first image through a bi-linear interpolation;
determining a first glare map of the first image by generating a first greyscale image of the first image;
determining a second glare map of the second image by generating a second greyscale image of the second image;
dilating the first glare map and the second glare map to expanded regions of glare represent on each map;
comparing the first glare map to the second glare map; and
generating a digital image by replacing the regions of glare in the first image with respective mapped regions from the second image, wherein the mapped regions from the second image do not include glare.
