# US 2020/0394429 A1 · Image analysis and processing pipeline with real-time feedback and autocapture capabilities, and visualization and configuration system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394429 A1
- Document ID: US20200394429A1
- Status: Published application
- Kind: A1
- Application number: 16/948,043
- Filed: 2020-08-28
- Published: 2020-12-17
- Earliest claimed: 2018-08-20
- Assignees: Capital One Services, LLC
- Applicants: Capital One Services, LLC
- Inventors: Jason PRIBBLE; Daniel Alan JARVIS; Nicholas CAPURSO
- Web page: https://patentgrep.com/patent/US20200394429A1

## CPC

- G06V 10/993: {Evaluation of the quality of the acquired pattern}
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/12: Edge-based segmentation
- G06V 10/141: Control of illumination
- G06V 10/242: {by image rotation, e.g. by 90 degrees}
- G06V 10/255: {Detecting or recognising potential candidate objects based on visual cues, e.g. shapes}
- G06V 10/30: Noise filtering
- G06V 10/443: {by matching or filtering}
- G06V 30/414: Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
- G06T 2207/20104: Interactive definition of region of interest [ROI]
- G06T 2207/20132: Image cropping
- G06T 2207/30168: Image quality inspection
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A device may capture a plurality of preview frames of a document, and for each preview frame of the plurality of preview frames, process the preview frame to identify an object in the preview frame. Processing the preview frame may include converting the preview frame into a grayscale image, generating a blurred image based on the grayscale image, detecting a plurality of edges in the blurred image, defining at least one bounding rectangle based on the plurality of edges, and determining an outline of the object based on the at least one bounding rectangle. The device may determine whether a value of an image parameter, associated with the one or more preview frames, satisfies a threshold, and provide feedback to a user of the device, or automatically capture an image of the document, based on determining whether the value of the image parameter satisfies the threshold.

## Claims

### Claim 1

A method, comprising:
processing, by a device, a preview frame to identify an outline of an object;
determining, by the device and based on processing the preview frame, whether a value of an image parameter, associated with the preview frame, satisfies a threshold,
the image parameter relating to contrast;
providing, by the device, feedback based on determining that the value of the image parameter does not satisfy the threshold,
the feedback including an instruction to perform an action with respect to at least one of the device or the object; and
automatically capturing, by the device, an image of the object based on determining that the value of the image parameter satisfies the threshold.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
processing a subsequent preview frame based on providing the feedback; and
determining the outline of the object based on processing the subsequent preview frame.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
providing, for display, a boundary corresponding to the outline of the object as an overlay.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
updating a position, an orientation, and/or a size of the boundary based on movements of the device.

### Claim 5 (depends on 1)

The method of claim 1, wherein the threshold is a first threshold; and
wherein the method further comprises:
applying a filter to the preview frame for glare detection; and
providing feedback based on determining that a value related to glare does not satisfy a second threshold.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
determining the outline of the object; and
wherein applying the filter to the preview frame comprises:
applying the filter only to pixels of a portion of the preview frame,
the portion of the preview frame corresponding to an area associated with the outline of the object.

### Claim 7 (depends on 1)

The method of claim 1, wherein the threshold is a first threshold and the value of the image parameter is a first value; and
wherein the method further comprises:
determining whether a second value, associated with a distance between the object and the device, satisfies a second threshold,
the second value being one of:
a width of the outline of the object,
a width of a camera preview display, or
a ratio based on the width of the outline of the object and the width of the camera preview display; and
providing feedback based on determining that the second value does not satisfy the second threshold.

### Claim 8

A device, comprising:
one or more memories; and
one or more processors, communicatively coupled to the one or more memories, configured to:
process a preview frame to identify an outline of an object;
determine, based on processing the preview frame, whether a value of an image parameter, associated with the preview frame, satisfies a threshold,
the image parameter relating to contrast;
provide feedback based on determining that the value of the image parameter does not satisfy the threshold,
the feedback including an instruction to perform an action with respect to at least one of the device or the object; and
automatically capture an image of the object based on determining that the value of the image parameter satisfies the threshold.

### Claim 9 (depends on 8)

The device of claim 8, wherein the one or more processors are further configured to:
process a subsequent preview frame based on providing the feedback; and
determine the outline of the object based on processing the subsequent preview frame.

### Claim 10 (depends on 9)

The device of claim 9, wherein the one or more processors are further configured to:
provide, for display, a boundary corresponding to the outline of the object as an overlay.

### Claim 11 (depends on 10)

The device of claim 10, wherein the one or more processors are further configured to:
update a position, an orientation, and/or a size of the boundary based on movements of the device.

### Claim 12 (depends on 8)

The device of claim 8, wherein the threshold is a first threshold; and
wherein the one or more processors are further configured to:
apply a filter to the preview frame for glare detection; and
provide feedback based on determining that a value related to glare does not satisfy a second threshold.

### Claim 13 (depends on 12)

The device of claim 12, wherein the one or more processors are further configured to:
determine the outline of the object; and
wherein the one or more processors, when applying the filter to the preview frame, are configured to:
apply the filter only to pixels of a portion of the preview frame,
the portion of the preview frame corresponding to an area associated with the outline of the object.

### Claim 14 (depends on 8)

The device of claim 8, wherein the threshold is a first threshold and the value of the image parameter is a first value; and
wherein the one or more processors are further configured to:
determine whether a second value, associated with a distance between the object and the device, satisfies a second threshold,
the second value being one of:
a width of the outline of the object,
a width of a camera preview display, or
a ratio based on the width of the outline of the object and the width of the camera preview display; and
provide feedback based on determining that the second value does not satisfy the second threshold.

### Claim 15

A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:
one or more instructions that, when executed by one or more processors of a device, cause the device to:
process a preview frame to identify an outline of an object;
determine, based on processing the preview frame, whether a value of an image parameter, associated with the preview frame, satisfies a threshold,
the image parameter relating to contrast;
provide feedback based on determining that the value of the image parameter does not satisfy the threshold,
the feedback including an instruction to perform an action with respect to at least one of the device or the object; and
automatically capture an image of the object based on determining that the value of the image parameter satisfies the threshold.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the one or more instructions further cause the device to:
process a subsequent preview frame based on providing the feedback; and
determine the outline of the object based on processing the subsequent preview frame.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein the one or more instructions further cause the device to:
provide, for display, a boundary corresponding to the outline of the object as an overlay.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the one or more instructions further cause the device to:
update a position, an orientation, and/or a size of the boundary based on movements of the device.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the threshold is a first threshold; and
wherein the one or more instructions further cause the device to:
apply a filter to the preview frame for glare detection; and
provide feedback based on determining that a value related to glare does not satisfy a second threshold.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein the one or more instructions further cause the device to:
determine the outline of the object; and
wherein the one or more instructions, that cause the device to apply the filter to the preview frame, cause the device to:
apply the filter only to pixels of a portion of the preview frame,
the portion of the preview frame corresponding to an area associated with the outline of the object.
