# US 2016/0253573 A1 · Automatically Capturing and Cropping Image of Check from Video Sequence for Banking or other Computing Application

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253573 A1
- Document ID: US20160253573A1
- Status: Published application
- Kind: A1
- Application number: 14/633,955
- Filed: 2015-02-27
- Published: 2016-09-01
- Earliest claimed: 2015-02-27
- Assignees: Lexmark International, Inc.
- Applicants: Lexmark International, Inc.
- Inventors: Ahmed Hamad Mohamed Eid; Tomasz Jan Cholewo; Stuart Willard Daneil; Stacy Lee Simpson
- Web page: https://patentgrep.com/patent/US20160253573A1

## CPC

- G06T 3/00: Geometric image transformations in the plane of the image
- G06Q 20/042: {characterized in that the payment protocol involves at least one cheque}
- G06Q 20/0425: {the cheque being electronic only}
- G06Q 20/108: {Remote banking, e.g. home banking}
- G06T 7/13: Edge detection
- G06V 30/19013: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching (specially adapted for image segmentation G06T7/10; specially adapted for the analysis of motion G06T7/20; specially adapted for image alignment G06T7/30; specially adapted for the calculation of depth from stereo images G06T7/50; specially adapted for position determination G06T7/70)}
- G06V 30/416: Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20132: Image cropping
- G06T 2207/30176: Document
- G06V 30/10: Character recognition
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A mobile device with camera automatically captures an image of a check from a video sequence. A computing application assesses quality metrics of a frame of the video and, if acceptable, initiates capture of the check in that frame without user selection. Metrics include an aspect ratio of the check, image quality of the routing transit symbols that delineate a routing transit number on a MICR line of the check, distances between the routing transit symbols and to an edge of the check, recognition of digits of the routing transit number, checksum of the routing transit numbers, and image sharpness. Other embodiments note cropping of the check from the background of the image, properly orienting the check for viewing, and providing color coded visual feedback to users about the quality of the image frame about the check, to name a few.

## Claims

### Claim 1

A method for automatically capturing an image of a check from a video sequence of images of the check without user selection, the video sequence having a plurality of frames, comprising:
determining an aspect ratio of the check;
finding in a single frame of the plurality of frames of the video sequence both routing transit symbols that delineate a routing transit number on a MICR line of the check;
matching to a template each of the routing transit symbols;
determining a first distance from one of the routing transit symbols to the other of the routing transit symbols and a second distance from said one of the routing transit symbols to an edge of the check;
calculating a ratio of the first distance and the second distance;
comparing each digit of the routing transit number to templates of digits to determine values of the routing transit number; and
capturing the image of the check from the single frame.

### Claim 2 (depends on 1)

The method of claim 1, further including cropping the check from the single frame, including eliminating background pixels.

### Claim 3 (depends on 1)

The method of claim 1, further including assessing stability of the video sequence.

### Claim 4 (depends on 1)

The method of claim 1, further including receiving for processing another frame of the video sequence.

### Claim 5 (depends on 1)

The method of claim 1, further including determining an orientation of the check in the single frame.

### Claim 6 (depends on 5)

The method of claim 5, wherein the finding said both routing transit symbols occurs relative to only a bottom or top portion of the check depending on said orientation.

### Claim 7 (depends on 5)

The method of claim 5, further including rotating the check for a user to view from left-to-right if the orientation of the check is upside-down as users read from left-to-right.

### Claim 8 (depends on 1)

The method of claim 1, further including calculating a checksum of the routing transit number.

### Claim 9 (depends on 1)

The method of claim 1, further including calculating a sharpness of the image of the check in the single frame.

### Claim 10 (depends on 1)

The method of claim 1, further including calculating a possible bounding border of the check in the single frame.

### Claim 11 (depends on 10)

The method of claim 10, further including displaying to a user the possible bounding border with color-coding according to a calculated quality of the possible bounding border.

### Claim 12 (depends on 1)

The method of claim 1, wherein the comparing said each digit of the routing transit number to the templates of digits to determine values of the routing transit number further includes comparing said each digit of the routing transit number to templates of digits ranging from values 0 to 9 and selecting a best matching image template therefore.

### Claim 13 (depends on 1)

The method of claim 1, further including calculating an image width to an image height of the check in the single frame to said determine the aspect ratio, wherein an acceptable range of aspect ratios ranges from about 1.7 to about 3.1.

### Claim 14 (depends on 1)

The method of claim 1, wherein the determining said first and second distances further includes determining an (x, y) position coordinate of a bounding box about said both routing transit symbols.

### Claim 15 (depends on 14)

The method of claim 14, further including determining said first and second distances from said (x, y) position coordinate of the bounding box about said both routing transit symbols.

### Claim 16 (depends on 8)

The method of claim 8, wherein the calculating the checksum further includes executing a Modulo 10 of weighted sums of the determined values of the routing transit number.

### Claim 17 (depends on 1)

The method of claim 1, further including determining if the aspect ratio, a worst match of the matching to the template, the ratio of the first and second distances, and the comparing said each digit of the routing transit number fall within a predetermined range of acceptable values before said capturing the image of the check from the single frame.

### Claim 18

A method for automatically capturing an image of a check from a video sequence of images of the check without user selection, the video sequence having a plurality of frames, comprising:
finding in a single frame of the plurality of frames of the video sequence both routing transit symbols that delineate a routing transit number on a MICR line of the check, the finding occurring by matching to a template each of the routing transit symbols and calculating a matching score therefore;
upon the matching score meeting a predetermined acceptable threshold, determining a first distance from one of the routing transit symbols to the other of the routing transit symbols and a second distance from said one of the routing transit symbols to an edge of the check;
calculating a ratio of the first distance and the second distance; and
upon the ratio falling within a predetermined acceptable range, capturing the image of the check from the single frame.

### Claim 19 (depends on 18)

The method of claim 18, further including receiving for processing another frame of the video sequence and repeating the finding, determining and calculating.

### Claim 20

A method for automatically capturing an image of a check from a video sequence of images of the check without user selection, the video sequence having a plurality of frames, comprising:
finding in a single frame of the plurality of frames of the video sequence both routing transit symbols that delineate a routing transit number on a MICR line of the check;
determining a first distance from one of the routing transit symbols to the other of the routing transit symbols and a second distance from said one of the routing transit symbols to an edge of the check;
calculating a ratio of the first distance and the second distance;
comparing each digit of the routing transit number to templates of digits to determine values of the routing transit number; and
capturing the image of the check from the single frame.
