# US 2022/0284723 A1 · Zero-footprint image capture by mobile device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284723 A1
- Document ID: US20220284723A1
- Status: Published application
- Kind: A1
- Application number: 17/750,898
- Filed: 2022-05-23
- Published: 2022-09-08
- Earliest claimed: 2020-12-23
- Assignees: ABBYY Development LLC
- Applicants: ABBYY Development Inc.
- Inventors: Ivan Zagaynov; Stepan Lobastov; Juri Katkov; Vasily Shahov; Olga Titova; Ivan Khintsitskiy
- Web page: https://patentgrep.com/patent/US20220284723A1

## CPC

- G06V 10/82: using neural networks
- G06V 30/414: Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
- G06F 18/21: Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/11: Region-based segmentation
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/40: Extraction of image or video features
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/48: by mapping characteristic values of the pattern into a parameter space, e.g. Hough transformation
- G06V 10/993: {Evaluation of the quality of the acquired pattern}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 30/142: using hand-held instruments; Constructional details of the instruments
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20132: Image cropping
- G06T 2207/30168: Image quality inspection
- G06T 2207/30176: Document
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A computer-implemented method for image capture by a mobile device, comprising: receiving, by a video capturing application running on a mobile device, a video stream from a camera of the mobile device; identifying a specific frame of the video stream; generating a plurality of hypotheses defining image borders within the specific frame; selecting, by a neural network, a particular hypothesis among the plurality of hypotheses; producing a candidate image by applying the particular hypothesis to the specific frame; determining a value of a quality metric of the candidate image; determining that the value of the quality metric of the candidate image exceeds one or more values of the quality metric of one or more previously processed images extracted from the video stream; wherein the image capture application is a zero-footprint application.

## Claims

### Claim 1

A method, comprising:
receiving, by a video capturing application running on a mobile device, a video stream from a camera of the mobile device;
identifying a specific frame of the video stream;
producing a candidate image by a neural network processing the specific frame;
determining a value of a quality metric of the candidate image;
determining that the value of the quality metric of the candidate image exceeds one or more values of the quality metric of one or more previously processed images extracted from the video stream.

### Claim 2 (depends on 1)

The method of claim 1, further comprising: performing optical character recognition of a document depicted by the candidate image.

### Claim 3 (depends on 2)

The method of claim 2, wherein the optical character recognition of the document is performed on the mobile device.

### Claim 4 (depends on 1)

The method of claim 1, further comprising: cropping the candidate image.

### Claim 5 (depends on 1)

The method of claim 1, further comprising: displaying the candidate image on a screen of the mobile device.

### Claim 6 (depends on 1)

The method of claim 1, wherein receiving the video stream is performed responsive to receiving a command via a web browser control.

### Claim 7 (depends on 1)

The method of claim 1, wherein receiving the video stream is performed responsive to receiving a command via a user interface control of the mobile device.

### Claim 8

A mobile device, comprising:
a memory;
a camera;
a processor, coupled to the memory and to the camera, the processor configured to:
receive a video stream from the camera;
identify a specific frame of the video stream;
produce a candidate image by a neural network processing the specific frame;
determine a value of a quality metric of the candidate image;
determine that the value of the quality metric of the candidate image exceeds one or more values of the quality metric of one or more previously processed images extracted from the video stream.

### Claim 9 (depends on 8)

The mobile device of claim 8, wherein the processor is further configured to: perform optical character recognition of a document depicted by the candidate image.

### Claim 10 (depends on 9)

The mobile device of claim 9 wherein the optical character recognition of the document is performed on the mobile device.

### Claim 11 (depends on 8)

The mobile device of claim 8, wherein the processor is further configured to: crop the candidate image.

### Claim 12 (depends on 8)

The mobile device of claim 8, wherein the processor is further configured to: display the candidate image on a screen of the mobile device.

### Claim 13 (depends on 8)

The mobile device of claim 8, wherein receiving the video stream is performed responsive to receiving a command via a web browser control.

### Claim 14 (depends on 8)

The mobile device of claim 8, wherein receiving the video stream is performed responsive to receiving a command via a user interface control of the mobile device.

### Claim 15

A non-transitory computer-readable storage medium comprising executable instructions that, when executed by a processor of a mobile device, cause the processor to:
receive a video stream from a camera associated with the mobile device;
identify a specific frame of the video stream;
produce a candidate image by a neural network processing the specific frame;
determine a value of a quality metric of the candidate image;
determine that the value of the quality metric of the candidate image exceeds one or more values of the quality metric of one or more previously processed images extracted from the video stream.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, further comprising executable instructions that, when executed by the processor of the mobile device, cause the processor to: perform optical character recognition of a document depicted by the candidate image.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the optical character recognition of the document is performed on the mobile device.

### Claim 18 (depends on 15)

The non-transitory computer-readable storage medium of claim 15 further comprising executable instructions that, when executed by the processor of the mobile device, cause the processor to: crop the candidate image.

### Claim 19 (depends on 15)

The non-transitory computer-readable storage medium of claim 15 further comprising executable instructions that, when executed by the processor of the mobile device, cause the processor to: display the candidate image on a screen of the mobile device.

### Claim 20 (depends on 15)

The non-transitory computer-readable storage medium of claim 15 wherein receiving the video stream is performed responsive to receiving a command via a web browser control.
