# US 2020/0195799 A1 · Systems and methods relating to document and fastener identification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0195799 A1
- Document ID: US20200195799A1
- Status: Published application
- Kind: A1
- Application number: 16/708,700
- Filed: 2019-12-10
- Published: 2020-06-18
- Earliest claimed: 2015-12-19
- Assignees: Ripcord Inc.
- Applicants: Ripcord Inc.
- Inventors: Alex FIELDING; Kevin C. HALL; Kirk H. KNIGHT; Jens Jordan HURLEY; Jonathan Floyd GRUBB; Joseph David Dills HARTNAGLE
- Web page: https://patentgrep.com/patent/US20200195799A1

## CPC

- B25C 11/00: Nail, spike, and staple extractors (incorporated in hammers B25D1/00)
- H04N 1/00607: {Grippers or the like, e.g. suction grippers}
- G03G 15/607: {for detecting size, presence or position of original}
- G07D 7/189: Detecting attached objects, e.g. tapes or clips (G07D7/187 takes precedence)
- H04N 1/00588: {to the scanning position (H04N1/00572, H04N1/00594 take precedence)}
- H04N 1/00649: {Control or synchronising different handling operations (H04N1/00657 takes precedence)}
- H04N 1/0066: {Aligning or positioning related to handling}
- H04N 1/125: {the sheet feeding apparatus serving an auxiliary function, e.g. as a white reference}
- B65H 2301/42212: Extracting staple from stapled set of articles
- G03B 15/03: Combinations of cameras with lighting apparatus; Flash units
- G03B 15/07: Arrangements of lamps in studios
- G03G 2215/00308: Object for which a graphic image is not of interest, e.g. medical sample
- H04N 1/00755: {Detecting an interruption of light}
- B25C: HAND-HELD NAILING OR STAPLING TOOLS; MANUALLY OPERATED PORTABLE STAPLING TOOLS (for shoemaking A43D)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03G: ELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
- G07D: HANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
- B65H: HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

Method and systems of automated document processing described herein include activating in sequence a plurality of illumination modules of an illumination source to illuminate a document, where the plurality of illumination modules are located at different positions relative to the document. The document can be imaged each time the document is illuminated by an illumination module to provide a plurality of images. A shadow profile of the document can be obtained based on the plurality of images. One or more of a boundary of the document and presence of a fastener attached to the document can be identified using the shadow profile. Any fasteners present may be removed using a robot arm.

## Claims

### Claim 1

A document processing system, comprising:
a document pedestal configured to receive a document;
an illuminating source comprising a plurality of illumination modules configured to illuminate the document, wherein each of the plurality of illumination modules are located at different positions relative to the document pedestal and configured to be illuminated in sequence to illuminate the document;
an imaging device configured to capture a plurality of images, the plurality of images comprising at least one image of the document each time the document is illuminated by each of the plurality of illumination modules; and
a controller unit configured to obtain a shadow profile of the document based on the plurality of images, and identify at least one of a boundary of the document and presence of a fastener attached to the document using the shadow profile.

### Claim 2 (depends on 1)

The system of claim 1, wherein the plurality of illumination modules comprise a plurality of light-emitting diodes (LEDs).

### Claim 3 (depends on 1)

The system of claim 1, further comprising a document transfer end-effector comprising:
a body;
a suction applicator extending from a lower surface of the body, wherein the suction applicator is configured to apply a suction force upon at least a portion of the document to lift the document; and
a document pincher comprising a rotatable arm configured to be rotated towards the body to contact the document and pinch the document between the document pincher and the lower surface of the body.

### Claim 4 (depends on 3)

The system of claim 3, further comprising a document platform configured to be positioned beneath the document which has been lifted to separate the document from other documents on the document pedestal.

### Claim 5 (depends on 1)

The system of claim 1, wherein the controller unit is configured to identify presence of an inverted fastener, the system further comprising:
a first document platform configured to be positioned beneath the document which has been lifted to separate the document from other documents on the document pedestal; and
a second document platform configured to be positioned over the document which has been lifted, wherein the document is sandwiched between the first document platform and second document platform, and wherein the first document platform and second document platform are configured to be rotated around a horizontal axis to flip the document over.

### Claim 6 (depends on 1)

The system of claim 1, further comprising a robot arm and wherein the controller unit is configured to instruct removal of the fastener using an end effector coupled to the robot arm.

### Claim 7 (depends on 1)

The system of claim 1, further comprising a fastener removal end effector, the fastener removal end effector comprising:
a pair of document contacting portions configured to contact a top surface of the document to hold the document in place;
a fastener removal tab between the pair of document contacting portions, wherein the fastener removal tab is configured to be inserted between the fastener and the top surface of the document; and
a fastener gripper disposed above the fastener removal tab configured to grip the fastener to position at least a portion of the fastener between the fastener removal tab and the fastener gripper,
wherein movement of the fastener gripper and the fastener removal tab away from the document removes the fastener.

### Claim 8 (depends on 7)

The system of claim 7, wherein the fastener is a staple and wherein the at least one of the fastener removal tab and the fastener gripper comprises a width that is the same as a corresponding width of a crown of the staple.

### Claim 9

An automated system for document processing, comprising:
a document input configured to receive a document, wherein the document comprises a fastener attached thereto;
a detection unit configured to collect information regarding the document and the fastener;
a controller unit configured to receive the information from the detection unit to generate processed information; and
an interaction unit configured to manipulate at least one of the document and the fastener using a tool selected based on the processed information.

### Claim 10 (depends on 9)

The system of claim 9, wherein the detection unit comprises:
an illumination source comprising a plurality of illumination modules configured to illuminate the document and the fastener in sequence from different positions; and
an image capture device configured to capture a plurality of images of the document and the fastener, wherein the plurality of images comprise at least one image of the document and the fastener each time an illumination module of the plurality of illumination modules illuminates the document and the fastener,
wherein the controller is configured to compare the plurality of images to generate the processed information.

### Claim 11 (depends on 9)

The system of claim 9, wherein the tool comprises a fastener removal tool, wherein the interaction unit is configured to be releasably coupled to the tool, and wherein the controller is configured to instruct the interaction unit to couple to the tool for manipulating at least one of the document and the fastener to remove the fastener.

### Claim 12 (depends on 9)

The system of claim 9, wherein the controller is configured to use the processed information to determine a characteristic of at least one of the document and the fastener, and wherein the controller is configured to autonomously control, based at least in part on the characteristic, a movement of the interaction unit for manipulating at least one of the document and the fastener.
