# US 2019/0170508 A1 · Portable 3d document scanning device and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0170508 A1
- Document ID: US20190170508A1
- Status: Published application
- Kind: A1
- Application number: 16/301,113
- Filed: 2017-04-05
- Published: 2019-06-06
- Earliest claimed: 2016-05-13
- Assignees: Kallion, Inc.
- Applicants: Kallion, Inc.
- Inventors: Chul Hee LEE
- Web page: https://patentgrep.com/patent/US20190170508A1

## CPC

- G01B 11/2518: {Projection by scanning of the object}
- G01B 11/028: {by measuring lateral position of a boundary of the object (G01B11/022, G01B11/024, G01B11/04 take precedence)}
- G01B 11/2509: {Color coding}
- G01B 11/2513: {with several lines being projected in more than one direction, e.g. grids, patterns}
- G01B 11/306: {for measuring evenness}
- G06T 7/55: from multiple images
- H04N 1/00: Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N 1/00827: {Arrangements for reading an image from an unusual original, e.g. 3-dimensional objects}
- H04N 13/20: Image signal generators
- H04N 23/60: Control of cameras or camera modules
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is a portable 3-dimensional (3D) document scanning device and method. The portable 3D document scanning device includes a projector projecting light of a predetermined pattern onto a document, a 3D scanning camera capturing a pattern of the light projected onto the document and the document, and a control unit estimating a size of the captured document based on image data of the captured document, estimating a shape of the captured document based on the pattern of the projected light and the captured pattern of the light, and correcting the image data of the captured document based on the estimated size and the estimated shape.

## Claims

### Claim 1

A portable 3-dimensional (3D) document scanning device, the device comprising:
a projector configured to project light of a predetermined pattern onto a document;
a 3D scanning camera configured to capture a pattern of the light projected onto the document and the document; and
a control unit, wherein the control unit is configured to:
estimate a size of the captured document based on image data of the captured document;
estimate a shape of the captured document based on the pattern of the projected light and the captured pattern of the light; and
correct the image data of the captured document based on the estimated size and the estimated shape.

### Claim 2 (depends on 1)

The device of claim 1, wherein the control unit is configured to:
detect at least one edge of the captured document to estimate the size and a rotation degree of the captured document;
compare the pattern of the projected light with the captured pattern of the light to estimate the shape of the captured document including bending or a wrinkle of the document; and
correct the image data of the captured document based on the estimated information.

### Claim 3 (depends on 2)

The device of claim 2, wherein the control unit is configured to:
correct the image data of the captured document based on the estimated information so as to change the captured document in a predetermined specific size and a predetermined specific shape.

### Claim 4 (depends on 1)

The device of claim 1, wherein the control unit is configured to:
detect whether a predetermined object is included in the captured document; and
when the object is detected, remove the detected object from the captured document.

### Claim 5 (depends on 1)

The device of claim 1, wherein the control unit is configured to:
estimate illuminance values for each area of the captured document based on the image data of the captured document, the pattern of the projected light and the captured pattern of the light, a material of the captured document, and an angle of the projected light; and
set the estimated illuminance values to a predetermined reference illuminance value with respect to each area of the captured document to correct the image data of the captured document.

### Claim 6 (depends on 1)

The device of claim 1, wherein the projector projects a plurality of structured lights having predetermined different patterns onto the document, and
wherein the 3D scanning camera captures a pattern of each of the plurality of structured lights projected onto the document.

### Claim 7

A portable 3D document scanning method, the method comprising:
projecting light of a predetermined pattern onto a document by using a projector;
capturing a pattern of the light projected onto the document and the document by using a 3D scanning camera;
estimating a size of the captured document based on image data of the captured document and estimating a shape of the captured document based on the pattern of the projected light and the captured pattern of the light; and
correcting the image data of the captured document based on the estimated size and the estimated shape.

### Claim 8 (depends on 7)

The method of claim 7, wherein the estimating includes:
detecting at least one edge of the captured document to estimate the size and a rotation degree of the captured document; and
comparing the pattern of the projected light and the captured pattern of the light to estimate the shape of the captured document including bending or a wrinkle of the document, and
wherein the correcting includes:
correcting the image data of the captured document based on the estimated information.

### Claim 9 (depends on 8)

The method of claim 8, wherein the correcting includes:
correcting the image data of the captured document based on the estimated information so as to change the captured document in a predetermined specific size and a predetermined specific shape.

### Claim 10 (depends on 7)

The method of claim 7, further comprising:
detecting whether a predetermined object is included in the captured document; and
when the object is detected, removing the detected object from the captured document,
wherein the correcting includes:
correcting the image data of the captured document, in which the detected object is removed, based on the estimated size and the estimated shape.

### Claim 11 (depends on 7)

The method of claim 7, wherein the estimating includes:
estimating illuminance values for each area of the captured document based on the image data of the captured document, the pattern of the projected light and the captured pattern of the light, a material of the captured document, and an angle of the projected light,
wherein the correcting includes:
setting the estimated illuminance values to a predetermined reference illuminance value with respect to each area of the captured document to correct the image data of the captured document.
