# US 2018/0322355 A1 · Mobile terminal, image processing method, and computer-readable recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322355 A1
- Document ID: US20180322355A1
- Status: Published application
- Kind: A1
- Application number: 16/034,912
- Filed: 2018-07-13
- Published: 2018-11-08
- Earliest claimed: 2016-01-20
- Assignees: Pfu Limited
- Applicants: Pfu Limited
- Inventors: Hiroki TANIZAKI; Mitsuru NISHIKAWA
- Web page: https://patentgrep.com/patent/US20180322355A1

## CPC

- H04N 1/00005: {relating to image data}
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06V 10/993: {Evaluation of the quality of the acquired pattern}
- G06V 30/40: Document-oriented image-based pattern recognition
- H04N 1/00037: {Detecting, i.e. determining the occurrence of a predetermined state (H04N1/00031 takes precedence)}
- H04N 1/00047: {using an image not specifically designed for the purpose}
- H04N 1/0005: {in service, i.e. during normal operation}
- H04N 1/00063: {using at least a part of the apparatus itself, e.g. self-testing}
- H04N 1/00087: {Setting or calibrating (picture signal circuits H04N1/40)}
- H04N 1/00307: {with a mobile telephone apparatus (constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00)}
- H04N 1/19594: {using a television camera or a still video camera}
- H04N 1/4074: {using histograms}
- H04N 23/634: {Warning indications}
- H04N 23/6811: {based on the image signal}
- H04N 23/71: Circuitry for evaluating the brightness variation
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/10024: Color image
- G06T 2207/30168: Image quality inspection
- G06T 2207/30176: Document
- H04N 2101/00: Still video cameras
- H04N 2201/0084: Digital still camera
- H04N 2201/0096: Portable devices
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A mobile terminal includes a memory, and a processor coupled to the memory, wherein the processor executes a process comprising acquiring a frame with taking a photograph, acquiring document image data of a document from the frame, detecting shine on the document image data, determining whether the shine is equal to or smaller than a shine baseline, and acquiring a frame with retaking a photograph when the shine is neither equal to nor smaller than the shine baseline.

## Claims

### Claim 1

A mobile terminal comprising:
a memory; and
a processor coupled to the memory, wherein
the processor executes a process comprising:
acquiring a frame with taking a photograph;
from the frame, acquiring document image data of a document;
detecting shine on the document image data;
determining whether the shine is equal to or smaller than a shine baseline; and
acquiring a frame with retaking a photograph when the shine is neither equal to nor smaller than the shine baseline.

### Claim 2 (depends on 1)

The mobile terminal according to claim 1, wherein
the acquiring the document image data includes acquiring area image data of an area in the document from the frame, and
the detecting includes detecting the shine on the area image data.

### Claim 3 (depends on 2)

The mobile terminal according to claim 2, wherein
the acquiring the document image data includes acquiring the area image data of the area in the document from the frame based on a document type of the document.

### Claim 4 (depends on 3)

The mobile terminal according to claim 3, wherein
the area is a content area in the document defined based on the document type.

### Claim 5 (depends on 1)

The mobile terminal according to claim 1, wherein
the process further comprises displaying notification data indicative of what a user needs to do when the shine is neither equal to nor smaller than the shine baseline.

### Claim 6 (depends on 1)

The mobile terminal according to claim 1, wherein
the detecting includes calculating a threshold of the shine based on a background gradation value as a gradation value with highest frequency of gradation values of pixels included in the document image data and based on a gradation value with high frequency of gradation values larger than the background gradation value and detecting a total number of pixels having gradation values larger than the threshold among the pixels included in the document image data as the shine.

### Claim 7 (depends on 1)

The mobile terminal according to claim 1, wherein
the acquiring the document image data includes acquiring area image data of divided areas in the document from the frame,
the detecting includes detecting the shine on the area image data of each of the divided areas, and
the determining includes determining whether the shine is equal to or smaller than the shine baseline in all the divided areas.

### Claim 8 (depends on 1)

The mobile terminal according to claim 1, wherein
the detecting further includes detecting blur on the document image data,
the determining further includes determining whether the blur is equal to or larger than a blur baseline, and
the acquiring the frame with retaking the photograph further includes acquiring the frame with retaking a photograph when the blur is neither equal to nor larger than the blur baseline.

### Claim 9 (depends on 4)

The mobile terminal according to claim 4, wherein
the acquiring the document image data includes acquiring the area image data of the content area in the document from the frame based on the document type of the document and a position from an end of the document.

### Claim 10 (depends on 4)

The mobile terminal according to claim 4, wherein
the content area is a character area.

### Claim 11 (depends on 1)

The mobile terminal according to claim 1, wherein
the process further comprises performing an optical character recognition processing on the document image data to acquire character data.

### Claim 12 (depends on 1)

The mobile terminal according to claim 1, wherein
the process further comprises displaying any one or both of the frame and the document image data.

### Claim 13 (depends on 1)

The mobile terminal according to claim 1, wherein
the frame is uncompressed image data.

### Claim 14

An image processing method comprising:
acquiring a frame with taking a photograph;
from the frame, acquiring document image data of a document;
detecting shine on the document image data;
determining whether the shine is equal to or smaller than a shine baseline; and
acquiring a frame with retaking a photograph when the shine is neither equal to nor smaller than the shine baseline.

### Claim 15

A non-transitory computer readable recording medium having stored therein a program, the program causing a computer to execute a process comprising:
acquiring a frame with taking a photograph;
from the frame, acquiring document image data of a document;
detecting shine on the document image data;
determining whether the shine is equal to or smaller than a shine baseline; and
acquiring a frame with retaking a photograph when the shine is neither equal to nor smaller than the shine baseline.
