# US 10,484,610 B2 · Image-capturing apparatus, captured image processing system, program, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,484,610 B2
- Document ID: US10484610B2
- Status: Granted
- Kind: B2
- Application number: 15/191,639
- Filed: 2016-06-24
- Published: 2016-10-20
- Granted: 2019-11-19
- Earliest claimed: 2012-01-17
- Assignees: Sharp Kabushiki Kaisha
- Applicants: Sharp Kabushiki Kaisha
- Inventors: Hiroshi Ishida
- Web page: https://patentgrep.com/patent/US10484610B2

## CPC

- H04N 5/142: {Edging; Contouring}
- G06T 5/80: Geometric correction
- G06T 7/13: Edge detection
- G06T 7/181: involving edge growing; involving edge linking
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 30/40: Document-oriented image-based pattern recognition
- H04N 1/00251: {with an apparatus for taking photographic images, e.g. a camera}
- H04N 1/00307: {with a mobile telephone apparatus (constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00)}
- H04N 1/3878: {Skew detection or correction}
- H04N 1/4092: {Edge or detail enhancement}
- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/635: {Region indicators; Field of view indicators}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 23/68: for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N 25/61: the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- G06T 2207/30176: Document
- G06V 10/247: {by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids}
- H04N 2201/0094: Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A mobile terminal apparatus includes a geometrical arrangement detecting section (111) detecting groups of edge pixels arranged in a shape of a line segment in an image captured by an image-capturing apparatus; and a display processing section (112) causes a contour line representative of a contour of a rectangular captured object to be displayed on the captured image displayed on a display section so that the contour line is superimposed on the groups of edge pixels detected by the geometrical arrangement detecting section (111).

## Claims

### Claim 1

An image processing apparatus, comprising:
a display that displays a captured image in which an object is captured, the object being a quadrangle;
the captured image in which the object is continuously captured is displayed on the display; and
a display processor that causes the display to display a correction-processed image in which an area of the object in the captured image is geometrically corrected to a predetermined quadrangle in a state where the captured image in which the object is continuously captured is being displayed; wherein
the captured image and the correction-processed image are displayed within the same screen.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, further comprising a detector that detects groups of edge pixels each having a shape of a line segment, wherein
the display processor displays a quadrangular contour line which indicates a contour of the object, and the quadrangular contour line is formed by straight lines corresponding to respective four line segments represented by four of the groups of edge pixels detected by the detector while being overlapped with the captured image on the groups of edge pixels detected by the detector.

### Claim 3 (depends on 2)

The image processing apparatus according to claim 2, wherein the display processor receives an instruction to edit coordinates of vertexes of the contour line, and generates the correction-processed image based on an image of an area surrounded by the contour line which connects the coordinates of vertexes having been edited.

### Claim 4 (depends on 2)

The image processing apparatus according to claim 2, further comprising a switch that switches whether or not the contour line is displayed by the display processor.

### Claim 5 (depends on 4)

The image processing apparatus according to claim 4, wherein the display processor displays the correction-processed image having been geometrically corrected when the switch sets not to display the contour line.

### Claim 6

An image processing method in an image processing apparatus including a display that displays a captured image in which an object that is a quadrangle is captured, the method comprising steps of:
(a) displaying on the display the captured image in which the object is continuously captured; and
(b) displaying on the display a correction-processed image in which an area of the object in the captured image is geometrically corrected to a predetermined quadrangle in a state where the captured image in which the object is continuously captured is being displayed; wherein
the captured image and the correction-processed image are displayed within the same screen in step (b).

### Claim 7 (depends on 6)

The image processing method according to claim 6, further comprising a step of (c) detecting groups of edge pixels each having a shape of a line segment, wherein
the step (b) displays a quadrangular contour line which indicates a contour of the object, and the quadrangular contour line is formed by straight lines corresponding to respective four line segments represented by four groups of edge pixels detected in the step (c) while being overlapped with the captured image on the groups of edge pixels detected in the step (c).

### Claim 8 (depends on 7)

The image processing method according to claim 7, wherein the step (b) includes receiving an instruction to edit coordinates of vertexes of the contour line, and generating the correction-processed image based on an image of an area surrounded by the contour line which connects the coordinates of vertexes having been edited.

### Claim 9 (depends on 6)

The image processing method according to claim 6, further comprising a step of (c) switching whether or not the contour line is displayed in the step (b).

### Claim 10 (depends on 9)

The image processing method according to claim 9, wherein the step (b) includes displaying the correction-processed image having been geometrically corrected when the contour line is set not to be displayed in the step (c).