# US 2013/0258047 A1 · Moving object periphery image correction apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0258047 A1
- Document ID: US20130258047A1
- Status: Published application
- Kind: A1
- Application number: 13/990,944
- Filed: 2011-03-08
- Published: 2013-10-03
- Earliest claimed: 2011-03-08
- Assignees: Mitsubishi Electric Corporation
- Inventors: Takuji Morimoto; Tetsuji Haga
- Web page: https://patentgrep.com/patent/US20130258047A1

## CPC

- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- G06T 3/12: Panospheric to cylindrical image transformations
- G06T 5/80: Geometric correction
- G06T 7/13: Edge detection
- G06T 2207/30264: Parking
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A reference line detection unit 12 extracts an edge from a distorted image taken by a fisheye camera to thereby determine a curved reference line. A distortion parameter calculation unit 13 calculates a distortion parameter such that the reference line is made linear. A distortion correction unit 14 corrects distortion of the distorted image by a distortion correction equation by using the distortion parameter.

## Claims

### Claim at position 1

1-15. (canceled)

### Claim 16

A moving object periphery image correction apparatus comprising:
an image pickup unit for acquiring a periphery image from an imaging device that takes a periphery of a moving object;
a reference line detection unit for extracting an edge from the periphery image acquired by the image pickup unit, and determining a curved reference line from the said edge;
a distortion parameter calculation unit for calculating a distortion parameter for distortion correction of the periphery image such that the reference line determined by the reference line detection unit is made linear;
a distortion correction unit for correcting a distortion of the periphery image acquired by the image pickup unit with the use of the distortion parameter calculated by the distortion parameter calculation unit, and outputting the resultant as a periphery image to be displayed on a display unit; and
a topographical information acquiring unit for acquiring topographical information of the periphery of the moving object,
wherein the image pickup unit selectively acquires the periphery image from the imaging device by using the topographical information acquired by the topographical information acquiring unit.

### Claim 17

A moving object periphery image correction apparatus comprising:
an image pickup unit for acquiring a periphery image from an imaging device that takes a periphery of a moving object;
a reference line detection unit for extracting an edge from the periphery image acquired by the image pickup unit, and determining a curved reference line from the said edge;
a distortion parameter calculation unit for calculating a distortion parameter for distortion correction of the periphery image such that the reference line determined by the reference line detection unit is made linear;
a distortion correction unit for correcting a distortion of the periphery image acquired by the image pickup unit with the use of the distortion parameter calculated by the distortion parameter calculation unit, and outputting the resultant as a periphery image to be displayed on a display unit; and
a peripheral object detection unit for detecting an object existing in the periphery of the moving object,
wherein the image pickup unit selectively acquires the periphery image from the imaging device by using information related to the object detected by the peripheral object detection unit.

### Claim 18

A moving object periphery image correction apparatus comprising:
an image pickup unit for acquiring a periphery image from an imaging device that takes a periphery of a moving object;
a reference line detection unit for extracting an edge from the periphery image acquired by the image pickup unit, and determining a curved reference line from the said edge;
a distortion parameter calculation unit for calculating a distortion parameter for distortion correction of the periphery image such that the reference line determined by the reference line detection unit is made linear;
a distortion correction unit for correcting a distortion of the periphery image acquired by the image pickup unit with the use of the distortion parameter calculated by the distortion parameter calculation unit, and outputting the resultant as a periphery image to be displayed on a display unit; and
a reference line averaging unit for averaging a plurality of reference lines,
wherein the reference line detection unit detects the reference line from each of the plurality of periphery images acquired by the image pickup unit and outputs the resultant to the reference line averaging unit, and
the distortion parameter calculation unit calculates the distortion parameter such that the reference line averaged by the reference line averaging unit is made linear.

### Claim 19 (depends on 16)

The moving object periphery image correction apparatus of claim 16, further comprising an optimum distortion parameter calculation unit for calculating an optimum distortion parameter by using a plurality of distortion parameters in which the distortion parameter calculation unit calculates for each of a plurality of reference lines when the reference line detection unit detects the plurality of reference lines,
wherein the distortion correction unit corrects the distortion of the periphery image by using the optimum distortion parameter calculated by the optimum distortion parameter calculation unit.

### Claim 20 (depends on 19)

The moving object periphery image correction apparatus of claim 19, wherein the optimum distortion parameter calculation unit calculates an average of the plurality of distortion parameters to determine the resultant as the optimum distortion parameter.

### Claim 21 (depends on 19)

The moving object periphery image correction apparatus of claim 19, further comprising a distortion parameter evaluation unit for distortion-correcting each of reference images by using the plurality of distortion parameters in which the distortion parameter calculation unit calculates for each of the plurality of reference lines when the reference line detection unit detects the plurality of reference lines, and for calculating an evaluation value indicative of adequacy of the distortion correction on the basis of a result of the said correction,
wherein the optimum distortion parameter calculation unit calculates an optimum distortion parameter from among the plurality of distortion parameters calculated by the distortion parameter calculation unit based on the evaluation value calculated by the distortion parameter evaluation unit.

### Claim 22 (depends on 16)

The moving object periphery image correction apparatus of claim 16, further comprising a reference line selection unit for causing a user to select a desired reference line from among a plurality of reference lines detected by the reference line detection unit,
wherein the distortion parameter calculation unit calculates the distortion parameter by using the reference line in which the reference line selection unit receives from the user.

### Claim 23 (depends on 16)

The moving object periphery image correction apparatus of claim 16, further comprising a reference line drawing unit for receiving a reference line drawn by a user,
wherein the distortion parameter calculation unit calculates the distortion parameter by using the reference line in which the reference line drawing unit receives from the user.

### Claim 24 (depends on 16)

The moving object periphery image correction apparatus of claim 16, further comprising a characteristic object detection unit for detecting a given characteristic object from the periphery image, and a characteristic object selection unit for causing a user to select a desired characteristic object from among a plurality of characteristic objects detected by the characteristic object detection unit,
wherein the distortion correction unit performs centering and distortion correction of the periphery image such that the characteristic object in which the characteristic object selection unit receives from the user is displayed at the center of a screen of the display unit.

### Claim 25 (depends on 16)

The moving object periphery image correction apparatus of claim 16, further comprising a center position input unit for receiving from a user a position of the periphery image to be displayed at the center of a screen of the display unit,
wherein the distortion correction unit performs centering and distortion correction of the periphery image such that the position in which the center position input unit receives from the user is positioned at the center of the screen of the display unit.

### Claim 26 (depends on 16)

The moving object periphery image correction apparatus of claim 16, wherein the reference line detection unit detects the curved reference line that extends horizontally.

### Claim 27 (depends on 16)

The moving object periphery image correction apparatus of claim 16, wherein the imaging device is attachable and detachable to and from the moving object.

### Claim 28 (depends on 16)

The moving object periphery image correction apparatus of claim 16, wherein the imaging device is a wide-angle imaging device.

### Claim 29 (depends on 16)

The moving object periphery image correction apparatus of claim 16, wherein the moving object is a vehicle.
