# US 2012/0249841 A1 · Scene enhancements in off-center peripheral regions for nonlinear lens geometries

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249841 A1
- Document ID: US20120249841A1
- Status: Published application
- Kind: A1
- Application number: 13/077,891
- Filed: 2011-03-31
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: Tessera Technologies Ireland Limited
- Inventors: Peter Corcoran; Petronel Bigioi; Piotr Stec
- Web page: https://patentgrep.com/patent/US20120249841A1

## CPC

- G06T 3/047: Fisheye or wide-angle transformations
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A technique of enhancing a scene containing one or more off-center peripheral regions within an initial distorted image captured with a large field of view includes determining and extracting an off-center region of interest (hereinafter “ROI”) within the image. Geometric correction is applied to reconstruct the off-center ROI into a rectangular or otherwise undistorted or less distorted frame of reference as a reconstructed ROI. A quality of reconstructed pixels is determined within the constructed ROI. Image analysis is selectively applied to the reconstructed ROI based on the quality of the reconstructed pixels.

## Claims

### Claim 1

Within a digital image acquisition system comprising a non-linear, wide-angled lens and an imaging sensor, a method of enhancing a scene containing one or more off-center peripheral regions, the method comprising:
using a processor;
acquiring an initial distorted image with a large field of view, including using a non-linear, wide-angled lens and imaging sensor;
determining and extracting an off-center region of interest (hereinafter “ROI”) within said image;
applying geometric correction to reconstruct said off-center ROI into an approximately rectangular frame of reference as a reconstructed ROI;
determining a quality of reconstructed pixels within said reconstructed ROI; and
selectively applying image analysis to said reconstructed ROI based on the quality of the reconstructed pixels.

### Claim 2 (depends on 1)

A method as in claim 1, further comprising compensating for global motion of the image acquisition system.

### Claim 3 (depends on 1)

A method as in claim 1, further comprising repeating the method for a second distorted image, and generating a second reconstructed ROI of approximately a same portion of an image scene as the first reconstructed ROI.

### Claim 4 (depends on 3)

A method as in claim 3, further comprising, responsive to analysis of the first and second reconstructed ROIs, processing both the first and second reconstructed ROIs and generating, based on the processing, an enhanced output image of substantially the same portion of the image scene.

### Claim 5 (depends on 1)

A method as in claim 1, further comprising, based on said selectively applying image analysis, adjusting an image acquisition parameter and repeating the method for a second distorted image, and generating, based on the second distorted image, a second reconstructed ROI of approximately a same portion of an image scene as the first reconstructed ROI.

### Claim 6 (depends on 5)

A method as in claim 5, further comprising processing the first and second reconstructed ROIs of approximately the same portion of the image scene, and generating, based on the processing, an enhanced output image of substantially the same portion of the image scene.

### Claim 7 (depends on 1)

A method as in claim 1, responsive to said analysis and said pixel quality selectively applying image enhancement and generating an enhanced output image.

### Claim 8

A digital image acquisition device, comprising:
a non-linear, wide-angled lens and an imaging sensor configured to capture digital images of scenes containing one or more off-center peripheral regions, including an initial distorted image with a large field of view;
a processor;
a memory having code embedded therein for programming the processor to perform a method of enhancing a scene containing one or more off-center peripheral regions, wherein the method comprises:
determining and extracting an off-center region of interest (hereinafter “ROI”) within said image;
applying geometric correction to reconstruct said off-center ROI into an approximately rectangular frame of reference as a reconstructed ROI;
determining a quality of reconstructed pixels within said reconstructed ROI; and
selectively applying image analysis to said reconstructed ROI based on the quality of the reconstructed pixels.

### Claim 9 (depends on 8)

A device as in claim 8, wherein the method comprises compensating for global motion of the image acquisition system.

### Claim 10 (depends on 8)

A device as in claim 8, wherein the method comprises repeating the method for a second distorted image, and generating a second reconstructed ROI of approximately a same portion of an image scene as the first reconstructed ROI.

### Claim 11 (depends on 10)

A device as in claim 10, wherein the method comprises, responsive to analysis of the first and second reconstructed ROIs, processing both the first and second reconstructed ROIs and generating, based on the processing, an enhanced output image of substantially the same portion of the image scene.

### Claim 12 (depends on 8)

A device as in claim 8, wherein the method comprises, based on said selectively applying image analysis, adjusting an image acquisition parameter and repeating the method for a second distorted image, and generating, based on the second distorted image, a second reconstructed ROI of approximately a same portion of an image scene as the first reconstructed ROI.

### Claim 13 (depends on 12)

A device as in claim 12, wherein the method comprises processing the first and second reconstructed ROIs of approximately the same portion of the image scene, and generating, based on the processing, an enhanced output image of substantially the same portion of the image scene.

### Claim 14 (depends on 8)

A device as in claim 8, wherein the method comprises, responsive to said analysis and said pixel quality, selectively applying image enhancement and generating an enhanced output image.

### Claim 15

One or more non-transitory, processor-readable storage media having code embedded therein for programming a processor to perform a method of enhancing a scene captured with a non-linear, wide-angled lens and containing one or more off-center peripheral regions, wherein the method comprises:
determining and extracting an off-center region of interest (hereinafter “ROI”) within an initial distorted image captured with a large field of view;
applying geometric correction to reconstruct said off-center ROI into an approximately rectangular frame of reference as a reconstructed ROI;
determining a quality of reconstructed pixels within said reconstructed ROI; and
selectively applying image analysis to said reconstructed ROI based on the quality of the reconstructed pixels.

### Claim 16 (depends on 15)

One or more non-transitory, processor-readable storage media as in claim 15, wherein the method comprises compensating for global motion of the image acquisition system.

### Claim 17 (depends on 15)

One or more non-transitory, processor-readable storage media as in claim 15, wherein the method comprises repeating the method for a second distorted image, and generating a second reconstructed ROI of approximately a same portion of an image scene as the first reconstructed ROI.

### Claim 18 (depends on 17)

One or more non-transitory, processor-readable storage media as in claim 17, wherein the method comprises, responsive to analysis of the first and second reconstructed ROIs, processing both the first and second reconstructed ROIs and generating, based on the processing, an enhanced output image of substantially the same portion of the image scene.

### Claim 19 (depends on 15)

One or more non-transitory, processor-readable storage media as in claim 15, wherein the method comprises, based on said selectively applying image analysis, adjusting an image acquisition parameter and repeating the method for a second distorted image, and generating, based on the second distorted image, a second reconstructed ROI of approximately a same portion of an image scene as the first reconstructed ROI.

### Claim 20 (depends on 19)

One or more non-transitory, processor-readable storage media as in claim 19, wherein the method comprises processing the first and second reconstructed ROIs of approximately the same portion of the image scene, and generating, based on the processing, an enhanced output image of substantially the same portion of the image scene.

### Claim 21 (depends on 15)

One or more non-transitory, processor-readable storage media as in claim 15, wherein the method further comprises, responsive to said analysis and said pixel quality, selectively applying image enhancement and generating an enhanced output image.
