# US 2024/0187734 A1 · Method and apparatus for correcting blur in all or part of an image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0187734 A1
- Document ID: US20240187734A1
- Status: Published application
- Kind: A1
- Application number: 18/438,928
- Filed: 2024-02-12
- Published: 2024-06-06
- Earliest claimed: 2004-03-25
- Assignees: Clear Imaging Research, LLC
- Inventors: Fatih M. Ozluturk
- Web page: https://patentgrep.com/patent/US20240187734A1

## CPC

- H04N 23/687: {by shifting the lens or sensor position}
- G02B 27/646: {compensating for small deviations, e.g. due to vibration or shake (movement of one or more optical elements for control of motion blur in cameras, projectors or printers G03B2205/0007; image stabilisation in cameras peculiar to the presence or use of an electronic image sensor H04N23/68)}
- G06T 5/70: Denoising; Smoothing
- G06T 5/73: Deblurring; Sharpening
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- H04N 5/265: Mixing
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/68: for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N 23/681: {Motion detection}
- H04N 23/6811: {based on the image signal}
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 25/615: involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF]
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20024: Filtering details
- G06T 2207/20201: Motion blur correction
- G06T 2207/20212: Image combination
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method, apparatus, and processor for capturing digital images. The method comprising: displaying a preview scene to be captured in a user interface of the imaging device, capturing a plurality of images using a lens having one or more lens elements and at least one moveable lens element, and moving the moveable lens element electro-mechanically to counter an effect of motion. The method further including processing the plurality of images, receiving and executing instructions stored in a memory of the imaging device, to obtain a corrected image, such that the corrected image includes a first and second subject, the first subject in the corrected image is blur free, and the second subject in the corrected image is blurred compared to the first subject, storing the corrected image in the memory, and displaying the corrected image in the user interface.

## Claims

### Claim 1

A method for use in an imaging device for capturing digital images, the method comprising:
displaying a preview of a scene to be captured in a user interface of the imaging device;
capturing a plurality of images using a lens having one or more lens elements and at least one moveable lens element movable relative to the imaging device, wherein the plurality of images include a first subject and a second subject;
moving the at least one moveable lens element of the lens electro-mechanically to counter an effect of motion of the imaging device;
processing the plurality of images by a processor of the imaging device, the processor receiving and executing instructions stored in a memory of the imaging device, to obtain a corrected image, such that
the corrected image includes the first subject and the second subject, the first subject in the corrected image is blur free, and the second subject in the corrected image is blurred compared to the first subject;
storing the corrected image in the memory of the imaging device; and
displaying the corrected image in the user interface of the imaging device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the method further comprises:
displaying the corrected image in the user interface;
receiving a user input in the user interface, wherein the user input selects the second subject in the corrected image;
processing the plurality of images by the processor to obtain a second corrected image, such that the second corrected image includes the first subject and the second subject, the second subject in the second corrected image is blur free, and the first subject in the second corrected image is blurred compared to the second subject;
storing the second corrected image in the memory; and
displaying the second corrected image in the user interface.

### Claim 3 (depends on 1)

The method of claim 1, wherein the imaging device receives a user input in the user interface of the imaging device and the user input designates the first subject to be blur free in the corrected image.

### Claim 4 (depends on 1)

The method of claim 1, wherein the processor designates the first subject to be blur free in the corrected image.

### Claim 5 (depends on 1)

The method of claim 1, wherein the processing of the images includes calculating by the processor a pixel value for each pixel representing an image point of the first subject in the corrected image based on values of the pixels representing the image point of the first subject in one or more of the plurality of images.

### Claim 6 (depends on 1)

The method of claim 1, wherein areas of the corrected image other than the first subject are blurred compared to areas other than the first subject in the plurality of images being processed.

### Claim 7 (depends on 1)

The method of claim 1, wherein processing the plurality of images comprises modifying one or more of the plurality of images such that the first subject in the plurality of images is aligned in a same location in the corrected image.

### Claim 8

An imaging device for capturing digital images, comprising:
a user interface configured to display a preview of a scene to be captured;
at least one image sensor for capturing a plurality of images, wherein the plurality of images include a first subject and a second subject;
at least one lens optically connected to the at least one image sensor, wherein the lens includes one or more lens elements, at least one of the lens elements electro-mechanically movable relative to the imaging device;
a memory configured to store instructions for execution by a processor;
the processor, wherein the processor is connected to the memory for receiving instructions stored therein, and executing the instructions by the processor causes the processor to correct the plurality of images to obtain a corrected image, such that the corrected image includes the first subject and the second subject, the first subject in the corrected image is blur free and the second subject in the corrected image is blurred compared to the first subject;
the memory further configured to store the corrected image; and
the user interface further configured to display the corrected image.

### Claim 9 (depends on 8)

The imaging device of claim 8, wherein:
the user interface is further configured to display the corrected image and to receive a user input, wherein the user input selects the second subject in the corrected image;
the instructions, when executed by the processor further cause the processor to process the plurality of images to obtain a second corrected image, such that the second corrected image includes the first subject and the second subject, the second subject in the second corrected image is blur free, and the first subject in the second corrected image is blurred compared to the second subject;
the memory is further configured to store the second corrected image; and
the user interface is further configured to display the second corrected image.

### Claim 10 (depends on 8)

The imaging device of claim 8, wherein executing the instructions by the processor further causes the processor to calculate a pixel value for each pixel representing an image point of the first subject in the corrected image based on values of the pixels representing the image point of the first subject in the one or more of the plurality of images.

### Claim 11 (depends on 8)

The imaging device of claim 8, wherein the user interface is further configured to receive a user input and the user input designates the first subject to be blur free in the corrected image.

### Claim 12 (depends on 8)

The imaging device of claim 8, wherein executing the instructions by the processor further causes the processor to designate the first subject to be blur free in the corrected image.

### Claim 13 (depends on 8)

The imaging device of claim 8, wherein executing the instructions by the processor further causes the processor to process the plurality of images to obtain the corrected image such that areas of the corrected image other than the first subject are blurred compared to areas other than the first subject in the plurality of images being processed.

### Claim 14 (depends on 8)

The imaging device of claim 8, wherein executing the instructions by the processor further causes the processor to modify the plurality of images such that the first subject in the plurality of images is aligned in a same location in the corrected image.

### Claim 15

A processor for use in an imaging device, wherein the processor is connected to a memory of the imaging device, the memory holding instructions for execution by the processor, wherein receiving and executing the instructions by the processor causes the processor to:
move at least one movable lens element within a lens of the imaging device electro-mechanically to counter an effect of a motion of the imaging device, wherein the lens includes one or more lens elements and at least one of the lens elements is movable relative to the imaging device;
receive a plurality of images captured by at least one image sensor and the lens of the imaging device, wherein the plurality of images include a first subject and a second subject;
process the plurality of images to obtain a corrected image, such that the corrected image includes the first subject and the second subject, the first subject in the corrected image is blur free and the second subject in the corrected image is blurred compared to the first subject;
store the corrected image in the memory of the imaging device; and
display the corrected image in user interface of the imaging device.

### Claim 16 (depends on 15)

The processor of claim 15, wherein executing the instructions by the processor further causes the processor to:
display the corrected image in the user interface of the imaging device and receive a user input via the user interface, wherein the user input selects the second subject in the corrected image;
correct the plurality of images to obtain a second corrected image, such that the second corrected image includes the first subject and the second subject, the second subject in the second corrected image is blur free, and the first subject in the second corrected image is blurred compared to the second subject;
store the second corrected image in the memory of the imaging device; and
display the second corrected image in the user interface of the imaging device.

### Claim 17 (depends on 15)

The processor of claim 15, wherein executing the instructions by the processor further causes the processor to calculate a pixel value for each pixel representing an image point of the first subject in the corrected image based on values of the pixels representing the image point of the first subject in the one or more of the plurality of images.

### Claim 18 (depends on 15)

The processor of claim 15, wherein executing the instructions by the processor further causes the processor to receive a user input via the user interface of the imaging device and the user input designates the first subject to be blur free in the corrected image.

### Claim 19 (depends on 15)

The processor of claim 15, wherein executing the instructions by the processor further causes the processor to process the plurality of images to obtain the corrected image such that areas of the corrected image other than the first subject are blurred compared to areas other than the first subject in the plurality of images being processed.

### Claim 20 (depends on 15)

The processor of claim 15, wherein executing the instructions by the processor further causes the processor to modify the plurality of images such that the first subject in the plurality of images is aligned in a same location in the corrected image.
