# US 7,612,805 B2 · Digital imaging system and methods for selective image filtration

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 7,612,805 B2
- Document ID: US7612805B2
- Status: Granted
- Kind: B2
- Application number: 11/825,521
- Filed: 2007-07-06
- Published: 2008-07-24
- Granted: 2009-11-03
- Earliest claimed: 2006-07-11
- Inventors: Neal Solomon
- Web page: https://patentgrep.com/patent/US7612805B2

## CPC

- G02B 27/0025: {for optical correction, e.g. distorsion, aberration}
- G06T 7/194: involving foreground-background segmentation
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- H04N 23/67: Focus control based on electronic image sensor signals
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/73: by influencing the exposure time
- H04N 23/75: by influencing optical camera components
- H04N 23/76: by influencing the image signals
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- H04N 23/811: {by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor}
- H04N 23/959: by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
- H04N 25/585: with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes
- H04N 25/61: the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- H04N 25/615: involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF]
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system is disclosed for the automated correction of optical and digital aberrations in a digital imaging system. The system includes digital filtration and digital system corrections to optical and digital aberrations. The system addresses issues in still and video photography that are presented in the digital imaging environment.

## Claims

### Claim 1

A digital imaging system for image filtration comprising:
a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the optical lens mechanism is a fixed focal length;
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and the digital signal processor;
wherein the microprocessor is used to provide digital and optical data to the digital signal processor;
wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;
wherein the system software forwards the data from the digital sensor to the digital processor;
wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;
wherein the data are forwarded from the digital sensor to the digital signal processor by an application specific integrated circuit;
wherein the digital signal processor applies a fast Fourier transform to a data file in order to satisfy a user specified special effects function;
wherein the digital signal processor modifies the data file by applying the special effects function; and
wherein the modified data file consisting of the digital data optimized from the aberrations that are corrected from the original optical image is stored in memory.

### Claim 2 (depends on 1)

The system of claim 1:
wherein the special effects function is a color enhancing function.

### Claim 3 (depends on 1)

The system of claim 1:
wherein the special effects function is a diffusion function of soft effect.

### Claim 4

A digital imaging system for image filtration comprising:
a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the optical lens mechanism is a fixed focal length;
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor;
wherein the microprocessor is used to provide digital and optical data to the digital signal processor;
wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;
wherein the system software forwards the data from the digital sensor to the digital processor;
wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;
wherein the data are forwarded from the digital sensor to the digital signal processor:
wherein a data file is analyzed by the microprocessor to separate specific objects in the image using the differentiation of the depth-of-field;
wherein the digital signal processor applies filtration only to specific objects in the image;
wherein the aberrations of the specific objects are corrected; and
wherein the digital signal processor forwards the modified date file to storage in memory.

### Claim 5 (depends on 4)

The system of claim 4:
wherein the subject is isolated by focusing on the subject and narrowing the depth of field range by manipulating the aperture.

### Claim 6 (depends on 4)

The system of claim 4:
wherein filtration is applied only to the background of an image exclusive of specific selected objects.

### Claim 7 (depends on 4)

The system of claim 4:
wherein specific color filtration is applied to objects.

### Claim 8 (depends on 4)

The system of claim 4:
wherein specific filtration applied to specific objects is soft effects.

### Claim 9

A digital imaging system for image filtration comprising:
a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and the digital signal processor;
wherein the microprocessor is used to provide digital and optical data to the digital signal processor;
wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;
wherein the system software forwards the data from the digital sensor to the digital processor;
wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;
wherein the lens type is a zoom lens;
wherein the lens focal length alternates from specific fixed focal length lens settings in a succession of steps;
wherein optical aberrations are corrected with digital filtration to modify multiple images from different focal lengths in a succession of data files; and
wherein the modified data file consisting of the digital data optimized from the aberrations that are corrected from the original optical image is stored in memory.

### Claim 10 (depends on 9)

The system of claim 9:
wherein as the zoom lens changes focal length positions, the system anticipates the direction of zoom lens changes to accelerate the filtration modifications.

### Claim 11

A digital imaging system for image filtration comprising:
a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system:
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and the digital signal processor;
wherein the microprocessor is used to provide digital and optical data to the digital signal processor;
wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;
wherein the system software forwards the data from the digital sensor to the digital processor:
wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;
wherein the system uses a video camera to capture moving objects;
wherein the type of filtration applied by the digital signal processor is applied to specific moving objects;
wherein the digital image that is captured is forwarded from the digital sensor to the digital signal processer:
wherein a data file is analyzed by the microprocessor to separate specific objects in the image using the temporal differentiation of caching in which successive images share geometric elements;
wherein the digital signal processor applies filtration only to a specific continuous object that is isolated and is in motion; and
wherein the digital signal processor forwards the modified data file to be stored in memory.

### Claim 12 (depends on 11)

The system of claim 11:
wherein a specific continuous object is selectively filtered with soft effects.

### Claim 13 (depends on 11)

The system of claim 11:
wherein the background of the image is filtered independently of the moving objects.

### Claim 14 (depends on 11)

The system of claim 11:
wherein multiple moving objects arc tracked and differentiation between objects is made by changing the depth of field of the objects.

### Claim 15

A digital imaging system for image filtration comprising:
a digital camera mechanism, an optical lens mechanism, digital sensors, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor;
wherein the microprocessor is used to provide digital and optical data to the digital signal processor;
wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;
wherein the system software forwards the data from the digital sensor to the digital processor;
wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;
wherein a network of digital imaging sensors is linked together in a fixed structure;
wherein the network is coordinated to track specific objects that are within its collective field of vision;
wherein the network captures images of objects using the digital imaging sensors:
wherein the individual digital imaging sensors forward the imaging data to a central digital signal processor:
wherein the digital signal processor selects a specific procedure to optimize the imaging data and corrects the aberrations:
wherein a data file is analyzed by the microprocessor to separate specific objects in the image using the temporal differentiation of caching in which successive images share geometric elements:
wherein the digital signal processor applies filtration only to specific continuous objects that are isolated and are in motion; and
wherein the modified data file consisting of the data optimized from the aberrations that are corrected from the original optical image is stored in memory.

### Claim 16 (depends on 15)

The system of claim 15:
wherein as an object moves through the sensor network, the system sensors are coordinated to hand off the object to other sensors on the grid.

### Claim 17 (depends on 15)

The system of claim 15:
wherein the background of the image in the sensor network is selectively filtered.

### Claim 18

A method of image filtration which comprises:
a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and the digital signal processor, the method consisting of;
forwarding the data from a digital sensor to a digital signal processor by an application specific integrated circuit;
providing digital and optical data to the digital signal processor;
identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations:
selecting a specific procedure from the database using the microprocessor to optimize the image and correct the aberrations:
applying digital filtration by using the application specific integrated circuit and digital signal processor to correct digital or optical aberrations:
applying a fast Fourier transform to a data file in order to satisfy a user specified special effects function;
modifying the data file by applying the special effects function using the digital signal processor; and
storing the data file in memory.

### Claim 19 (depends on 18)

The method of claim 18 further comprising the step of:
applying the special effects function as a color enhancing function.

### Claim 20 (depends on 18)

The method of claim 18 further comprising the step of:
applying the special effects function as a diffusion function of soft effect.

### Claim 21

A method of image filtration which comprises:
a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor, the method consisting of;
forwarding the data from a digital sensor to a digital signal processor;
analyzing a data file by the microprocessor to separate specific objects it the image using the differentiation of the depth-of-field:
providing digital and optical data to the digital signal processor;
identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations;
selecting a specific procedure from the database using the microprocessor to optimize the image and correct the aberrations;
applying digital filtration by using the application specific integrated circuit and digital signal processor to correct digital or optical aberrations:
correcting the aberrations of the specific objects in the image by applying the digital signal processor filtration; and
forwarding the modified data file from the digital signal process to storage in memory.

### Claim 22

The method of clam 21 further comprising the step of:
applying specific color filtration to objects.

### Claim 23 (depends on 21)

The method of claim 21 further comprising the step of:
applying soft effects filtration to specific objects.

### Claim 24

A method of image filtration comprising:
a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor, the method consisting of;
alternating the lens focal length of a zoom lens from specific fixed focal length lens settings in a succession of steps;
creating data files corresponding to each focal length lens setting;
forwarding the data from a digital sensor to the digital signal processor;
providing digital and optical data to a digital signal processor;
identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations;
selecting a specific procedure from the database using the microprocessor to optimize the image and correct the aberrations;
applying digital filtration by using the application specific integrated circuit and digital signal processor to correct digital or optical aberrations;
correcting optical aberrations with digital filtration to modify multiple images from different focal lengths in a succession of data files; and
storing the modified data files in memory.

### Claim 25 (depends on 24)

The method of claim 24 further comprising:
wherein as the zoom lens changes focal length positions, anticipating the direction of zoom lens changes to accelerate the filtration modifications.

### Claim 26

A method for image filtration comprising:
digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor, the method consisting of;
capturing moving objects using a video camera;
forwarding the data that are captured from the digital sensor to a digital signal processor;
providing digital and optical data to a digital signal processor;
identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations:
selecting a specific procedure from the database using the microprocessor to optimize the image and correct the aberrations;
analyzing a data file by the microprocessor to separate specific objects in the image;
using the temporal differentiation of caching in which successive images share geometric elements;
applying filtration only to a specific continuous object that is isolated and is in motion by using the digital signal processor;
correcting optical aberrations with digital filtration; and
storing the modified data file in memory by forwarding the data file from the digital signal processor.

### Claim 27 (depends on 26)

The method of claim 26 further comprising the step of:
filtering with soft effects a specific continuous object.

### Claim 28 (depends on 26)

The method of claim 26 further comprising the step of:
filtering the background of the image independently of the moving objects.

### Claim 29 (depends on 26)

The method of claim 26 further comprising:
tracking multiple moving objects; and
differentiating between objects by changing the depth of field of the objects.

### Claim 30

A method for image filtration comprising:
a digital camera mechanism, an optical lens mechanism, digital sensors, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;
wherein the aberrations from the optical system are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor, the method consisting of:
linking a network of digital imaging sensors together in a fixed structure;
coordinating the network to track specific objects that are within its collective field of vision;
capturing the network images of objects using the digital imaging sensors;
forwarding the imaging data from individual digital imaging sensors to a central digital signal processor;
analyzing the data in the images in the digital signal processor by using the microprocessor to separate specific images in the network;
providing digital and optical data to the digital signal processor;
identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations;
selecting a specific procedure to optimize the image and correct the aberrations;
applying digital filtration by using the application specific integrated circuit and digital signal processor to correct digital or optical aberrations;
modifying a data file by correcting optical aberrations with digital filtration;
analyzing the data file by using the microprocessor to separate specific objects in the image using the temporal differentiation of caching in which successive images share geometric elements;
applying filtration by the digital signal processor only to specific continuous objects that are isolated and are in motion; and
forwarding the consolidated data file to storage in memory.

### Claim 31 (depends on 30)

The method of claim 30 further comprising the step of:
coordinating the hand off of the object to other sensors on the grid as objects move through the sensor network.

### Claim 32 (depends on 30)

The method of claim 30 further comprising the step of:
filtering the background of the image in the sensor network by differentiating the objects.