# US 2013/0155281 A1 · Method and apparatus for robust image processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0155281 A1
- Document ID: US20130155281A1
- Status: Published application
- Kind: A1
- Application number: 13/562,806
- Filed: 2012-07-31
- Published: 2013-06-20
- Earliest claimed: 2007-06-28
- Assignees: Motorola Mobility LLC
- Inventors: Carl L. Shurboff; Fan He; Joy Xiong
- Web page: https://patentgrep.com/patent/US20130155281A1

## CPC

- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/18: the unit being a set of transform coefficients
- H04N 19/48: using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data (motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513)
- H04N 19/60: using transform coding
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N 25/61: the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- H04N 1/00307: {with a mobile telephone apparatus (constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method is provided for taking a digital picture of an image. The method can include: recording a first plurality of pixel values representing the image; generating a first compressed image data file based on the first plurality of pixel values; recording a second plurality of pixel values representing the image; generating a second compressed image data file based on the first plurality of pixel values; and processing the first and second plurality of pixel values in a compressed domain to generate a third plurality of pixel values, wherein processing includes combining the first and second compressed image data files by replacing portions of the second compressed image data file with corresponding portions of the first compressed image data file.

## Claims

### Claim 1

A method for taking a digital picture of an image, the method comprising the steps of:
recording a first plurality of pixel values representing the image;
generating a first compressed image data file based on the first plurality of pixel values;
recording a second plurality of pixel values representing the image;
generating a second compressed image data file based on the first plurality of pixel values; and
processing the first and second plurality of pixel values in a compressed domain to generate a third plurality of pixel values, wherein processing includes combining the first and second compressed image data files by replacing portions of the second compressed image data file with corresponding portions of the first compressed image data file.

### Claim 2 (depends on 1)

The method in accordance with claim 1 wherein the step of recording the first plurality of pixel values comprises the steps of:
measuring a light condition for a center portion of the image; and
recording the first plurality of pixel values in accordance with optimized recording for the light condition for the center portion of the image, and
wherein the step of recording the second plurality of pixel values comprises the steps of:
measuring a light condition for a portion of the image other than the center portion; and
recording the second plurality of pixel values in accordance with optimized recording for the light condition of the portion of the image other than the center portion.

### Claim 3 (depends on 2)

The method in accordance with claim 2 wherein the step of recording the first plurality of pixel values in accordance with optimized recording for the light condition for the center portion of the image comprises the step of recording the first plurality of pixel values for a first predetermined exposure time, and wherein the step of recording the second plurality of pixel values in accordance with optimized recording for the light condition of a portion of the image other than the center portion comprises the step of recording the second plurality of pixel values for a second predetermined exposure time, wherein the first predetermined exposure time is defined to optimize bright light conditions at the center portion, and wherein the second predetermined exposure time is defined to maximize a dynamic range of the image.

### Claim 4 (depends on 1)

The method in accordance with claim 1 wherein the step of processing the first and second plurality of pixel values to generate a third plurality of pixel values comprises the steps of:
determining a center image boundary in response to the first and second plurality of pixel values; and
generating the third plurality of pixel values in the compressed domain in response to the first plurality of pixel values, the second plurality of pixel values and the center image boundary.

### Claim 12

A digital camera module comprising:
a plurality of light sensitive pixel elements;
a first memory buffer;
a second memory buffer; and
a controller coupled to the plurality of light sensitive pixel elements and the first and second memory buffers, the controller recording a first plurality of pixel values representing an image by activating the plurality of light sensitive pixel elements in a first predetermined manner and storing the first plurality of pixel values in the first buffer, the controller generating a first compressed image data file based on the first plurality of pixel values, the controller recording a second plurality of pixel values representing the image by activating the plurality of light sensitive pixel elements in a second predetermined manner and storing the second plurality of pixel values in the second buffer, and the controller generating a second compressed image data file based on the first plurality of pixel values, wherein the controller processes the first and second plurality of pixel values in a compressed domain to generate a third plurality of pixel values, wherein processing includes combining the first and second compressed image data files by replacing portions of the second compressed image data file with corresponding portions of the first compressed image data file.

### Claim 13 (depends on 12)

The digital camera module in accordance with claim 12 wherein the controller activates the plurality of light sensitive pixel elements in the first predetermined manner by measuring a light condition for a center portion of the image and activating the plurality of light sensitive pixel elements for optimized recording for the light condition measured for the center portion of the image.

### Claim 14 (depends on 13)

The digital camera module in accordance with claim 13 wherein the controller activates the plurality of light sensitive pixel elements in the second predetermined manner by measuring a light condition for a portion of the image other than the center portion and activating the plurality of light sensitive pixel elements for optimized recording for the light condition measured for the portion of the image other than the center portion.

### Claim 15 (depends on 14)

The digital camera module in accordance with claim 14 wherein the controller activates the plurality of light sensitive pixel elements for optimized recording for the light condition measured for the center portion of the image by providing a first timing signal to the plurality of light sensitive pixel elements for activation thereof for a first predetermined exposure time and activates the plurality of light sensitive pixel elements for optimized recording for the light condition measured for the portion of the image other than the center portion by providing a second timing signal to the plurality of light sensitive pixel elements for activation thereof for a second predetermined exposure time.

### Claim 16 (depends on 12)

The digital camera module in accordance with claim 12 further comprising a lens system for focusing light passing through the lens system onto the plurality of light sensitive pixel elements, wherein the plurality of light sensitive pixel elements are arranged in an array within a light path of light passing through the lens system.

### Claim 17 (depends on 12)

The digital camera module in accordance with claim 12 wherein the controller records the first plurality of pixel values in the compressed domain by activating the plurality of light sensitive pixel elements in the first predetermined manner to measure compressed image data for the plurality of light sensitive pixel elements to generate a first compressed image data file, the controller storing the first compressed image data file in the first buffer, and wherein the controller records the second plurality of pixel values in the compressed domain by activating the plurality of light sensitive pixel elements in the second predetermined manner to measure compressed image data for the plurality of light sensitive pixel elements to generate a second compressed image data file, the controller storing the second compressed image data file in the second buffer, and wherein the controller processes the first and second plurality of pixel values in the compressed domain to generate the third plurality of pixel values by processing the first and second compressed image data files to generate a third compressed image data file.

### Claim 18

A mobile communication device comprising:
a plurality of light sensitive pixel elements;
a first memory buffer;
a second memory buffer;
a controller coupled to the plurality of light sensitive pixel elements and the first and second memory buffers, the controller recording a first plurality of pixel values representing an image by activating the plurality of light sensitive pixel elements in a first predetermined manner and storing the first plurality of pixel values in the first buffer, the controller generating a first compressed image data file based on the first plurality of pixel values, the controller recording a second plurality of pixel values representing the image by activating the plurality of light sensitive pixel elements in a second predetermined manner and storing the second plurality of pixel values in the second buffer, and the controller generating a second compressed image data file based on the first plurality of pixel values, wherein the controller processes the first and second plurality of pixel values in a compressed domain to generate a third plurality of pixel values, wherein processing includes combining the first and second compressed image data files by replacing portions of the second compressed image data file with corresponding portions of the first compressed image data file;
a storage device coupled to the exposure controller for storing the digital image as image information;
a communication controller coupled to the storage device for selectively
retrieving the image information corresponding to the digital image; and
transmitting circuitry coupled to the communication controller for transmitting the digital image when the image information corresponding to the digital image is provided to the transmitting circuitry by the communication controller.

### Claim 19 (depends on 18)

The mobile communication device in accordance with claim 18 wherein the controller records the first plurality of pixel values in the compressed domain by activating the plurality of light sensitive pixel elements in the first predetermined manner to measure compressed image data for the plurality of light sensitive pixel elements to generate a first compressed image data file, the controller storing the first compressed image data file in the first buffer, and wherein the controller records the second plurality of pixel values in the compressed domain by activating the plurality of light sensitive pixel elements in the second predetermined manner to measure compressed image data for the plurality of light sensitive pixel elements to generate a second compressed image data file, the controller storing the second compressed image data file in the second buffer, and wherein the controller processes the first and second plurality of pixel values in the compressed domain to generate the third plurality of pixel values by processing the first and second compressed image data files to generate a third compressed image data file.

### Claim 20 (depends on 18)

The mobile communication device in accordance with claim 18 further comprising a lens system for focusing light passing through the lens system onto the plurality of light sensitive pixel elements, wherein the plurality of light sensitive pixel elements are arranged in an array within a light path of light passing through the lens system.
