# US 2004/0080640 A1 · Method a system for improving resolution in color image data generated by a color image sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0080640 A1
- Document ID: US20040080640A1
- Status: Published application
- Kind: A1
- Application number: 10/630,824
- Filed: 2003-07-30
- Published: 2004-04-29
- Earliest claimed: 1997-01-08
- Assignees: Ricoh Company, Ltd.
- Inventors: Shin Aoki; Haike Guan
- Web page: https://patentgrep.com/patent/US20040080640A1

## CPC

- G06T 3/4007: based on interpolation, e.g. bilinear interpolation (image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403)
- H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values}
- H04N 25/134: {based on three different wavelength filter elements}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An intensity value is independently estimated based upon interpolated values as well as measured sensor values according to the location of an individual sensor within a sensor unit. The interpolated values are in either CrCb or RGB values while an estimated intensity value is in Y value. The independent intensity value substantially improves color resolution.

## Claims

### Claim 1

A method of improving color image data, comprising the steps of:
a) placing over a unit area a predetermined pattern of color-component specific filter elements on a single plane in a sensor, each of the color-component specific filter elements filtering a predetermined color-component over one of sub-unit areas in the unit area;
b) sampling color image data for the unit area using the color-component specific filter elements, a portion of the color image data being sampled only through a corresponding one of the color-component specific filter elements for a corresponding one of the sub-unit areas;
c) generating chroma values for each of the color-component specific elements from the-color image data;
d) adjusting the chroma values according to the specific pattern of the color-component specific elements; and
e) estimating an intensity value based upon the chroma values adjusted in said step d) and the color image data from said step b).

### Claim 2 (depends on 1)

The method of improving color image data according to claim 1 further comprising the additional steps of:
f) further adjusting the chroma values for an improved color characteristic between said step d) and said step e).
g) adjusting the intensity value for an improved edge characteristic after said step e); and
h) generating RGB data based upon the chroma values adjusted in said step f) and the intensity value adjusted in said step g).

### Claim 3 (depends on 2)

The method of improving color image data according to claim 2 further comprising an additional step i) of gamma converting the RGB data after said step h).

### Claim 4 (depends on 1)

The method of improving color image data according to claim 1 wherein the color image data is in a RGB data format in said step a).

### Claim 5 (depends on 4)

The method of improving color image data according to claim 4 wherein said step a) uses a first predetermined matrix for converting the color image data to the RGB data format.

### Claim 6 (depends on 5)

The method of improving color image data according to claim 5 further comprising an additional step j) of gamma converting the RGB data.

### Claim 7 (depends on 5)

The method of improving color image data according to claim 5 wherein said step d) uses a second predetermined matrix for converting the RGB data to the chroma values.

### Claim 8 (depends on 7)

The method of improving color image data according to claim 7 wherein said first matrix and said second matrix are combined into a third matrix to be applicable in an additional step for replacing said step a), said step b) and said step c).

### Claim 9 (depends on 1)

The method of improving color image data according to claim 1 wherein said step d) adjust the chroma values based upon a predetermined filter.

### Claim 10 (depends on 7)

The method of improving color image data according to claim 7 wherein the intensity in said step e) has a range equal to all of the color-component specific photo elements in the sensor.

### Claim 11 (depends on 10)

The method of improving color image data according to claim 10 wherein the intensity in said step e) is determined based upon following equations:
Y=Y0CCD1+Y1Cr+Y2Cb Y0=−CG/C Y1=(R1CG−G1CR)/C Y2=(B1CG−G1CR)/C C=−G1+G1CR−R1CG−B1CG+G1CB
where Y is intensity of one of the color-component specific elements; CCD1 is a color image data value from a predetermined photo sensor element; Cr and Cb are the chroma values; R1, G1 and B1 are a portion of the first matrix; CR, CB and CG are predetermined constants.

### Claim 12

A system for improving color image data, comprising:
a single-plane color image sensor having a predetermined spatial pattern of color-component specific photo elements on a single plane for generating color image data, each of the color-component specific filter elements filtering a predetermined color-component over one of sub-unit areas in a unit area, said single-plane color image sensor sampling the color image data for the unit area using the color-component specific filter elements, a portion of the color image data being sampled only through a corresponding one of the color-component specific filter elements for a corresponding one of the sub-unit areas;
an interpolated chroma value generator connected to said single-plane color image sensor for generating interpolated chroma values according to the spatial pattern; and
an intensity estimator connected to said interpolated chroma value generator and said single-plane color image sensor for estimating an intensity value based upon the interpolated chroma values and the color image data.

### Claim 13 (depends on 12)

The system for improving color image data according to claim 12 wherein said interpolated chroma value generator further comprises a color-component specific spatial filter for interpolating the color image data and a convertor for converting the color image to the chroma values.

### Claim 14 (depends on 12)

The system for improving color image data according to claim 12 further comprising a smoothing filter connected between said interpolated chroma value generator and said intensity estimator for reducing an error amount in the color image data.

### Claim 15 (depends on 14)

The system for improving color image data according to claim 14 further comprising an edge enhancement filter connected to said intensity estimator for enhancing an edge.

### Claim 16 (depends on 15)

The system for improving color image data according to claim 15 further comprising a RGB converter connected to said smoothing filter and said edge enhancement filter for generating a set of RGB data.

### Claim 17 (depends on 12)

The system for improving color image data according to claim 12 wherein said single-plane color image sensor is one dimensional.

### Claim 18 (depends on 12)

The system for improving color image data according to claim 12 wherein said single-plane color image sensor is two-dimensional.

### Claim 19 (depends on 18)

The system for improving color image data according to claim 18 wherein said single-plane color image sensor is at least three by three of said color-component specific photo elements.

### Claim 20 (depends on 14)

The system for improving color image data according to claim 14 wherein said smoothing filter is a median filter for outputting a median value.

### Claim 21 (depends on 14)

The system for improving color image data according to claim 14 wherein said smoothing filter is a low-pass filter for outputting a median value.

### Claim 22 (depends on 12)

The system for improving color image data according to claim 12 wherein said intensity estimator estimates the intensity value in a range equal to all of the color-component specific photo elements in said single-plane color image sensor.

### Claim 23 (depends on 22)

The system for improving color image data according to claim 22 wherein said intensity estimator estimates the intensity value based upon following equations:
Y=Y0CCD1+Y1Cr+Y2Cb Y0=−CG/C Y1=(R1CG−G1CR)/C Y2=(B1CG−G1CR)/C C=−G1+G1CR−R1CG−B1CG+G1CB
where Y is intensity of one of the color-component specific elements; CCD1 is a color image data value from a predetermined photo sensor element; Cr and Cb are the chroma values; R1, G1 and B1 are a portion of the first matrix; CR, CB and CG are predetermined constants.

### Claim 24 (depends on 12)

The system for improving resolution in color image data according to claim 12 further comprising a parameter storage for storing multiple sets of parameters and a control unit connected to said parameter storage and said intensity estimator for selecting one of the sets of the parameters based upon a particular location in the spatial pattern.

### Claim 25

A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps of reproducing a high-resolution image, said method steps comprising:
k) placing over a unit area a predetermined pattern of color-component specific filter elements on a single plane in a sensor, each of the color-component specific filter elements filtering a predetermined color-component over one of sub-unit areas in the unit area;
l) sampling color image data for the unit area using the color-component specific filter elements, a portion of the color image data being sampled only through a corresponding one of the color-component specific filter elements for a corresponding one of the sub-unit areas;
m) generating chroma values for each of the color-component specific elements from the color image data;
n) adjusting the chroma values according to the specific pattern of the color-component specific elements;
o) further adjusting the chroma values for smoothing the chroma values adjusted in said step l);
p) estimating an intensity value based upon the chroma values twice adjusted in said steps l) and m) and the color image data from said step k);
q) adjusting the intensity value for an improved edge characteristic after said step o); and
r) generating RGB data based upon the chroma values adjusted in said step n) and the intensity value adjusted in said step p).
