# US 2006/0050956 A1 · Signal processing apparatus, signal processing method, and signal processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0050956 A1
- Document ID: US20060050956A1
- Status: Published application
- Kind: A1
- Application number: 11/220,699
- Filed: 2005-09-08
- Published: 2006-03-09
- Earliest claimed: 2004-09-09
- Assignees: Fuji Photo Film Co., Ltd.
- Inventors: Seiji Tanaka
- Web page: https://patentgrep.com/patent/US20060050956A1

## CPC

- H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values}
- H04N 25/134: {based on three different wavelength filter elements}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The object of the present invention is to provide a signal processing apparatus, a signal processing method, and a signal processing program that can suppress generation of spurious signals due to interpolation and to improve the diagonal resolution of an image generated by interpolation. According to the present invention, generation of spurious signals due to interpolation can be suppressed. Moreover, the diagonal resolution of an image generated through interpolation can be improved.

## Claims

### Claim 1

A signal processing apparatus which obtains a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing apparatus comprising:
a first correlation value calculating unit which calculates, from the values of color signals obtained from a plurality of pixels around the R-pixel location or the B-pixel location in a first direction and a plurality of pixels around the R-pixel location or the B-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
a second correlation value calculating unit which calculates a second correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R- or B-pixel location in a given two-dimensional range around the R- or B-pixel location;
an interpolation direction determining unit which determines, on the basis of the second correlation value, which of the first and second directions has a higher correlation; and
an interpolation unit which interpolates color signals obtained from the pixels located along the direction determined by the interpolation direction determining unit to calculate a G color signal at the R-pixel location or the B-pixel location.

### Claim 2

A signal processing apparatus which obtains a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing apparatus comprising:
a first correlation value calculating unit which calculates, from the values of color signals obtained from a plurality of pixels around the R-pixel location, the B-pixel location, and the G-pixel location in a first direction and a plurality of pixels around the R-pixel location or the B-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
a second correlation value calculating unit which calculates a second correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R-, B-, or G-pixel location in a given two-dimensional range around the R- or B-pixel location;
an interpolation direction determining unit which determines, on the basis of the second correlation value, which of the first and second directions has a higher correlation; and
an interpolation unit which interpolates color signals obtained from the pixels located along the direction determined by the interpolation direction determining unit to calculate a G color signal at the R-pixel location or the B-pixel location.

### Claim 3

A signal processing apparatus which obtains a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing apparatus comprising:
a first correlation value calculating unit which calculates, from the values of color signals obtained from a plurality of pixels around the R-pixel location or the B-pixel location in a first direction and a plurality of pixels around the R-pixel location or the B-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
a second correlation value calculating unit which calculates, from the values of color signals obtained from a plurality of pixels around the G-pixel location in a third direction different from the first and second directions and a plurality of pixels around the G-pixel location along a fourth direction different from the third direction, a second correlation value representing the degree of correlation along the third direction and along the fourth direction;
a third correlation value calculating unit which calculates a third correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R- or B-pixel location in a given two-dimensional range around the R- or B-pixel location;
a fourth correlation value calculating unit which calculates a fourth correlation value representing the degree of correlation along the third direction and along the fourth direction by applying two-dimensional filtering to the second correlation value calculated for each G-pixel location in a given two-dimensional range around the R- or B-pixel location;
an interpolation direction determining unit which determines, on the basis of the third and fourth correlation values, which of the first, second, third, and fourth directions has the highest correlation; and
an interpolation unit which calculates a G color signal at the R-pixels location or the B-pixel location by interpolating color signals obtained from the pixels located along the direction that is determined by the interpolation direction determining unit as having the highest correlation, or by performing weighted interpolation of color signals of pixels along the direction that has the highest correlation and color signals of pixels along another direction.

### Claim 4

A signal processing method for obtaining a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing method comprising the steps of:
calculating, from the values of color signals obtained from a plurality of pixels around the R-pixel location or the B-pixel location in a first direction and a plurality of pixels around the R-pixel location or the B-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
calculating a second correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R- or B-pixel location in a given two-dimensional range around the R- or B-pixel location;
determining, on the basis of the second correlation value, which of the first and second directions has a higher correlation; and
interpolating color signals obtained from the pixels located along the direction determined by the interpolation direction determining unit to calculate the G color signal at the R-pixel location or the B-pixel location.

### Claim 5

A signal processing method for obtaining a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing method comprising the steps of:
calculating, from the values of color signals obtained from a plurality of pixels around the R-pixel location, the B-pixel location, and the G-pixel location in a first direction and a plurality of pixels around the R-pixel location, the B-pixel location or the G-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
calculating a second correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R-, B-, or G-pixel location in a given two-dimensional range around the R- or B-pixel location;
determining, on the basis of the second correlation value, which of the first and second directions has a higher correlation; and
interpolating color signals obtained from the pixels located along the direction determined by the interpolation direction determining unit to calculate the G color signal at the R-pixel location or the B-pixel location.

### Claim 6

A signal processing method for obtaining a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing method comprising the steps of:
calculating, from the values of color signals obtained from a plurality of pixels around the R-pixel location or the B-pixel location in a first direction and a plurality of pixels around the R-pixel location or the B-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
calculating, from the values of color signals obtained from a plurality of pixels around the G-pixel location in a third direction different from the first and second directions and a plurality of pixels around the G-pixel location along a fourth direction different from the third direction, a second correlation value representing the degree of correlation along the third direction and along the fourth direction;
calculating a third correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R- or B-pixel location in a given two-dimensional range around the R- or B-pixel location;
calculating a fourth correlation value representing the degree of correlation along the third direction and along the fourth direction by applying two-dimensional filtering to the second correlation value calculated for each G-pixel location in a given two-dimensional range around the R- or B-pixel location;
determining, on the basis of the third and fourth correlation values, which of the first, second, third, and fourth directions has the highest correlation; and
calculating a G color signal at the R-pixels location or the B-pixel location by interpolating color signals obtained from the pixels located along the direction that is determined by the interpolation direction determining unit as having the highest correlation, or by performing weighted interpolation of color signals of pixels along the direction that has the highest correlation and color signals of pixels along another direction.

### Claim 7

A signal processing program for obtaining a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing program causing a computer to implement the functions of:
calculating, from the values of color signals obtained from a plurality of pixels around the R-pixel location or the B-pixel location in a first direction and a plurality of pixels around the R-pixel location or the B-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
calculating a second correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R- or B-pixel location in a given two-dimensional range around the R- or B-pixel location;
determining, on the basis of the second correlation value, which of the first and second directions has a higher correlation; and
interpolating color signals obtained from the pixels located along the direction determined by the interpolation direction determining unit to calculate the G color signal at the R-pixel location or the B-pixel location.

### Claim 8

A signal processing program for obtaining a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing program causing a computer to implement the functions of:
calculating, from the values of color signals obtained from a plurality of pixels around the R-pixel location, the B-pixel location, and the G-pixel location in a first direction and a plurality of pixels around the R-pixel location, the B-pixel location or the G-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
calculating a second correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R-, B-, or G-pixel location in a given two-dimensional range around the R- or B-pixel location;
determining, on the basis of the second correlation value, which of the first and second directions has a higher correlation; and
interpolating color signals obtained from the pixels located along the direction determined by the interpolation direction determining unit to calculate the G color signal at the R-pixel location or the B-pixel location.

### Claim 9

A signal processing program for obtaining a G color signal at R-pixel location and a B-pixel location on a solid-state image sensor having a color-filter array including at least red, green and blue by interpolating color signals from nearby pixels on the basis of color signals of a plurality of colors outputted from the solid-state image sensor, the signal processing program causing a computer to implement the functions of:
calculating, from the values of color signals obtained from a plurality of pixels around the R-pixel location or the B-pixel location in a first direction and a plurality of pixels around the R-pixel location or the B-pixel location along a second direction different from the first direction, a first correlation value representing the degree of correlation along the first direction and along the second direction different from the first direction;
calculating, from the values of color signals obtained from a plurality of pixels around the G-pixel location in a third direction different from the first and second directions and a plurality of pixels around the G-pixel location along a fourth direction different from the third direction, a second correlation value representing the degree of correlation along the third direction and along the fourth direction;
calculating a third correlation value representing the degree of correlation along the first direction and along the second direction by applying two-dimensional filtering to the first correlation value calculated for each R- or B-pixel location in a given two-dimensional range around the R- or B-pixel location;
calculating a fourth correlation value representing the degree of correlation along the third direction and along the fourth direction by applying two-dimensional filtering to the second correlation value calculated for each G-pixel location in a given two-dimensional range around the R- or B-pixel location;
determining, on the basis of the third and fourth correlation values, which of the first, second, third, and fourth directions has the highest correlation; and
calculating a G color signal at the R-pixels location or the B-pixel location by interpolating color signals obtained from the pixels located along the direction that is determined by the interpolation direction determining unit as having the highest correlation, or by performing weighted interpolation of color signals of pixels along the direction that has the highest correlation and color signals of pixels along another direction.
