# US 8,279,346 B2 · Frame rate converting apparatus and method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,279,346 B2
- Document ID: US8279346B2
- Status: Granted
- Kind: B2
- Application number: 12/499,518
- Filed: 2009-07-08
- Published: 2010-01-28
- Granted: 2012-10-02
- Earliest claimed: 2008-07-22
- Assignees: Canon Kabushiki Kaisha
- Inventors: Masaki Suzuki
- Web page: https://patentgrep.com/patent/US8279346B2

## CPC

- G06F 3/1415: {with means for detecting differences between the image stored in the host and the images displayed on the displays}
- H04N 7/0132: {the field or frame frequency of the incoming video signal being multiplied by a positive integer, e.g. for flicker reduction}
- G09G 2320/02: Improving the quality of display appearance
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2340/0435: Change or adaptation of the frame rate of the video stream
- G09G 2360/18: Use of a frame buffer in a display terminal, inclusive of the display panel
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

In an image processing apparatus, degradation of edges of stationary subjects can be suppressed in a moving image obtained by converting moving image data having F frames per unit time into moving image data having 2F sub frames per the unit time. For this purpose, pixel data is inputted in order of raster scanning into an input terminal. Then three contiguous pixel data X1 to X3 are obtained by the input terminal and two delay circuits. A differentiator calculates a difference d1 (=X1−X2) between the pixel data of interest X2 and the neighbor pixel data X1 and a difference d2 (=X3−X2) between the pixel data of interest X2 and the neighbor pixel data X3. A multiplier coefficient for low-pass filter calculation is determined based on the differences d1 and d2, and pixel data X2′ is calculated as pixel data after filter-processing of the pixel data of interest X2.

## Claims

### Claim 1

An image processing apparatus for converting moving image data having F frames per unit time into moving image data having 2F sub frames per the unit time, the apparatus comprising:
an input unit to input moving image data by frame;
a low-pass filter to multiply pixel data of interest and neighbor pixel data of the pixel data of interest in the frame inputted by said input unit by a multiplier coefficient and to add up the results of multiplication, thereby generating a low-frequency sub frame;
a high-frequency sub frame generator to extract high frequency component data from the frame inputted by said input unit and to add the high frequency component data to the frame inputted by said input unit, thereby generating a high-frequency sub frame; and
an output unit to output the low-frequency sub frame and the high-frequency sub frame,
wherein said low-pass filter comprises:
(a) a subtracter to subtract a brightness value of the pixel data of interest from a brightness value of the neighbor pixel data;
(b) a comparator to compare a result d1 of subtraction by said subtracter with a previously-set threshold Th equal to or greater than 0; and
(c) a selector to, (1) when d1≦Th holds as the result of comparison by said comparator, select a previously-set positive multiplier coefficient V0 as a multiplier coefficient for multiplication of the neighbor pixel data, and (2) while when d1>Th holds as the result of comparison by said comparator, select a positive multiplier coefficient V1 less than the multiplier coefficient V0 as the multiplier coefficient for multiplication of the neighbor pixel data,
wherein the apparatus further comprises a multiplier to multiply the low-frequency sub frame generated by said low-pass filter by a positive multiplier coefficient less than 1, and to output the result of multiplication as a subject of selection by said output unit, and
wherein said high-frequency sub frame generator subtracts the result of multiplication by said multiplier from the frame inputted by said input unit, thereby generating the high-frequency sub frame.

### Claim 2

An image processing apparatus for converting moving image data having F frames per unit time into moving image data having 2F sub frames per the unit time, the apparatus comprising:
an input unit to input moving image data by frame;
a low-pass filter to multiply pixel data of interest and neighbor pixel data of the pixel data of interest in the frame inputted by said input unit by a multiplier coefficient and to add up the result of multiplication, thereby generating a low-frequency sub frame;
a high-frequency sub frame generator to extract high frequency component data from the frame inputted by said input unit and to add the high frequency component data to the frame inputted by said input unit, thereby generating a high-frequency sub frame; and
an output unit to output the low-frequency sub frame and the high-frequency sub frame,
wherein said low-pass filter comprises:
(a) a subtracter to subtract a brightness value of the pixel data of interest from a brightness value of the neighbor pixel data;
(b) a comparator to compare a result d1 of subtraction by said subtracter with a previously-set threshold Th equal to or greater than 0; and
(c) a processor to, (1) when d1≦Th holds as the result of comparison by said comparator, perform low-pass filter processing on the pixel data of interest using the pixel data of interest and the neighbor pixel data, and (2) while when d1>Th holds as the result of comparison by said comparator, performing the low-pass filter processing on the pixel data of interest using the pixel data of interest and the pixel data of interest as substitute data for the neighbor pixel data,
wherein the apparatus further comprises a multiplier to multiply the low-frequency sub frame generated by said low-pass filter by a positive multiplier coefficient less than 1, and to output the result of multiplication as a subject of selection by said output unit, and
wherein said high-frequency sub frame generator subtracts the result of multiplication by said multiplier from the frame inputted by said input unit, thereby generating the high-frequency sub frame.

### Claim 3

A control method for an image processing apparatus for converting moving image data having F frames per unit time into moving image data having 2F sub frames per the unit time, the method comprising:
an input step of inputting moving image data by frame;
a low-pass filter step of multiplying pixel data of interest and neighbor pixel data of the pixel data of interest in the frame inputted at said input step by a multiplier coefficient and adding up the results of multiplication, thereby generating a low-frequency sub frame;
a high-frequency sub frame generation step of extracting high frequency component data from the frame inputted at said input step and adding the high frequency component data to the frame inputted at said input step, thereby generating a high-frequency sub frame; and
an output step of outputting the low-frequency sub frame and the high-frequency sub frame,
wherein said low-pass filter step comprises:
(a) a subtraction step of subtracting a brightness value of the pixel data of interest from a brightness value of the neighbor pixel data;
(b) a comparison step of comparing a result d1 of subtraction at said subtraction step with a previously-set threshold Th equal to or greater than 0; and
(c) a selection step of, (1) when d1≦Th holds as the result of comparison at said comparison step, selecting a previously-set positive multiplier coefficient V0 as a multiplier coefficient for multiplication of the neighbor pixel data, and (2) while when d1>Th holds as the result of comparison at said comparison step, selecting a positive multiplier coefficient V1 less than the multiplier coefficient V0 as the multiplier coefficient for multiplication of the neighbor pixel data,
wherein the method further comprises a multiplication step of multiplying the low-frequency sub frame generated by said low-pass filter step by a positive multiplier coefficient less than 1, and outputting the result of multiplication as a subject of selection by said output step, and
wherein said high-frequency sub frame generation step subtracts the result of multiplication by said multiplication step from the frame inputted by said input step, thereby generating the high-frequency sub frame.

### Claim 4

A control method for an image processing apparatus for converting moving image data having F frames per unit time into moving image data having 2F sub frames per the unit time, the method comprising:
an input step of inputting moving image data by frame;
a low-pass filter step of multiplying pixel data of interest and neighbor pixel data of the pixel data of interest in the frame inputted at said input step by a multiplier coefficient and adding up the results of multiplication, thereby generating a low-frequency sub frame;
a high-frequency sub frame generation step of extracting high frequency component data from the frame inputted at said input step and adding the high frequency component data to the frame inputted at said input step, thereby generating a high-frequency sub frame; and
an output step of outputting the low-frequency sub frame and the high-frequency sub frame,
wherein said low-pass filter step comprises:
(a) a subtraction step of subtracting a brightness value of the pixel data of interest from a brightness value of the neighbor pixel data;
(b) a comparison step of comparing a result d1 of subtraction at said subtraction step with a previously-set threshold Th equal to or greater than 0; and
(c) processing step of, (1) when d1≦Th holds as the result of comparison at said comparison step, performing low-pass filter processing on the pixel data of interest using the pixel data of interest and the neighbor pixel data, and (2) while when d1>Th holds as the result of comparison at said comparison step, performing the low-pass filter processing on the pixel data of interest using the pixel data of interest and the pixel data of interest as substitute data for the neighbor pixel data,
wherein the method further comprises a multiplication step of multiplying the low-frequency sub frame generated by said low-pass filter step by a positive multiplier coefficient less than 1, and outputting the result of multiplication as a subject of selection by said output step,
wherein said high-frequency sub frame generation step subtracts the result of multiplication by said multiplication step from the frame inputted by said input step, thereby generating the high-frequency sub frame.

### Claim 5 (depends on 1)

A non-transitory computer-readable storage medium holding a computer program read and executed by a computer, thereby causing the computer to function as the image processing apparatus recited in claim 1.

### Claim 6 (depends on 2)

A non-transitory computer-readable storage medium holding a computer program read and executed by a computer, thereby causing the computer to function as the image processing apparatus recited in claim 2.
