# US 2005/0030302 A1 · Video processing apparatus, video processing method, and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2005/0030302 A1
- Document ID: US20050030302A1
- Status: Published application
- Kind: A1
- Application number: 10/884,063
- Filed: 2004-07-01
- Published: 2005-02-10
- Earliest claimed: 2003-07-04
- Assignees: Sony Corporation
- Inventors: Toru Nishi; Kazuhiko Ueda; Mitsuyasu Asano; Kazuki Yokoyama; Tetsuji Inada
- Web page: https://patentgrep.com/patent/US20050030302A1

## CPC

- G09G 3/3611: {Control of matrices with row and column drivers}
- G06T 5/73: Deblurring; Sharpening
- G06T 7/12: Edge-based segmentation
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G09G 3/20: for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20192: Edge enhancement; Edge preservation
- G09G 2320/0252: Improving the response speed
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2320/106: Determination of movement vectors or equivalent parameters within the image
- G09G 2340/16: Determination of a pixel data signal depending on the signal applied in the previous frame
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A holding type display such as a liquid-crystal display for controlling motion blur is disclosed. A step edge detector detects an edge portion of a moving step edge in video data in an input frame or an input field. A corrector corrects a pixel value of a pixel at the edge portion of the step edge detected by the step edge detector, based on a spatial amount of motion of the corresponding pixel supplied by a motion detector.

## Claims

### Claim 1

A video processing apparatus comprising:
means for detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
video processing means for processing a pixel value in the video data based on the result of the motion detection of the motion detecting means; and
display means for displaying the result of the process of the pixel value provided by the video processing means,
wherein the video processing means comprises:
a step edge detector for detecting an edge portion in response to the result of the motion detection of the motion detecting means; and
a corrector for correcting the result of the step edge detection of the step edge detector.

### Claim 2 (depends on 1)

A video processing apparatus according to claim 1, wherein the motion detecting means detects the motion in the video by comparing an object moving in the video data with an object moving in the reference video data.

### Claim 3 (depends on 1)

A video processing apparatus according to claim 1, wherein the corrector performs correction by changing the edge height in the edge portion detected by the step edge detector depending on the motion detected by the motion detecting means.

### Claim 4 (depends on 3)

A video processing apparatus according to claim 3, wherein the corrector performs correction by changing the edge height in the edge portion of the step edge detected by the step edge detector depending on the display characteristics of the display means.

### Claim 5

A video processing method comprising the steps of:
detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
processing a pixel value in the video data based on the result of the motion detection in the motion detecting step; and
displaying the result of the process of the pixel value provided in the video processing step,
wherein the video processing step comprises:
detecting an edge portion of a step edge in the video data in response to the result of the motion detection in the motion detecting step; and
correcting the result of the step edge detection.

### Claim 6

A computer program for causing a computer to perform a video processing method, the computer program comprising program code for performing the steps of:
detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
processing a pixel value in the video data based on the result of the motion detection in the motion detecting step; and
displaying the result of the process of the pixel value provided in the video processing step,
wherein the video processing step comprises:
detecting an edge portion in a step edge in the video data in response to the result of the motion detection in the motion detecting step; and
correcting the result of the step edge detection.

### Claim 7

A video processing apparatus for commanding a display device to display each of a plurality of access units constituting a moving picture, the display device including a plurality of display elements that take a predetermined period of time to reach an output target level from the moment the target level is addressed, each of the plurality of display elements corresponding to at least a portion of a predetermined one of pixels forming the access unit, the video processing apparatus comprising:
motion detecting means for detecting an object that has moved to a spatial location in a first access unit from a spatial location in a second access unit prior to the first access unit, and a spatial amount of motion of the object;
edge detecting means for detecting an edge portion of the object detected by the motion detecting means;
correcting means for correcting a pixel value of a pixel, positioned at the edge portion of the object detected by the edge detecting means, from among a plurality of pixels forming the first access unit, based on the spatial amount of motion of the object detected by the motion detecting means; and
display commanding means for commanding the display device to display the first access unit by addressing the pixel values of the plurality of pixels forming the first access unit, containing the pixel value corrected by the correcting means, as the target levels of the corresponding display elements to the display device.

### Claim 8 (depends on 7)

A video processing apparatus according to claim 7, wherein the object comprises pixels which, having a first pixel value, are consecutively aligned in the direction of motion, and beyond a predetermined pixel thereof as a border, pixels which, having a second pixel value different from the first pixel value, are consecutively aligned in the direction of motion; and
wherein the edge detecting means detects, as a pixel corresponding to the edge portion of the object, a pixel having the first pixel value bordering the pixel having the second pixel value.

### Claim 9 (depends on 8)

A video processing apparatus according to claim 8, wherein the edge detecting means further calculate the difference value between the first pixel value of the first pixel detected as the edge portion of the object and the second pixel value of a second pixel adjacent to the first pixel in the direction of motion; and
wherein the correcting means determine, regarding the first pixel detected by the edge detecting means, a first gain depending on the amount of motion detected by the motion detecting means, calculate the product between the determined first gain and the difference value detected by the edge detecting means so as to determine a correction value, and add the determined correction value to the pixel value of the first pixel so as to determine a corrected pixel value of the first pixel.

### Claim 10 (depends on 9)

A video processing apparatus according to claim 9, wherein the correcting means further determine, regarding the first pixel, a second gain depending on the time response characteristics of the display element corresponding to the first pixel of the display device, and calculate the product of the first gain, the determined second gain, and the difference value so as to determine the correction value.

### Claim 11 (depends on 10)

A video processing apparatus according to claim 10, wherein the correcting means further set, as a target pixel to be corrected, two or more pixels including the first pixel, of pixels consecutively lined in the direction opposite to the direction of motion of the object, beginning at the first pixel, distribute the correction value to the two or more pixels to be corrected, add the distributed correction value to the pixel values corresponding to the two or more pixels to be corrected so as to determine the corrected pixel value of the two or more pixels to be corrected.

### Claim 12

A video processing method for commanding a display device to display each of a plurality of access units constituting a moving picture, the display device including a plurality of display elements that take a predetermined period of time to reach an output target level from the moment the target level is addressed, each of the plurality of display elements corresponding to at least a portion of a predetermined one of pixels forming the access unit, the video processing method comprising:
a motion detecting step for detecting an object that has moved to a spatial location in a first access unit from a spatial location in a second access unit prior to the first access unit, and a spatial amount of motion of the object;
an edge detecting step for detecting an edge portion of the object detected in the motion detecting step;
a correcting step for correcting the pixel value of a pixel, positioned at the edge portion of the object detected in the edge detecting step, from among a plurality of pixels forming the first access unit, based on the spatial amount of motion of the object detected in the motion detecting step; and
a display commanding step for commanding the display device to display the first access unit by addressing the pixel values of the plurality of pixels forming the first access unit, containing the pixel value corrected in the correcting step, as the target levels of the corresponding display elements to the display device.

### Claim 13

A computer program for causing a computer to perform a video processing method for commanding a display device to display each of a plurality of access units constituting a moving picture, the display device including a plurality of display elements that take a predetermined period of time to reach an output target level from the moment the target level is addressed, each of the plurality of display elements corresponding to at least a portion of a predetermined one of pixels forming the access unit, the computer program comprising program code for performing:
a motion detecting step for detecting an object that has moved to a spatial location in a first access unit from a spatial location in a second access unit prior to the first access unit and a spatial amount of motion of the object;
an edge detecting step for detecting an edge portion of the object detected in the motion detecting step;
a correcting step for correcting the pixel value of a pixel, positioned at the edge portion of the object detected in the edge detecting step, from among a plurality of pixels forming the first access unit, based on the spatial amount of motion of the object detected in the motion detecting step; and
a display commanding step for commanding the display device to display the first access unit by addressing the pixel values of the plurality of pixels forming the first access unit, containing the pixel value corrected in the correcting step, as the target levels of the corresponding display elements to the display device.

### Claim 14

A video processing apparatus comprising:
motion detecting means for detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
first video processing means for performing a first video process on the video data based on the result of the motion detection of the motion detecting means;
second video processing means for performing a second video process other than the first video process on the video data based on the result of the motion detection of the motion detecting means; and
display means for displaying at least one of the results of the first and second video processes of the first and second video processing means based on the result of the motion detection of the motion detecting means.

### Claim 15 (depends on 14)

A video processing apparatus according to claim 14, wherein the motion detecting means detects the motion in the video by comparing an object moving in the video data with an object moving in the reference video data.

### Claim 16 (depends on 14)

A video processing apparatus according to claim 14, wherein the second video processing means comprises:
a step edge detector for detecting an edge portion in accordance with the result of the motion detection of the motion detecting means; and
a corrector for correcting the result of the step edge detection of the step edge detector.

### Claim 17 (depends on 16)

A video processing apparatus according to claim 16, wherein the corrector performs correction by changing the edge height in the edge portion detected by the step edge detector depending on the motion detected by the motion detecting means.

### Claim 18 (depends on 17)

A video processing apparatus according to claim 17, wherein the corrector performs correction by changing the edge height in the edge portion detected by the step edge detector depending on the display characteristics of the display means.

### Claim 19 (depends on 14)

A video processing apparatus according to claim 14, wherein the display means comprises:
a switch for switching between the result of the video process of the first processing means and the result of the video process of the second video processing means, based on the result of the motion detection of the motion detecting means;
a display controller for converting the result selected by the switch to a signal having a predetermined format responsive to the target level of a display element of each pixel; and
a hold unit for holding the result of the conversion of the display controller for each of all display elements.

### Claim 20

A video processing method comprising:
a motion detecting step for detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
a first video processing step for performing a first video process on the video data based on the result of the motion detection in the motion detecting step;
a second video processing step for performing a second video process other than the first video process on the video data based on the result of the motion detection in the motion detecting step; and
a display step for displaying at least one of the results of the first and second video processes in the first and second video processing steps based on the result of the motion detection of the motion detecting step.

### Claim 21

A computer program for causing a computer to perform a video processing method, the computer program comprising program code for performing:
a motion detecting step for detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
a first video processing step for performing a first video process on the video data based on the result of the motion detection in the motion detecting step;
a second video processing step for performing a second video process other than the first video process on the video data based on the result of the motion detection in the motion detecting step; and
a display step for displaying at least one of the results of the first and second video processes in the first and second video processing steps based on the result of the motion detection of the motion detecting step.

### Claim 22

A video processing apparatus comprising:
motion detecting means for detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
video processing means for performing a video process on pixel values in the video data based on the result of the motion detection of the motion detecting means; and
display controlling means for controlling a predetermined display device to display the result of the video processing means,
wherein the video processing means comprise correcting means for subjecting a block formed of two pixels values corresponding to two pixels to be disposed consecutively in a predetermined direction of the video data to an asymmetric high-pass filter process, taking advantage of the result of the motion detecting means, thereby correcting one of the pixel values included in the block.

### Claim 23

A video processing method comprising the steps of:
detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
processing a pixel value in the video data based on the result of the motion detection in the motion detecting step; and
controlling a predetermined display device to display the result of the process of the pixel value provided in the video processing step,
wherein the video processing step comprises a correcting step for subjecting a block formed of two pixels values corresponding to two pixels to be disposed consecutively in a predetermined direction of the video data to an asymmetric high-pass filter process, taking advantage of the result of the motion detecting step, thereby correcting one of the pixel values included in the block.

### Claim 24

A computer program for causing a computer to perform a video processing method, the computer program comprising program code for performing the steps of:
detecting motion in a video based on input video data and reference video data immediately prior to the input video data;
processing a pixel value in the video data based on the result of the motion detection in the motion detecting step; and
controlling a predetermined display device to display the result of the process of the pixel value provided in the video processing step,
wherein the video processing step comprises a correcting step for subjecting a block formed of two pixels values corresponding to two pixels to be disposed consecutively in a predetermined direction of the video data to an asymmetric high-pass filter process, taking advantage of the result of the motion detecting step, thereby correcting one of the pixel values included in the block.
