Signal processing device and method, and recording medium
AssigneeSony Corporation
InventorsTetsujiro Kondo, Junichi Ishibashi, Takashi Sawao, Seiji Wada, Tohru Miyake, Takahiro Nagano, NAOKI FUJIWARA
Life of this patent
Estimating the term…
Abstract
A signal processor 12 acquires a second signal obtained by detecting a first signal, as a signal of the real world, having a first dimension. The second signal is of a second dimension lower than the first dimension and has distortion relative to the first signal. The signal processor 12 performs signal processing which is based on the second signal to generate a third signal alleviated in distortion as compared to the second signal.
Claims84
A picture processing apparatus for processing picture data made up of a predetermined number of pixel data acquired by an imaging device having a predetermined number of pixels each having an integrating effect, said picture processing apparatus comprising:
- processing unit decision means for deciding, based on area information specifying a foreground area made up only of foreground object components making up a foreground object in said picture data, a background area made up only of background object components making up a background object in said picture data, and a mixed area which is a mixture of said foreground object components and the background object components in said picture data, said mixed area including a covered background area formed at a leading end in a movement direction of said foreground object, and an uncovered background area formed at a trailing end of said foreground object, a processing unit made up of pixel data lying on at least a straight line extending in a direction coincident with the direction of movement of said foreground object from an outer end of said covered background area to an outer end of said uncovered background area, centered about said foreground area;
- normal equation generating means for generating a normal equation by setting pixel values of pixels in said processing unit decided based on said processing unit and a dividing value which is an unknown dividing value obtained on dividing said foreground object components in said imxed area with a predetermined dividing number;
- and
- calculating means for solving said normal equation by the least square method to generate foreground object components adjusted for the quantity of movement blurring.
A picture processing method for processing picture data made up of a predetermined number of pixel data acquired by an imaging device having a predetermined number of pixels each having an integrating effect, said picture processing method comprising:
- a processing unit decision step of deciding, based on area information specifying a foreground area made up only of foreground object components making up a foreground object in said picture data, a background area made up only of background object components making up a background object in said picture data, and a mixed area which is a mixture of said foreground object components and the background object components in said picture data, said mixed area including a covered background area formed at a leading end in a movement direction of said foreground object, and an uncovered background area formed at a trailing end of said foreground object, a processing unit made up of pixel data lying on at least a straight line extending in a direction coincident with the direction of movement of said foreground object from an outer end of said covered background area to an outer end of said uncovered background area, centered about said foreground area;
- a normal equation generating step of generating a normal equation by setting pixel values of pixels in said processing unit decided based on said processing unit and a dividing value which is an unknown dividing value obtained on dividing said foreground object components in said mixed area with a predetermined dividing number;
- and
- a calculating step of solving said normal equation by the least square method to generate foreground object components adjusted for the quantity of movement blurring.
A picture processing program for processing picture data made up of a predetermined number of pixel data acquired by an imaging device having a predetermined number of pixels each having an integrating effect, said picture processing program comprising:
- a processing unit decision step of deciding, based on area information specifying a foreground area made up only of foreground object components making up a foreground object in said picture data, a background area made up only of background object components making up a background object in said picture data, and a mixed area which is a mixture of said foreground object components and the background object components in said picture data, said mixed area including a covered background area formed at a leading end in a movement direction of said foreground object, and an uncovered background area formed at a trailing end of said foreground object, a processing unit made up of pixel data lying on at least a straight line extending in a direction coincident with the direction of movement of said foreground object from an outer end of said covered background area to an outer end of said uncovered background area, centered about said foreground area;
- a normal equation generating step of generating a normal equation by setting pixel values of pixels in said processing unit decided based on said processing unit and a dividing value which is an unknown dividing value obtained on dividing said foreground object components in said mixed area with a predetermined dividing number;
- and
- a calculating step of solving said normal equation by the least square method to generate foreground object components adjusted for the quantity of movement blurring.
A signal processing apparatus for processing detection data, acquired every predetermined time period by a sensor made up of a predetermined number of detection elements having time-integrating effects, every predetermined time period, said signal processing apparatus comprising:
- foreground sample data extracting means for extracting said sample data present in detection data before or after considered detection data where there exists considered sample data which is the sample data under consideration, as foreground sample data corresponding to an object proving the foreground in the real world;
- background sample data extracting means for extracting said sample data present in detection data lying after or before the considered detection data where there exists considered sample data which is the sample data under consideration, as background sample data corresponding to an object proving the background in the real world;
- and
- detection means for detecting a mixing ratio of said considered sample data based on said considered sample data, said foreground sample data and said background sample data.
A signal processing method for processing detection data, acquired every predetermined time period by a sensor made up of a predetermined number of detection elements having time-integrating effects, every predetermined time period, said signal processing method comprising:
- a foreground sample data extracting step of extracting said sample data present in detection data before or after considered detection data where there exists considered sample data which is the sample data under consideration, as foreground sample data corresponding to an object proving the foreground in the real world;
- a background sample data extracting step of extracting said sample data present in detection data lying after or before the considered detection data where there exists considered sample data which is the sample data under consideration, as background sample data corresponding to an object proving the background in the real world;
- and
- a detection step of detecting a mixing ratio of said considered sample data based on said considered sample data, said foreground sample data and said background sample data.
A signal processing program for processing detection data, acquired every predetermined time period by a sensor made up of a predetermined number of detection elements having time-integrating effects, every predetermined time period, said signal processing program comprising:
- a foreground sample data extracting step of extracting said sample data present in detection data before or after considered detection data where there exists considered sample data which is said sample data under consideration, as foreground sample data corresponding to an object proving the foreground in the real world;
- a background sample data extracting step of extracting said sample data present in detection data lying after or before the considered detection data where there exists considered sample data which is the sample data under consideration, as background sample data corresponding to an object proving the background in the real world;
- and
- a detection step of detecting a mixing ratio of said considered sample data based on said considered sample data, said foreground sample data and said background sample data.
A signal processing apparatus for processing detection data, acquired every predetermined time period by a sensor made up of a predetermined number of detection elements having time-integrating effects, every predetermined time period, said signal processing apparatus comprising:
- still/movement decision means for deciding still/movement based on said detection data;
- and
- detection means for detecting a mixed area containing sample data having plural real world objects mixed together based on the results of discrimination.
A signal processing method for processing detection data, acquired every predetermined time period by a sensor made up of a predetermined number of detection elements having time-integrating effects, every predetermined time period, said signal processing method comprising:
- a still/movement decision step of deciding still/movement based on said detection data;
- and
- a detection step of detecting a mixed area containing sample data having plural real world objects mixed together based on the results of discrimination.
A signal processing program for processing detection data, acquired every predetermined time period by a sensor made up of a predetermined number of detection elements having time-integrating effects, every predetermined time period, said signal processing program comprising:
- a still/movement decision step of deciding still/movement based on said detection data;
- and
- a detection step of detecting a mixed area containing sample data having plural real world objects mixed together based on the results of discrimination.
A signal processing apparatus comprising:
- means for acquiring second signals of a second dimension by projecting first signals as real-world signals of a first dimension on a sensor and by detecting the mapped signals by said sensor, said first dimension being lower than said first dimension;
- and
- signal processing means for extracting the significant information, buried by said projection from said second signals, by performing signal processing which is based on said second signals.
A signal processing method comprising:
- a signal acquisition step of acquiring a second signal by projecting a first signal as a real world signal of a first dimension on a sensor and detecting the so-mapped first signal by said sensor, said second signal being of a second dimension lower than said first dimension;
- and
- a signal processing step of performing signal processing based on said second signal to extract the significant information buried by projection from said second signal.
A recording medium having recorded thereon a computer-readable program, said program comprising:
- a signal acquisition step of acquiring a second signal by projecting a first signal as a real world signal of a first dimension on a sensor and detecting the so-mapped first signal by said sensor, said second signal being of a second dimension lower than said first dimension;
- and
- a signal processing step of performing signal processing based on said second signal to extract the significant information buried by projection from said second signal.
A signal processing apparatus comprising:
- signal acquisition means for acquiring a second signal by detecting a first signal as a real world signal of a first dimension by a sensor, said second signal being of a second dimension lower than said first dimension and containing distortion with respect to said first signal;
- and
- signal processing means for performing signal processing on said second signal for generating a third signal alleviated in distortion as compared to said second signal.
A signal processing method comprising:
- a signal acquisition step of acquiring a second signal by detecting a first signal as a real world signal of a first dimension by a sensor, said second signal being of a second dimension lower than said first dimension;
- and
- a signal processing step of performing signal processing on said second signal to generate a third signal alleviated in distortion as compared to said second signal.
A recording medium having a computer-readable program, recorded thereon, said computer-readable program comprising:
- a signal acquisition step of acquiring a second signal by detecting a first signal as a real world signal of a first dimension by a sensor, said second signal being of a second dimension lower than said first dimension said signal being of a second dimension lower than said first dimension;
- and
- a signal processing step of performing signal processing on said second signal to generate a third signal alleviated in distortion as compared to said second signal.
A signal processing apparatus for processing a predetermined number of detection signals acquired by a sensor made up of a predetermined number of detection elements having time integrating effects, said signal processing apparatus comprising:
- area specifying means for specifying a foreground area made up only of foreground object components constituting an foreground object, a background area made up only of background object components constituting a background object, and a mixed area mixed from said foreground object components and the background object components;
- mixing ratio detection means for detecting a mixing ratio of said foreground object components and said background object components at least in said mixed area;
- and
- separating means for separating said foreground object and said background object from each other based on the specified results by said area specifying means and said mixing ratio.
A signal processing method for processing a predetermined number of detection signals acquired by a sensor made up of a predetermined number of detection elements having time integrating effects, said signal processing method comprising:
- an area specifying step of specifying a foreground area, made up only of foreground object components constituting an foreground object, a background area made up only of background object components constituting a background object, and a mixed area mixed from said foreground object components and the background object components;
- a mixed area detection step of detecting a mixing ratio of said foreground object components and said background object components at least in said mixed area;
- and
- a separating step of separating said foreground object and said background object from each other based on the specified results by said area specifying means and said mixing ratio.
A recording medium having a computer-readable program, recorded thereon, said computer-readable program comprising:
- an area specifying step of specifying a foreground area, made up only of foreground object components constituting an foreground object, a background area made up only of background object components constituting a background object, and a mixed area mixed from said foreground object components and the background object components;
- a mixed area detection step of detecting a mixing ratio of said foreground object components and said background object components at least in said mixed area;
- and
- a separating step of separating said foreground object and said background object from each other based on the specified results by said area specifying means and said mixing ratio.
A signal processing apparatus for processing a predetermined number of detection signals acquired by a sensor made up of a predetermined number of detection elements having time integrating effects, said signal processing apparatus comprising:
- area specifying means for specifying a foreground area, made up only of foreground object components constituting an foreground object, a background area made up only of background object components constituting a background object, and a mixed area mixed from said foreground object components and the background object components;
- and
- mixing ratio detecting means for detecting a mixing ratio between said foreground object components and said background object components at least in said mixed area based on the results specified by said area specifying means.
A signal processing method for processing a predetermined number of detection signals acquired by a sensor made up of a predetermined number of detection elements having time integrating effects, said signal processing method comprising:
- an area specifying step of specifying a foreground area, made up only of foreground object components constituting an foreground object, a background area made up only of background object components constituting a background object, and a mixed area mixed from said foreground object components and the background object components;
- and
- a mixing ratio detecting step of detecting a mixing ratio between said foreground object components and said background object components at least in said mixed area based on the results specified by said area specifying means.
A recording medium having a computer-readable program recorded thereon, said signal processing method for processing a predetermined number of detection signals acquired by a sensor made up of a predetermined number of detection elements having time integrating effects, said computer-readable program comprising:
- an area specifying step of specifying a foreground area, made up only of foreground object components constituting an foreground object, a background area made up only of background object components constituting a background object, and a mixed area mixed from said foreground object components and the background object components;
- and
- a mixing ratio detecting step of detecting a mixing ratio between said foreground object components and said background object components at least in said mixed area based on the results specified by said area specifying means.
A signal processing apparatus for processing a predetermined number of detection signals acquired by a sensor made up of a predetermined number of detection elements having time integrating effects, said signal processing apparatus comprising:
- mixing ratio detecting means for detecting a mixing ratio of foreground object components and background object components in a mixed area in which said foreground object components constituting a foreground object and said background object components constituting a background object are mixed;
- and
- separating means for separating said foreground object and said background object from each other based on said mixing ratio.
A signal processing method for processing a predetermined number of detection signals acquired by a sensor made up of a predetermined number of detection elements having time integrating effects, said signal processing method comprising:
- a mixing ratio detecting step of detecting a nixing ratio of foreground object components and background object components in a mixed area in which said foreground object components constituting a foreground object and said background object components constituting a background object are nixed;
- and
- a separating step of separating said foreground object and said background object from each other based on said mixing ratio.
A recording medium having recorded thereon a computer-readable program for processing a predetermined number of detection signals acquired by a sensor made up of a predetermined number of detection elements having time integrating effects, said computer-readable program comprising:
- a mixing ratio detecting step of detecting a mixing ratio of foreground object components and background object components in a mixed area in which said foreground object components constituting a foreground object and said background object components constituting a background object are mixed;
- and
- a separating step of separating said foreground object and said background object from each other based on said mixing ratio.
Dependencies are inferred from the claim text.