Back to results
US 7,254,268 B2Granted
Object extraction
AssigneeArcSoft, Inc.
InventorsBin Zhao, Na Li
Life of this patent
Estimating the term…
Abstract
A video sequence is processed to extract one or more objects. The extracted objects are used to create a new video sequence. In particular, a user is able to select a background and/or an audio recording. Alternatively, the object extraction system automatically selects a background and/or audio recording. The extracted objects are integrated into the selected background and/or the audio recording is added to form a new video sequence.
Claims66
A method for classifying an object in a non-static frame as foreground or background, comprising:
- (a) classifying a pixel in the non-static frame as foreground when a value component of the pixel exceeds a mean value of the value component for the pixel across multiple frames by a first value;
- (b) classifying the pixel as background when the pixel is in shadow;
- (c) classifying the pixel as background when the pixel is under different illumination and each usable component of the pixel exceeds a mean value of that component by a second value;
- and
- (d) classifying the pixel as foreground when the pixel is not classified by acts (a), (b), or (c).
2 more elements
A method for processing a sequence of frames, comprising:
- extracting one or more objects from a frame by classifying each pixel of the frame as being background or foreground, said classifying each pixel comprising:
- (a) classifying a pixel in the frame as foreground when a value component of the pixel exceeds a mean value of the value component for the pixel across multiple frames by a first value;
- (b) classifying the pixel as background when the pixel is in shadow;
- (c) classifying the pixel as background when the pixel is under different illumination and each usable component of the pixel exceeds a mean value of that component by a second value;
- and
- (d) classifying the pixel as foreground when the pixel is not classified by acts (a), (b), or (c);
- selecting a new background;
- selecting an audio recording;
- and
- integrating the extracted objects with the new background and the audio recording.
7 more elements
A system, comprising:
- a computer including a memory;
- a sequence of frames stored in the memory;
- and
- a computer program executable by the computer, the computer program comprising instructions for classifying an object in a non-static frame from the sequence of frame as foreground or background, the instructions comprising:
- (a) classifying in a pixel in the non-static frame as foreground when a value component of the pixel exceeds a mean value of the value component for the pixel across multiple frames in the sequence of frames by a first value;
- (b) classifying the pixel as background when the pixel is in shadow;
- (c) classifying the pixel as background when the pixel is under different illumination and each usable component of the pixel exceeds a mean value of that component by a second value;
- and
- (d) classifying the pixel as foreground when the pixel is not classified by acts (a), (b), or (c).
6 more elements
A system, comprising:
- means for extracting one or more objects from a frame by classifying each pixel of the frame as being background or foreground, said classifying comprising:
- (a) classifying a pixel as foreground when a value component of the pixel exceeds a mean value of the value component for the pixel across multiple frames by a first value;
- (b) classifying the pixel as background when the pixel is in shadow;
- (c) classifying the pixel as background when the pixel is under different illumination and each usable component of the pixel exceeds a mean value of that component by a second value;
- and
- (d) classifying the pixel as foreground when the pixel is not classified by acts (a), (b), or (c);
- means for selecting a new background;
- means for selecting an audio recording;
- and
- means for integrating the extracted objects with the new background and audio recording.
7 more elements
A computer readable storage medium encoded with a computer program executable by a computer, the computer program comprising instructions for classifying an object in a non-static frame as foreground or background, wherein the instructions comprise:
- (a) classifying a pixel in the non-static frame as foreground when a value component of the pixel exceeds a mean value of the value component for the pixel across multiple frames by a first value;
- (b) classifying the pixel as background when the pixel is in shadow;
- (c) classifying the pixel as background when the pixel is under different illumination and each usable component of the pixel exceeds a mean value of that component by a second value;
- and
- (d) classifying the pixel as foreground when the pixel is not classified by acts (a), (b), or (c).
2 more elements
A computer readable storage medium encoded with software instructions, wherein the the software instructions comprise:
- extracting one or more objects from a frame by classifying each pixel of the frame as being background or foreground, said classifying comprising:
- (a) classifying a pixel in the frame as foreground when a value component of the pixel exceeds a mean value of the value component for the pixel across multiple frames by a first value;
- (b) classifying the pixel as background when the pixel is in shadow;
- (c) classifying the pixel as background when the pixel is under different illumination and each usable component of the pixel exceeds a mean value of that component by a second value;
- and
- (d) classifying the pixel as foreground when the pixel is not classified by acts (a), (b), or (c);
- selecting a new background;
- selecting an audio recording;
- and
- integrating the extracted objects with the new background and audio recording.
7 more elements
Dependencies are inferred from the claim text.