Stereo video for gaming
AssigneeMicrosoft Corporation
InventorsThore KH Graepel, Andrew Blake, Ralf Herbrich
Life of this patent
Estimating the term…
Abstract
A real-time stereo video signal of a captured scene with a physical foreground object and a physical background is received. In real-time, a foreground/background separation algorithm is used on the real-time stereo video signal to identify pixels from the stereo video signal that represent the physical foreground object. A video sequence may be produced by rendering a 3D virtual reality based on the identified pixels of the physical foreground object.
Claims20
A method for producing a video sequence in a game console, comprising:
- receiving from a stereo camera a real-time stereo video signal comprising paired left and right images of a captured scene, the captured scene comprising a physical foreground object and a physical background, the physical foreground object comprised of at least a first aspect and a second aspect;
- performing, in real-time, a foreground/background separation algorithm on the real-time stereo video signal to identify pixels captured from the real-time stereo video signal that are indicative of the physical foreground object;
- performing, in real-time, a normalization technique on at least a first portion of the identified pixels indicative of the physical foreground object to identify pixels indicative of the first aspect;
- and
- producing a video sequence by rendering a virtual reality based on the identified pixels indicative of the first aspect.
A method for producing a video sequence in a game console, comprising:
- receiving from a stereo camera a real-time stereo video signal comprising paired left and right images of a captured scene, the captured scene comprising a physical foreground object and a physical background;
- performing, in real-time, a foreground/background separation algorithm on the real-time stereo video signal to identify pixels captured from the real-time stereo video signal that are indicative of the physical foreground object;
- detecting attributes of the physical foreground object;
- comparing the detected attributes of the physical foreground object to one or more kernel images, respective kernel images associated with a set of attributes;
- identifying a kernel image associated with a set of attributes that substantially correspond to the detected attributes;
- and
- producing a video sequence by rendering a virtual reality based at least in part upon the identified kernel image.
A computer-readable medium having computer-executable instructions that, when executed by a processor, are configured to perform a method, the method comprising:
- receiving from a stereo camera a stereo video signal comprising paired left and right images of a captured scene, the captured scene comprising a physical foreground object and a physical background, the physical foreground object comprised of at least a first aspect and a second aspect;
- performing a foreground/background separation algorithm on the stereo video signal to identify pixels captured from the stereo video signal that are indicative of the physical foreground object;
- separating pixels indicative of the first aspect of the physical foreground object from pixels indicative of the second aspect of the physical foreground object;
- and
- producing a video sequence by rendering a virtual reality based on the identified pixels indicative of the first aspect of the physical foreground object.
Dependencies are inferred from the claim text.