System And Method For Processing Video Using Depth Sensor Information
OwnerKar Han Tan, W. Bruce Culbertsoninventors
Life of this patent
Estimating the term…
Abstract
A method for processing video using depth sensor information, comprising the steps of: dividing the image area into a number of bins roughly equal to the depth sensor resolution, with each bin corresponding to a number of adjacent image pixels; adding each depth measurement to the bin representing the portion of the image area to which the depth measurement corresponds; averaging the value of the depth measurement for each bin to determine a single average value for each bin; and applying a threshold to each bin of the registered depth map to produce a threshold image.
Claims20
A method executed on a computer, for processing a video using depth sensor information comprising the steps of
- creating a registered depth map that registers depth pixels in a depth coordinate system to image pixels in an image coordinate system,
- wherein the registered depth map is created from video image information comprised of depth pixels corresponding to a depth coordinate system and image pixels corresponding to an image coordinate system, wherein the image coordinate system is divided into a number of bins such that each image pixel location is represented with a resolution comparable to the depth sensor;
- and
- applying a threshold to each bin of the registered depth map to produce a threshold image.
The method recited in step 2 wherein the step of creating a registered depth map further includes the step of:
- for each bin, computing the average depth measurement value for that bin.
A tangible computer readable storage medium having instructions for causing a computer to execute a method comprising the steps of:
- creating a registered depth map that registers depth pixels in a depth coordinate system to image pixels in an image coordinate system,
- wherein the registered depth map is created from video information comprised of depth pixels corresponding to a depth pixel coordinate system and image pixels corresponding to an image coordinate system, wherein the image coordinate system is divided into a number of bins such that each image pixel location is represented with a resolution comparable to the depth sensor;
- and
- applying a threshold to each bin of the registered depth map to produce a threshold image.
A method, executed on a computer, for processing a video image comprised of both image and depth sensor information, comprising the steps of:
- dividing the image area into a number of bins roughly equal to the depth sensor resolution, with each bin corresponding to a number of adjacent image pixels;
- adding each depth measurement to the bin representing the portion of the image area to which the depth measurement corresponds;
- averaging the value of the depth measurement for each bin to determine a single average value for each bin;
- and
- applying a threshold to each bin to produce a threshold image.
Dependencies are inferred from the claim text.