Computing motion of pixels among images
AssigneeNVIDIA Corporation
InventorsVipul Parashar, Dong Zhang, Sampurnananda Mishra
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques to calculate motion of one or more pixel in a region in an image. In at least one embodiment, motion is calculated based on motion of one or more pixels in a different region of said image that overlaps said region in which one or more algorithms are expressed in CUDA code, for example, for efficient execution on a GPU.
Claims29
One or more processors comprising:
- circuitry to:
- identify at least a first region of an image and a second region of the image that overlap at an overlapping portion;
- for a pixel within the overlapping portion that lacks a corresponding optical flow vector, use one or more optical flow vectors of the first region to calculate motion to convert the pixel to a valid pixel;
- and
- for each pixel within the second region that lacks a corresponding optical flow vector, iteratively use one or more valid pixels within the overlapping portion comprising the converted pixel to calculate motion to convert each pixel;
- and
- update a flow map to generate a second flow map based at least in part on the conversion of each pixel within the second region that lacks a corresponding optical flow vector.
A system, comprising:
- one or more processors to:
- identify at least a first region of an image and a second region of the image that overlap at an overlapping portion;
- for a pixel within the overlapping portion that lacks a corresponding optical flow vector, use one or more optical flow vectors of the first region to calculate motion to convert the pixel to a valid pixel;
- and
- for each pixel within the second region that lacks a corresponding optical flow vector, iteratively use one or more valid pixels within the overlapping portion comprising the converted pixel to calculate motion to convert each pixel;
- and
- update a flow map to generate a second flow map based at least in part on the conversion of each pixel within the second region that lacks a corresponding optical flow vector.
A method, comprising:
- identifying at least a first region of an image and a second region of the image that overlap at an overlapping portion;
- for a pixel within the overlapping portion that lacks a corresponding optical flow vector, using one or more optical flow vectors of the first region to calculate motion to convert the pixel to a valid pixel;
- and
- for each pixel within the second region that lacks a corresponding optical flow vector, iteratively using one or more valid pixels within the overlapping portion comprising the converted pixel to calculate motion to convert each pixel;
- and
- updating a flow map to generate a second flow map based at least in part on the conversion of each pixel within the second region that lacks a corresponding optical flow vector.
A non-transitory machine-readable medium having stored thereon a set of instructions, which if performed by one or more processors, cause the one or more processors to at least:
- identify at least a first region of an image and a second region of the image that overlap at an overlapping portion;
- for a pixel within the overlapping portion that lacks a corresponding optical flow vector, use one or more optical flow vectors of the first region to calculate motion to convert the pixel to a valid pixel;
- and
- for each pixel within the second region that lacks a corresponding optical flow vector, iteratively use one or more valid pixels within the overlapping portion comprising the converted pixel to calculate motion to convert each pixel;
- and
- update a flow map to generate a second flow map based at least in part on the conversion of each pixel within the second region that lacks a corresponding optical flow vector.
A system, comprising:
- one or more computers having one or more processors to
- identify at least a first region of an image and a second region of the image that overlap at an overlapping portion;
- for a pixel within the overlapping portion that lacks a corresponding optical flow vector, use one or more optical flow vectors of the first region to calculate motion to convert the pixel to a valid pixel;
- and
- for each pixel within the second region that lacks a corresponding optical flow vector, iteratively use one or more valid pixels within the overlapping portion comprising the converted pixel to calculate motion to convert each pixel;
- and
- update a flow map to generate a second flow map based at least in part on the conversion of each pixel within the second region that lacks a corresponding optical flow vector.
Dependencies are inferred from the claim text.