Mesh stitching for motion estimation and depth from stereo
AssigneeQUALCOMM Incorporated
InventorsSamuel Benjamin Holmes, Jonathan Wicks
Life of this patent
Estimating the term…
Abstract
This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for mesh stitching for motion estimation and depth from stereo. A processor may obtain an indication of a mesh associated with a set of motion vectors for a first frame and a second frame in a plurality of frames. The processor may detect a set of regions in the mesh including a set of motion disparity values associated with the set of motion vectors, where each motion disparity value in the set of motion disparity values is less than a coherency threshold. The processor may calculate an adjustment to the mesh based on the region. The processor may output an indication of the adjustment to the mesh.
Claims30
An apparatus for graphics processing, comprising:
- a memory;
- and
- a processor coupled to the memory and, based on information stored in the memory, the processor is configured to:
- obtain an indication of a mesh associated with a set of motion vectors for a first frame and a second frame in a plurality of frames;
- detect a set of regions in the mesh including a set of motion disparity values associated with the set of motion vectors, wherein each motion disparity value in the set of motion disparity values is less than a coherency threshold and wherein the set of motion disparity values includes at least one of:
- a set of motion values associated with a set of vectors for a map of a motion difference between the first frame and the second frame;
- or
- a set of disparity values associated with a stereo offset between a left-eye image and a right-eye image, wherein the left-eye image and the right-eye image are associated with one or more frames of the plurality of frames;
- calculate an adjustment to the mesh based on the set of regions;
- and
- output an indication of the adjustment to the mesh.
A method of graphics processing, comprising:
- obtaining an indication of a mesh associated with a set of motion vectors for a first frame and a second frame in a plurality of frames;
- detecting a set of regions in the mesh including a set of motion disparity values associated with the set of motion vectors, wherein each motion disparity value in the set of motion disparity values is less than a coherency threshold and wherein the set of motion disparity values includes at least one of:
- a set of motion values associated with a set of vectors for a map of a motion difference between the first frame and the second frame;
- or
- a set of disparity values associated with a stereo offset between a left-eye image and a right-eye image, wherein the left-eye image and the right-eye image are associated with one or more frames of the plurality of frames;
- calculating an adjustment to the mesh based on the region;
- and
- outputting an indication of the adjustment to the mesh.
A computer-readable medium storing computer executable code, the computer executable code, when executed by a processor, causes the processor to:
- obtain an indication of a mesh associated with a set of motion vectors for a first frame and a second frame in a plurality of frames;
- detect a set of regions in the mesh including a set of motion disparity values associated with the set of motion vectors, wherein each motion disparity value in the set of motion disparity values is less than a coherency threshold and wherein the set of motion disparity values includes at least one of:
- a set of motion values associated with a set of vectors for a map of a motion difference between the first frame and the second frame;
- or
- a set of disparity values associated with a stereo offset between a left-eye image and a right-eye image, wherein the left-eye image and the right-eye image are associated with one or more frames of the plurality of frames;
- calculate an adjustment to the mesh based on the set of regions;
- and
- output an indication of the adjustment to the mesh.
Dependencies are inferred from the claim text.