US 2021/0281813 A1 · SUPER-RESOLUTION DEPTH MAP GENERATION FOR MULTI-CAMERA OR OTHER ENVIRONMENTS

Abstract

A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

Claims20

Dependent claims

A method comprising:

obtaining, using at least one processor, first and second input image frames, the first and second input image frames associated with first and second image planes, respectively;
obtaining, using the at least one processor, a depth map associated with the first input image frame;
and
producing another version of the depth map by performing one or more times:
projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane;
and
adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

4 more elements

An apparatus comprising:

at least one memory configured to store first and second input image frames, the first and second input image frames associated with first and second image planes, respectively;
and
at least one processor configured to:
obtain a depth map associated with the first input image frame;
and
to produce another version of the depth map, one or more times:
project the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane;
and
adjust at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

6 more elements

A non-transitory computer readable medium containing instructions that when executed cause at least one processor to:

obtain first and second input image frames, the first and second input image frames associated with first and second image planes, respectively;
obtain a depth map associated with the first input image frame;
and
to produce another version of the depth map, one or more times:
project the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane;
and
adjust at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

4 more elements

Dependencies are inferred from the claim text.

Super-resolution depth map generation for multi-camera or other environments

Life of this patent

Super-resolution depth map generation for multi-camera or other environments

Life of this patent

Abstract

Claims20