US 12,586,310 B2 · Apparatus and method with image processing

Abstract

A processor-implemented method includes obtaining a first motion matrix corresponding to an extended reality (XR) system and a second motion matrix based on a conversion coefficient from an XR system coordinate system into a rolling shutter (RS) camera coordinate system, and projecting an RS color image of a current frame onto a global shutter (GS) color image coordinate system based on the second motion matrix and generating a GS color image of the current frame, wherein the second motion matrix is a motion matrix of a timestamp of a depth image captured by a GS camera corresponding to a timestamp of a first scanline of an RS color image captured by the GS camera.

Claims20

Dependent claims

A processor-implemented method, the method comprising:

obtaining a first motion matrix corresponding to an extended reality (XR) system and a second motion matrix based on a conversion coefficient from an XR system coordinate system into a rolling shutter (RS) camera coordinate system, the second motion matrix is a motion matrix of a timestamp of a depth image captured by a GS camera corresponding to a timestamp of a selected scanline among a plurality of scanlines of an RS color image captured by an RS camera, and the depth image is selected based on temporal correspondence with the selected scanline;
and
generating a GS color image of a current frame by projecting an RS color image of the current frame onto a global shutter (GS) color image coordinate system based on the second motion matrix.

An electronic device comprising:

one or more processors configured to:
obtain a first motion matrix corresponding to an extended reality (XR) system and a second motion matrix based on a conversion coefficient from an XR system coordinate system into a rolling shutter (RS) camera coordinate system, the second motion matrix is a motion matrix of a timestamp of a depth image captured by a GS camera corresponding to a timestamp of a selected scanline among a plurality of scanlines of an RS color image captured by an RS camera;
and
generate a GS color image of a current frame by projecting an RS color image of the current frame onto a global shutter (GS) color image coordinate system based on the second motion matrix.

1 more element

Dependencies are inferred from the claim text.

Apparatus and method with image processing

Life of this patent

Apparatus and method with image processing

Life of this patent

Abstract

Claims20