Image synthesis system
AssigneeSpookfish Innovations PTY LTD
InventorsSimon Cope, Peter Kovesi, Jianzhong Xiao
Life of this patent
Estimating the term…
Abstract
Image synthesis system are disclosed for synthesizing a global shutter image based on a rolling shutter image. The rolling shutter image is captured by an aerial camera system having at least one rolling shutter camera and the rolling shutter image has a plurality of scanlines, the scanlines having associated different position and pose information. The image synthesis system is arranged to project a rolling shutter image captured by a rolling shutter camera to object space, such as by projecting each scanline of the rolling shutter image using position and pose information associated with the scanline, and subsequently from object space to a synthetic global shutter image.
Claims20
An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:
- project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to a 3D object space, the 3D object space including information indicative of height of features in the 3D object space, by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by ray tracing each pixel of the rolling shutter image from the rolling shutter image to the 3D object space;
- and
- project, subsequently, from the 3D object space to a synthetic global shutter image by ray tracing each pixel from the 3D object space to the synthetic global shutter image.
An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:
- project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to a 3D object space, the 3D object space including information indicative of height of features in the 3D object space, by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center;
- project, subsequently, from the 3D object space to a synthetic global shutter image;
- define multiple synthetic global shutter image portions based on the synthetic global shutter image;
- and,
- select a different position and pose for each synthetic global shutter image portion that reduces a residual perspective error for the synthetic global shutter image portion.
An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:
- project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to a 3D object space, the 3D object space including information indicative of height of features in the 3D object space, by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by projecting a subset of pixels of the rolling shutter image to the 3D object space;
- project, subsequently, from the 3D object space to a synthetic global shutter image by projecting a subset of pixels from the 3D object space to the synthetic global shutter image;
- and
- interpolate between the pixels projected to the synthetic global shutter image to determine other pixels of the synthetic global shutter image.
An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:
- project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to a 3D object space, the 3D object space including information indicative of height of features in the 3D object space, by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by projecting the rolling shutter image onto a triangulated mesh representing a relevant portion of the 3D object space;
- and
- project, subsequently, from the 3D object space to a synthetic global shutter image by rendering from the 3D object space to the synthetic global shutter image.
Dependencies are inferred from the claim text.