Image synthesis system

An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:

• use an elevation dataset to define a 3D object space that includes information indicative of height of features in object space;
• project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to the 3D object space by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by projecting a subset of pixels of the rolling shutter image to the 3D object space;
• project, subsequently, from the 3D object space to a synthetic global shutter image by projecting a subset of pixels from the 3D object space to the synthetic global shutter image;
• and
• interpolate between the pixels projected to the synthetic global shutter image to determine other pixels of the synthetic global shutter image.

An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:

• use an elevation dataset to define a 3D object space that includes information indicative of height of features in object space;
• project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to the 3D object space by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by projecting the rolling shutter image onto a triangulated mesh representing a relevant portion of the 3D object space;
• and
• project, subsequently, from the 3D object space to a synthetic global shutter image by rendering from the 3D object space to the synthetic global shutter image.

An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:

• use an elevation dataset to define a 3D object space that includes information indicative of height of features in object space;
• project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to the 3D object space by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center;
• project, subsequently, from the 3D object space to a synthetic global shutter image;
• define multiple synthetic global shutter image portions based on the synthetic global shutter image;
• and,
• select a different position and pose for each synthetic global shutter image portion that reduces a residual perspective error for the synthetic global shutter image portion.

A method of synthesizing a global shutter image based on a rolling shutter image, the method comprising:

• using an elevation dataset to define a 3D object space that includes information indicative of height of features in object space;
• projecting a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having different associated position and pose information, to the 3D object space by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by ray tracing each pixel of the rolling shutter image from the rolling shutter image to the 3D object space;
• and
• projecting, subsequently, from the 3D object space to a synthetic global shutter image, by ray tracing each pixel from the 3D object space to the synthetic global shutter image.

A method of synthesizing a global shutter image based on a rolling shutter image, the method comprising:

• using an elevation dataset to define a 3D object space that includes information indicative of height of features in object space;
• projecting a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having different associated position and pose information, to the 3D object space by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by projecting a subset of pixels of the rolling shutter image to the 3D object space;
• projecting, subsequently, from the 3D object space to a synthetic global shutter image by projecting a subset of pixels from the 3D object space to the synthetic global shutter image;
• and
• interpolating between the pixels projected to the synthetic global shutter image to determine other pixels of the synthetic global shutter image.

A method of synthesizing a global shutter image based on a rolling shutter image, the method comprising:

• using an elevation dataset to define a 3D object space that includes information indicative of height of features in object space;
• projecting a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having different associated position and pose information, to the 3D object space by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by projecting the rolling shutter image onto a triangulated mesh representing a relevant portion of the 3D object space;
• and
• projecting, subsequently, from the 3D object space to a synthetic global shutter image by, and rendering from the 3D object space to the synthetic global shutter image.

A method of synthesizing a global shutter image based on a rolling shutter image, the method comprising:

• using an elevation dataset to define a 3D object space that includes information indicative of height of features in object space;
• projecting a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having different associated position and pose information, to the 3D object space by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center;
• projecting, subsequently, from the 3D object space to a synthetic global shutter image;
• defining multiple synthetic global shutter image portions based on the synthetic global shutter image;
• and
• selecting a different position and pose for each synthetic global shutter image portion that reduces a residual perspective error for the synthetic global shutter image portion.