US 2026/0238736 A1 · Method and system for creating digitally augmented camera images containing image data of a LED wall

Abstract

The present invention proposes a method, preferably computer-implemented method, for creating digitally augmented camera images based on camera images captured by a camera, which contain image data of a LED wall displaying LED wall display data, which is contained in computer-rendered scenery image data, the method comprising: rendering scenery image data for a first pose P1 of the camera; sending LED wall display data comprised in the scenery image data to the LED wall for display; capturing, with the camera, a camera image containing image data of the LED wall displaying the LED wall display data at a second pose P2 of the camera; and augmenting the camera image with image augmentation data to obtain an augmented camera image, wherein the image augmentation data is derived from the scenery image data, taking into consideration the second pose P2 of the camera.

Claims8

Dependent claims

A method for creating digitally augmented camera images based on camera images captured by a camera, which contain image data of a LED wall displaying LED wall display data, which is contained in computer-rendered scenery image data, the method comprising:

a) rendering scenery image data for a first pose of the camera;
b) sending LED wall display data comprised in the scenery image data to the LED wall for display;
c) capturing, with the camera, a camera image containing image data of the LED wall displaying the LED wall display data at a second pose of the camera;
and
d) augmenting the camera image with image augmentation data to obtain an augmented camera image, wherein the image augmentation data is derived from the scenery image data, taking into consideration the second pose of the camera;
wherein the image augmentation data is derived from the scenery image data by:
providing a 3D model of the LED wall;
generating an extended 3D model of the LED wall based on the 3D model of the LED wall;
projecting the scenery image data rendered for the first pose of the camera onto the extended 3D model of the LED wall to obtain a textured extended 3D model of the LED wall;
rendering the textured extended 3D model of the LED wall for the second pose of the camera to obtain the image augmentation data.

7 more elements

A digital image processing system for creating digitally augmented camera images with rendered scenery image data that comprises LED wall display data for display on a LED wall and image augmentation data for digitally augmenting camera images containing image data of the LED wall, the digital image processing system being communicatively connectable to a camera and comprising:

a processing unit that is configured to receive information on a first pose of the camera;
communicate information on the first pose of the camera to a rendering engine for rendering scenery image data for the first pose of the camera;
effect communication of LED wall display data comprised in the scenery image data to a LED wall for display thereon;
receive information on a second pose of the camera;
receive a camera image captured by the camera at the second pose of the camera that contains image data of the LED wall displaying the LED wall display data;
augment the camera image with image augmentation data to obtain an augmented camera image, wherein the image augmentation data is derived from the scenery image data, taking into consideration the second pose of the camera;
a storage unit for storing data, for storing a 3D model of the LED wall to be provided to the processing unit, for storing an extended 3D model of the LED wall to be provided to the processing unit, for storing a textured extended 3D model of the LED wall to be provided to the processing unit, and for storing information on the first pose of the camera to be provided to the processing unit for creating the image augmentation data;
wherein the processing unit is configured to derive image augmentation data from the scenery image data by:
generating an extended 3D model of the LED wall based on the 3D model of the LED wall;
projecting the scenery image data rendered for the first pose of the camera onto the extended 3D model of the LED wall to obtain a textured extended 3D model of the LED wall;
and
rendering the textured extended 3D model of the LED wall for the second pose of the camera to obtain the image augmentation data.

9 more elements

Dependencies are inferred from the claim text.

Method and system for creating digitally augmented camera images containing image data of a LED wall

Life of this patent

Method and system for creating digitally augmented camera images containing image data of a LED wall

Life of this patent

Abstract

Claims8