# US 10,482,652 B2 · Image conversion for signage > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,652 B2 - Document ID: US10482652B2 - Status: Granted - Kind: B2 - Application number: 14/892,581 - Filed: 2014-05-13 - Published: 2016-07-28 - Granted: 2019-11-19 - Earliest claimed: 2013-05-23 - Assignees: Aim Sport AG - Applicants: AIM Sport AG - Inventors: Bernardus de Roos; Daniel Bernard de Roos; Erik Jozef Benoit Hubo - Web page: https://patentgrep.com/patent/US10482652B2 ## CPC - G06T 15/20: Perspective computation - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 17/00: Three-dimensional [3D] modelling for computer graphics - G06T 2200/04: involving 3D image data - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method of image conversion for signage, displaying an image on a display surface, includes determining (1) a shape model of a three-dimensional object, determining (2) geometric properties of a display surface including a position and orientation of the display surface in a space, determining (3) a position of a viewpoint in the space, determining (4) a position and orientation of the shape model in the space, and computing (6) an inverse perspective projection onto the display surface based on the position of the viewpoint, for example the camera position in space, to generate a display image, wherein the display image, when displayed on the display surface and viewed through the viewpoint, appears to show the three-dimensional object with a position and orientation according to the position and orientation of the shape model in the space. ## Claims ### Claim 1 A method of image conversion for signage, comprising: determining a shape model of a three-dimensional object; determining geometric properties of a display surface of a display device, including a position and orientation of the display surface in a space; determining a viewing position in the space; determining a position and orientation of the shape model in the space; determining a shape model of physical objects that are present around the display surface; computing a two-dimensional view of the three-dimensional object and of the shape model of the physical objects around the display surface, as seen from the viewing position, wherein the two-dimensional view shows the three-dimensional object in the context of the physical objects; displaying the two-dimensional view as a preview image of an image that is visible through a camera at the viewing position; computing an inverse perspective projection of at least a part of the object that is visible from the viewing position onto the display surface based on the viewing position to generate a display image, where the display image, when displayed on the display surface and viewed from the viewing position, appears to show the three-dimensional object with a position and orientation according to the position and orientation of the shape model in the space; displaying the display image on the display surface; and capturing an image of the display surface displaying the display image, using the camera at the viewing position. ### Claim 2 (depends on 1) The method of claim 1, wherein the step of computing the inverse perspective projection comprises computing the inverse perspective projection of the two-dimensional view. ### Claim 3 (depends on 2) The method of claim 2, wherein the steps of computing the two-dimensional view and computing the inverse perspective projection are performed repeatedly, using different viewing directions for computing the two-dimensional view, to generate different display images covering different portions of the display surface. ### Claim 4 (depends on 1) The method of claim 1, wherein the three-dimensional object comprises a non-planar object. ### Claim 5 (depends on 4) The method of claim 4, wherein the three-dimensional object comprises a consumable or a 3D logo. ### Claim 6 (depends on 1) The method of claim 1, wherein the three-dimensional object comprises a consumable or a 3D logo. ### Claim 7 (depends on 1) The method of claim 1, wherein the display surface comprises a first portion having at least a first orientation and a second portion having a second orientation, wherein the first orientation is different from the second orientation. ### Claim 8 (depends on 7) The method of claim 7, wherein different copies of the shape model are arranged along the first portion having the first orientation and the second portion having the second orientation, and wherein each orientation of the different copies of the shape model depends on a corresponding local orientation of the first portion and the second portion. ### Claim 9 (depends on 8) The method of claim 8, wherein the position and/or orientation of the shape model in the space is such that the object appears to protrude out of the display surface and in a substantially horizontal direction. ### Claim 10 (depends on 1) The method of claim 1, wherein the step of determining a position and orientation of the shape model comprises receiving an input representing an orientation and/or position of the three-dimensional object from a user interface. ### Claim 11 (depends on 1) The method of claim 1, wherein the display surface is oriented substantially vertically. ### Claim 12 (depends on 1) The method of claim 1, wherein the display surface extends along the perimeter of a sports field or arena. ### Claim 13 (depends on 1) The method of claim 1, further comprising: receiving information whether the camera at the viewing position is active; and wherein the display image is displayed on the display surface on condition that the camera at the viewing position is active. ### Claim 14 A system for image conversion for signage, comprising: a display device comprising a display surface; a camera; a shape unit that determines a shape model of a three-dimensional object; a display unit that determines geometric properties of the display surface of the display device including a position and orientation of the display surface in a space; a viewing position unit that determines a viewing position of the camera in the space, and the shape unit being configured to determine a position and orientation of the shape model in the space; a computing unit that determines a shape model of physical objects that are present around the display surface and computes a two-dimensional view of the three-dimensional object and of the shape model of the physical objects around the display surface, as seen from the viewing position, wherein the two-dimensional view shows the three-dimensional object in the context of the physical objects; and a display that displays the two-dimensional image as a preview image of an image that is visible through the camera, wherein the computing unit also computes an inverse perspective projection of at least a part of the object that is visible from the viewing position onto the display surface based on the viewing position to generate a display image, where the display image, when displayed on the display surface and viewed from the viewing position, appears to show the three-dimensional object with a position and orientation according to the position and orientation of the shape model in the space, wherein the display device is configured to display the display image on the display surface, and wherein the camera is configured to capture an image of the display surface displaying the display image. ### Claim 15 (depends on 1) A computer program product stored on a non-transitory computer readable media, comprising instructions for causing a processor to perform the method of claim 1.