# US 2013/0155060 A1 · Method for setting a system for projecting an image onto a relief projection surface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0155060 A1
- Document ID: US20130155060A1
- Status: Published application
- Kind: A1
- Application number: 13/713,925
- Filed: 2012-12-13
- Published: 2013-06-20
- Earliest claimed: 2011-12-16
- Assignees: Commissariat A L'energie Atomique Et Aux Energies Alternatives
- Inventors: Gorka Arrizabalaga; Jean-Francois Mainguet
- Web page: https://patentgrep.com/patent/US20130155060A1

## CPC

- G06T 15/00: Three-dimensional [3D] image rendering
- G06T 7/33: using feature-based methods
- G06T 7/73: using feature-based methods
- H04N 9/3185: {Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14)}
- H04N 9/3194: {including sensor feedback}
- H04N 13/363: using image projection screens (volumetric display H04N13/388)
- G06T 2200/04: involving 3D image data
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for displaying an image onto a relief projection surface using a projection system includes the automatic measurement, using a fixed camera, of the distance separating virtual reference frame points projected onto the projection surface, from real reference frame points produced on a three-dimensional screen to set the projection system, acquisition, by the same fixed camera as that used during the setting of the projection system, of an image of a rear face of the three-dimensional screen, identification of the position of a finger in contact with a front face of the three-dimensional screen in the acquired image, and control of an appliance according to the identified position of the finger.

## Claims

### Claim 1

A method for displaying an image onto a relief projection surface using a projection system, the method comprising setting the projection system to obtain and save a value of a setting parameter thereof, defining one of colors and textures for individual facets of a computer model defining the relief projection surface, constructing an image to be projected according to the computer model of at least one of the colors and textures defined for the individual facets and of the saved value of the setting parameter, and projecting the constructed image onto a projection surface of a three-dimensional screen produced in a translucent material, the screen comprising a front face on which the projected image is displayed and a rear face forming the projection surface, wherein setting the projection system comprises automatically measuring, using a fixed camera, a distance separating virtual reference frame points projected onto the projection surface from real reference frame points produced on the three-dimensional screen, the method further comprising acquiring, using the fixed camera, an image of the rear face of the three-dimensional screen, identifying a position of a finger in contact with the front face of the three-dimensional screen in the acquired image, and controlling an appliance according to the identified position of the finger.

### Claim 2 (depends on 1)

The method of claim 1, wherein setting the projection system comprises saving a computer model defining the relief projection surface and positions of at least four virtual reference frame points on the projection surface, producing the three-dimensional screen comprising the projection surface defined by the computer model and the real reference frame points fixed with no degree of freedom on the projection surface at the positions of the virtual reference frame points defined by the computer model, constructing an image containing the virtual reference frame points based at least in part on the computer model and a value chosen for the setting parameter of the projection system, using a projector, projecting the constructed image onto the projection surface, automatically measuring the distance separating, on the projection surface, the projected virtual reference frame points from the real reference frame points, if the measured distance is greater than a predetermined threshold, automatically modifying the value of the setting parameter to reduce the distance and reiteration of the constructing step, the projection step, the automatic measurement step, and the automatic modification step, and if the measured distance is less than the predetermined threshold, saving the value of the setting parameter for use in a subsequent projection of an image onto the projection surface.

### Claim 3 (depends on 1)

The method of claim 1, wherein the setting parameter corresponds to the position of the computer model in a reference frame linked with no degree of freedom to the projector.

### Claim 4 (depends on 1)

The method of claim 1, wherein measuring the distance comprises acquiring the image of the real reference frame points using the fixed camera and identifying the the real reference frame points in the image, acquiring the image of the virtual reference frame points projected onto the projection surface using the fixed camera and identifying the virtual reference frame points in the image, automatically associating each real point identified in the acquired image with a corresponding virtual point identified in the acquired image, and computing the distance separating the real points from the corresponding virtual points based at least in part on the coordinates of the real points in the acquired image and the coordinates of the virtual points in the acquired image.

### Claim 5 (depends on 1)

The method of claim 1, further comprising repeatedly executing the steps of constructing the image according to the computer model, of one of the colors and textures defined for the individual facets and of the value saved for the setting parameter, the constructed image also comprising the virtual reference frame points, projecting the constructed image, and setting the projection system on the basis of the projected constructed image so as to automatically adapt the projected image to a movement of the three-dimensional screen.

### Claim 6 (depends on 1)

The method of claim 1, wherein the image constructed according to the computer model has no virtual reference frame points.

### Claim 7 (depends on 2)

The method of claim 2, further comprising producing a mold based at least in part on the computer model of the projection surface, the mold comprising suction holes at each position of a virtual reference frame point, applying a plate of thermo-formable material to the mold by suction through the suction holes of air pockets present between the plate and the mold, and forming the real reference frame points by suction of the thermo-formable material into the suction holes.

### Claim 8 (depends on 1)

A non-transitory and tangible information storage medium comprising instructions for execution of a method according to claim 1, the instructions being configured for execution by an electronic computer.

### Claim 9

An apparatus for displaying a three-dimensional image, the system comprising a projector suitable for projecting an image onto a relief projection surface, an electronic memory containing a computer model defining the relief projection surface and positions of at least four virtual reference frame points on the relief projection surface, a three-dimensional screen produced in a translucent material, the screen comprising a front face on which is displayed the projected image and a rear face forming the projection surface, and real reference frame points that are fixed, with no degree of freedom, on the projection surface at the positions of the virtual reference frame points defined by the computer model, and an electronic computer programmed to construct an image containing the virtual reference frame points based at least in part on the computer model and a value chosen for at least one parameter of the projection system that can be set, and to control the projection of the constructed image onto the projection surface, by the projector, an electronic measuring instrument for measuring a distance separating, on the projection surface, the projected virtual reference frame points from the real reference frame points, the electronic measuring instrument comprising a fixed camera, and wherein the computer is further programmed for automatically setting the value of the setting parameter of the projection system according to the distance measured by the electronic instrument, acquiring, by the fixed camera, an image of the rear face of the three-dimensional screen, identifying a position of a finger in contact with the front face of the three-dimensional screen in the acquired image, and controlling an appliance according to the identified position of the finger.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the computer is further programmed to, if the measured distance is greater than a predetermined threshold, automatically modify the value of the setting parameter to reduce the distance, and to, if the measured distance is less than the predetermined threshold, save the value of the setting parameter for use in a subsequent projection of an image onto the projection surface by the projection system.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the real reference frame points are cavities, the depths of which are greater than 0.5 mm.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the real reference frame points are cavities, the depths of which are greater than 1 mm.

### Claim 13 (depends on 9)

The apparatus of claim 9, wherein the real reference frame points are bumps, the heights of which are greater than 0.5 mm.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the real reference frame points are bumps, the heights of which are greater than 1 mm.
