# US 2013/0293516 A1 · Touch Sensitive Holographic Displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0293516 A1
- Document ID: US20130293516A1
- Status: Published application
- Kind: A1
- Application number: 13/934,223
- Filed: 2013-07-03
- Published: 2013-11-07
- Earliest claimed: 2008-12-24
- Assignees: Light Blue Optics Ltd.
- Inventors: Nicholas A. Lawrence; Paul R. Routley; Adrian J. Cable
- Web page: https://patentgrep.com/patent/US20130293516A1

## CPC

- G06F 3/042: by opto-electronic means
- G03H 1/0005: {Adaptation of holography to specific applications (holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042)}
- G03H 1/2205: {using downstream optical component}
- G03H 1/2294: {Addressing the hologram to an active spatial light modulator}
- G06F 1/3231: Monitoring the presence, absence or movement of users
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06F 3/0426: {tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886)}
- G06Q 50/12: Hotels or restaurants
- G03H 2001/0061: {in haptic applications when the observer interacts with the holobject}
- G03H 2001/2213: {Diffusing screen revealing the real holobject, e.g. container filed with gel to reveal the 3D holobject}
- G03H 2001/2215: {Plane screen}
- G03H 2001/2221: {Screen having complex surface, e.g. a structured object}
- G03H 2001/2271: {RGB holobject}
- G03H 2210/22: 2D SLM object wherein the object beam is formed of the light modulated by the SLM
- G03H 2210/441: Numerical processing applied to the object data other than numerical propagation
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00})
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

We describe a touch sensitive holographic image display device for holographically projecting a touch sensitive image at an acute angle onto a surface on which the device is placed. The device includes holographic image projection optics comprising at least one coherent light source illuminating a spatial light modulator (SLM), output optics to project a hologram onto an acute angle surface, and a remote touch sensing system to remotely detect a touch of a location within or adjacent to the holographically displayed image. A control system is configured to provide data defining an image for display, to receive detected touch data, and to control the device responsive to remote detection of a touch of a the displayed image.

## Claims

### Claim 1

(canceled)

### Claim 2

A touch sensitive image display device for projecting a touch sensitive displayed image at an acute angle onto a surface, the device comprising:
image projection optics comprising at least one light source;
a remote touch sensing system to remotely detect a touch of a location within or adjacent to said displayed image and having a touch data output to provide detected touch data; and
a display system to drive said image projection optics;
wherein the device further comprises:
an image data input to receive image data defining an image for display;
wherein said image projection optics comprises a spatial light modulator (SLM) illuminated by said light source and output optics to project modulated light from said SLM onto said surface at said acute angle; and
wherein said display system includes memory for storing said data defining said image for display and an output for driving said SLM to display data on said SLM to replay said displayed image on said surface; and
wherein said remote touch sensing system further comprises a touch imaging sensor, and a system to:
input touch location data from said touch imaging sensor for identifying said detected touch of a location;
apply anti-distortion processing to convert said touch location data to provide anti-distorted detected touch data; and
provide said anti-distorted detected touch data to said touch data output for input to said display system.

### Claim 3 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said remote touch sensing system is an optical remote touch sensing system comprising infrared illumination optics to provide illumination in a region above said surface on which said image is displayed, and wherein said touch imaging sensor is configured to detect light from touching said displayed image through said illuminated region.

### Claim 4 (depends on 3)

A touch sensitive image display device as claimed in claim 3 wherein said illuminated region comprises a sheet above said surface, and wherein said touch imaging sensor is configured to detect scattered light from said sheet.

### Claim 5 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said touch imaging sensor comprises a sensor for optical time-of-flight ranging.

### Claim 6 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said anti-distortion processing is configured to compensate for distortion of said position of said detected touch in relation to said displayed image arising from said acute angle projection.

### Claim 7 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said display system further comprises a processor configured to:
input said image data;
convert said image data to target image data;
generate, from said target image data, data for display on said spatial light modulator to reproduce a target image corresponding to said target image data; and
output said data for said spatial light modulator;
wherein said target image is distorted to compensate for said projection at said acute angle to form said displayed image.

### Claim 8 (depends on 7)

A touch sensitive image display device as claimed in claim 7 wherein the device is configured to, in operation, rest against said surface with said output optics at a defined height from said surface, and wherein said distortion of said target image and said anti-distortion of said remote touch sensing system compensates for a combination of said acute angle and said defined height.

### Claim 9 (depends on 7)

A touch sensitive image display device as claimed in claim 7, wherein said conversion of said input image data to said target image data comprises mapping pixels of said target image data to pixels of said input image data and looking up values for said pixels of said target image data in said input image data.

### Claim 10 (depends on 7)

A touch sensitive image display device as claimed in claim 7, wherein said conversion of said input image data to said target image data comprises mapping pixels of said input image data to pixels of said target image data such that a plurality of pixels of said target image data have values dependent on a single pixel of said input image data; and additionally or alternatively such that a single pixel of said target image data has a value dependent on values of a plurality of pixels of said input image data.

### Claim 11 (depends on 7)

A touch sensitive image display device as claimed in claim 7 wherein said conversion of said input image data to said target image data further comprises compensating for variations in per unit area brightness of said image due to said acute angle protection.

### Claim 12 (depends on 7)

A touch sensitive image display device as claimed in claim 7 wherein said projected image comprises a multicolor image, wherein said illumination system comprises a multicolor illumination system, wherein said conversion of said input image data to said target image data comprises compensating for different scaling of different color components of said multicolor projected image due to said projection.

### Claim 13 (depends on 12)

A touch sensitive image display device as claimed in claim 12 wherein said compensating further comprises compensating for different aberrations of said different color components by spatial mapping of said aberrations for a said color component.

### Claim 14 (depends on 7)

A touch sensitive image display device as claimed in claim 7 wherein said processor is configured to generate, from said target image data, data for display by omitting to process portions of target image space in which said target image data is located from which data for said image is absent.

### Claim 15 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said remote touch sensing system is configured to apply said anti-distortion processing to convert said touch location data to rectangular x-y co-ordinates and to provide anti-distorted detected touch data in said rectangular x-y co-ordinates.

### Claim 16 (depends on 2)

A touch sensitive image display device as claimed in claim 2 configured to display a calibration image to enable a user to calibrate positions of one or more touch sensitive locations on said displayed image to configure said anti-distortion processing.

### Claim 17 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said remote touch sensing system comprises an optical remote touch sensing system which shares part of said image projection optics.

### Claim 18 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said spatial light modulator is a reflective spatial light modulator (SLM), and wherein said projection optics defines two antiparallel optical paths for said light, one towards and one away from said reflective SLM via a shared beamsplitter.

### Claim 19 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said projection optics comprises an off-axis lens.

### Claim 20 (depends on 2)

A touch sensitive image display device as claimed in claim 2 wherein said remote touch sensing system further comprises a system to determine an action responsive to said anti-distorted touch data.

### Claim 21 (depends on 2)

A remote touch sensing system for the touch sensitive image display device of claim 2, the system comprising:
a touch imaging sensor, and a system to:
input touch location data from said touch imaging sensor for identifying said detected touch of a location;
apply anti-distortion processing to convert said touch location data to provide anti-distorted detected touch data; and
provide said anti-distorted detected touch data to said touch data output for input to said display system.
