# US 6,304,263 B1 · Three-dimensional display system: apparatus and method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 6,304,263 B1 - Document ID: US6304263B1 - Status: Granted - Kind: B1 - Application number: 09/148,562 - Filed: 1998-09-04 - Granted: 2001-10-16 - Earliest claimed: 1996-06-05 - Assignees: Hyper3D Corp. - Inventors: Alessandro Chiabrera; Bruno Bianco; Jonathan J. Kaufman - Web page: https://patentgrep.com/patent/US6304263B1 ## CPC - G06T 15/10: Geometric effects - H04N 13/111: Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation - H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) - H04N 13/243: using three or more two-dimensional [2D] image sensors - H04N 13/324: Colour aspects - H04N 13/349: Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking (for viewing without the aid of special glasses using fly-eye lenses H04N13/307) - H04N 13/363: using image projection screens (volumetric display H04N13/388) - H04N 13/365: using digital micromirror devices [DMD] - H04N 19/597: specially adapted for multi-view video sequence encoding - G06T 2207/10012: Stereo images - H04N 5/74: Projection arrangements for image reproduction, e.g. using eidophor - H04N 13/307: using fly-eye lenses, e.g. arrangements of circular lenses - H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A three-dimensional scene is reproduced on a specialized light display which offers full multiviewpoint capability and autostereoscopic views. The displayed image is produced using a set of M two-dimensional images of the scene collected at a set of distinct spatial locations. These M two-dimensional images are processed through a specialized mathematical encoding scheme to obtain a set of N×K display-excitation electrical-input signals, where K is the number of pixels in the display, and N≧M is the number of individual light-radiating elements within one pixel. The display is thus comprised of a total of N×K light-radiating elements. Each of the K pixels is adapted for control of their associated radiance patterns. The display is connected for response to the set of N×K display-excitation electrical-input signals. The display provides a multiviewpoint and autostereoscopic three-dimensional image associated with the original three-dimensional scene. An alternative embodiment of the invention is utilized to provide efficient storage and display of 3D computer graphics images. ## Claims ### Claim 1 A method for producing a three-dimensional image of a three-dimensional scene, comprising the steps of: (a) using a set of M two-dimensional views of said three-dimensional scene to produce a set of display-excitation electrical-input signals; and (b) driving a planar display device with said set of display-excitation electrical-input signals to produce said three-dimensional image of said three-dimensional scene wherein said planar display device is comprised of a plurality of pixels driven by said display-excitation electrical-input signals and each pixel within said plurality of pixels is comprised of a plurality of sub-pixels adapted for controlling the radiance pattern from said pixel. ### Claim 2 An apparatus for providing a three-dimensional image of a three-dimensional scene, said apparatus comprising: (a) encoding means for processing a set of M two-dimensional views of said three-dimensional scene to obtain a set of display-excitation electrical-input signals; and, (b) planar display means comprised of a plurality of pixels connected for response to said set of display-excitation electrical-input signals, whereby to produce said three-dimensional image of said three-dimensional scene, wherein each pixel within said plurality of pixels is comprised of a plurality of sub-pixels, said plurality of sub-pixels being adapted for controlling the radiance pattern from each of said pixels within said plurality of pixels. ### Claim 3 (depends on 2) The apparatus according to claim 2, wherein said encoding means obtains said set of display-excitation electrical-input signals using a least-squares solution. ### Claim 4 (depends on 2) The apparatus according to claim 2, wherein said encoding means obtains said set of display-excitation electrical-input signals using a constrained least-squares solution. ### Claim 5 (depends on 2) The apparatus according to claim 2, wherein said encoding means obtains said set of display-excitation electrical-input signals using a weighted least-squares solution. ### Claim 6 (depends on 2) The apparatus according to claim 2, wherein said encoding means obtains said set of display-excitation electrical-input signals using a multiresolution wavelet expansion. ### Claim 7 (depends on 2) The apparatus of claim 2 wherein said encoding means includes means for comparatively evaluating the radiance pattern of said three-dimensional scene with the radiance pattern associated with said planar display means. ### Claim 8 (depends on 2) The apparatus of claim 2 wherein said three-dimensional image comprises an autostereoscopic image. ### Claim 9 (depends on 2) The apparatus of claim 2 wherein said display means includes a reflecting screen. ### Claim 10 (depends on 2) The apparatus of claim 2 wherein said display means includes a grating light valve display device. ### Claim 11 (depends on 2) The apparatus of claim 2 wherein said display means includes an afocal optical system. ### Claim 12 (depends on 2) The apparatus of claim 2 wherein said display means includes a focal optical system. ### Claim 13 (depends on 2) The apparatus of claim 2 wherein said display means includes a reflecting screen and a focal optical system. ### Claim 14 (depends on 2) The apparatus of claim 2 wherein said display means includes a reflecting screen and an afocal optical system. ### Claim 15 (depends on 2) The apparatus of claim 2 wherein said three-dimensional image has only two degrees of freedom. ### Claim 16 (depends on 2) The apparatus of claim 2 wherein said encoding means includes means for equalizing the radiance of said display means with the radiance of the three-dimensional scene. ### Claim 17 (depends on 2) The apparatus of claim 2 wherein said encoding means includes a neural network. ### Claim 18 A method for designing a system used to produce a three-dimensional image of a three-dimensional scene, comprising the steps of: performing a comparative evaluation of the radiance function of said three-dimensional scene and a radiance function associated with a planar display device of said system; and, configuring a component of said system responsive to said comparative evaluation. ### Claim 19 A method for producing a three-dimensional image of a three-dimensional scene, comprising the steps of: (a) using a set of two-dimensional views of said three-dimensional scene to derive a plurality of samples of a first radiance function, said first radiance function associated with said three-dimensional scene at a planar window; (b) determining a quantitative relationship between (i) a second radiance function associated with a planar display and (ii) a set of display-excitation electrical input signals, said planar display comprising a plurality of pixels and each of said pixels comprising a plurality of sub-pixels; (c) generating said set of display-excitation electrical-input signals using said quantitative relationship and said first radiance function, said set of display-excitation electrical-input signals configured to minimize an error between said first and second radiance functions; and, (d) controlling said planar display responsive to said set of display-excitation electrical input signals whereby to set said second radiance function about equal to said first radiance function and produce said three-dimensional image of said three-dimensional scene. ### Claim 20 (depends on 19) The method of claim 19 wherein said controlling step includes the substep of controlling the radiance of each of said pixels of said planar display responsive to said set of display-excitation electrical input signals. ### Claim 21 (depends on 20) The method of claim 20 wherein said substep of controlling the radiance of each of said pixels includes the substep of adjusting the intensity of each of said sub-pixels of each of said pixels responsive to said set of display-excitation electrical-input signals. ### Claim 22 An apparatus for producing a three-dimensional image of a three-dimensional scene, comprising: (a) means for deriving a plurality of samples of a first radiance function using a set of two-dimensional views of said three-dimensional scene, said first radiance function associated with said three-dimensional scene at a planar window; (b) means for determining a quantitative relationship between (i) a second radiance function associated with a planar display and (ii) a set of display-excitation electrical input signals, said planar display comprising a plurality of pixels and each of said pixels comprising a plurality of sub-pixels; (c) means for generating said set of display-excitation electrical-input signals using said quantitative relationship and said first radiance function, said set of display-excitation electrical-input signals configured to minimize an error between said first and second radiance functions; and, (d) means for controlling said planar display responsive to said set of display-excitation electrical input signals whereby to set said second radiance function about equal to said first radiance function and produce said three-dimensional image of said three-dimensional scene. ### Claim 23 (depends on 22) The apparatus of claim 22 wherein said controlling means includes means for controlling the radiance of each of said pixels of said planar display responsive to said set of display-excitation electrical input signals. ### Claim 24 (depends on 22) The apparatus of claim 22 wherein said means for controlling the radiance of each of said pixels includes means for adjusting the intensity of each of said sub-pixels of each of said pixels responsive to said set of display-excitation electrical-input signals.