# US 2018/0322818 A1 · Head Tracking Based Depth Fusion > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0322818 A1 - Document ID: US20180322818A1 - Status: Published application - Kind: A1 - Application number: 15/969,984 - Filed: 2018-05-03 - Published: 2018-11-08 - Earliest claimed: 2017-05-04 - Assignees: Pure Depth Limited - Applicants: Pure Depth Inc. - Inventors: Austin F. O'BRIEN - Web page: https://patentgrep.com/patent/US20180322818A1 ## CPC - G09G 3/003: {to produce spatial visual effects} - G06T 15/005: {General purpose rendering architectures} - H04N 13/128: Adjusting depth or disparity - H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes - H04N 13/395: with depth sampling, i.e. the volume being constructed from a stack or sequence of two-dimensional [2D] image planes - G09G 3/3208: organic, e.g. using organic light-emitting diodes [OLED] - G09G 3/36: using liquid crystals - G09G 2300/023: Display panel composed of stacked panels - G09G 2320/028: by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction - G09G 2380/10: Automotive applications - H04N 13/366: using viewer tracking - H04N 2213/002: Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A multi-layer display (MLD) system may include a plurality of display screens including at least first and second display screens arranged in a substantially parallel and overlapping manner, and a processing system comprising at least one processor and memory. The processing system may be configured to render content on and between two MLD layers, such that the content is correctly rendered from the perspective angle of the viewer. ## Claims ### Claim 1 A multi-layer display (MLD) system for displaying three-dimensional images: a multi-layer display unit; and a processing system communicatively coupled to the multi-layer display unit and a head and/or eye tracking device, and comprising at least one processor and memory, the processing system being configured to: obtain one or more images; detect head and/or eye position of a viewer based on information received from the head and/or eye tracking device; generating a virtual simulacrum representing at least the multi-layer display unit and the detected position in relation to the multi-layer display unit; using the generated virtual simulacrum, determine display parameters for displaying an image on the multi-layer display unit; and display, on the multi-layer display unit, at least one image based on the obtained one or more images based on the display parameters. ### Claim 2 (depends on 1) The multi-layer display system according to claim 1, wherein the multi-layer display unit comprises a plurality of display layers including at least first and second display layers arranged in a substantially parallel and overlapping manner, and wherein the processing system is further configured to: generate, from at least one of the obtained one or more images, a first image for displaying on the first display layer and a second image for simultaneously displaying on the second display layer; adjust at least one of the first image or the second image using the determined display parameters; and simultaneously display, after the adjusting, the first image on the first display layer and the second image on the second display layer. ### Claim 3 (depends on 2) The multi-layer display system according to claim 2, wherein said adjusting at least one of the first image or the second image using the determined display parameters includes reskewing, reshaping and/or resizing at least one of the first or second image. ### Claim 4 (depends on 3) The multi-layer display system according to claim 3, wherein the processing system is further configured to determine the display parameters based upon a distance between the first and second display layers. ### Claim 5 (depends on 4) The multi-layer display system according to claim 4, wherein the processing system is further configured to determine the display parameters based upon at least one of a distance and an angle of the detected position in relation to a center of a screen of the multi-layer display unit. ### Claim 6 (depends on 3) The multi-layer display system according to claim 3, wherein the reskewing, reshaping and/or resizing at least one of the first or second image is performed based upon one or more projected images based upon a virtual multi-layer display unit and a virtual camera represented in the virtual simulacrum. ### Claim 7 (depends on 6) The multi-layer display system according to claim 6, wherein the processing system is further configured to, using the generated virtual simulacrum, determine a perspective view based on the detected position, project the perspective view to the virtual multi-layer display unit using the virtual camera, reskew the projected view to align aspects in the first display layer and the second display layer, and to perform said determining the display parameters according to the projecting and/or the reskewing. ### Claim 8 (depends on 7) The multi-layer display system according to claim 7, wherein at least one of the projecting and/or the reskewing is based on a projection matrix associated with the virtual camera associated with the virtual multi-layer display unit. ### Claim 9 (depends on 2) The multi-layer display system according to claim 2, wherein the processing system is configured to perform said obtaining the one or more images concurrently with the detecting. ### Claim 10 (depends on 2) The multi-layer display system according to claim 2, wherein the multi-layer display unit further comprises a light source configured to provide light to at least one of the display screens. ### Claim 11 (depends on 1) The multi-layer display system according to claim 1, wherein the head and/or eye tracking device is attached to the multi-layer display unit. ### Claim 12 A method for displaying three-dimensional images on a multi-layer display (MLD) system comprising a multi-layer display unit and a processing system having at least one processor and memory, the method comprising: obtaining one or more images; detecting head and/or eye position of a viewer based on information received from a head and/or eye tracking device; generating a virtual simulacrum representing at least the multi-layer display unit and the detected position in relation to the multi-layer display unit; using the generated virtual simulacrum, determine display parameters for displaying an image on the multi-layer display unit; and display, on the multi-layer display unit, at least one image based on the obtained one or more images based on the display parameters. ### Claim 13 (depends on 12) The method according to claim 12, further comprising: generating, from at least one of the obtained one or more images, a first image for displaying on a first display layer on a first layer of the multi-layer display unit and a second image for simultaneously displaying on a second display layer arranged in a substantially parallel and overlapping manner to the first display layer; adjusting at least one of the first image or the second image using the determined display parameters; and simultaneously displaying, after the adjusting, the first image on the first display layer and the second image on the second display layer. ### Claim 14 (depends on 13) The method according to claim 13, further comprising utilizing a depth map to affect the overlapping manner of the first and second displayed images through manipulation of transparency. ### Claim 15 (depends on 13) The method according to claim 13, wherein said adjusting at least one of the first image or the second image using the determined display parameters includes reskewing, reshaping and/or resizing at least one of the first or second image. ### Claim 16 (depends on 12) The method according to claim 12, wherein determining display parameters for displaying an image on the multi-layer display unit comprises: logically extending straight lines from the detected head/eye position to a plurality of vertices of a content in the one or more images such that the straight lines are incident on to a plane of the simulacrum; displaying, after the logically extending, the plane on the second display layer. ### Claim 17 A non-transitory computer readable storage medium storing computer program instruction which, when executed by a processor of a multi-layer display (MLD) system comprising a multi-layer display unit for displaying three-dimensional images, causes the multi-layer display system to perform operations comprising: obtaining one or more images; detecting head and/or eye position of a viewer based on information received from a head and/or eye tracking device; generating a virtual simulacrum representing at least the multi-layer display unit and the detected position in relation to the multi-layer display unit; using the generated virtual simulacrum, determine display parameters for displaying an image on the multi-layer display unit; and display, on the multi-layer display unit, at least one image based on the obtained one or more images based on the display parameters.