# US 12,192,686 B2 · Method and apparatus for remapping pixel locations > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,686 B2 - Document ID: US12192686B2 - Status: Granted - Kind: B2 - Application number: 18/503,033 - Filed: 2023-11-06 - Published: 2024-02-29 - Granted: 2025-01-07 - Earliest claimed: 2018-11-19 - Assignees: Flightsafety International Inc. - Applicants: Flightsafety International Inc. - Inventors: David Michael Emig; Brock Alan Ebert; Terry Richard Linn - Web page: https://patentgrep.com/patent/US12192686B2 ## CPC - H04N 9/317: {Convergence or focusing systems (electronic adjustment of convergence H04N9/3185; convergence or focusing arrangements for cathode ray tubes H04N9/28; means for automatic focusing of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/53)} - G02B 13/08: Anamorphotic objectives - G02B 27/0911: {Anamorphotic systems} - G03B 21/10: Projectors with built-in or built-on screen - G03B 37/06: involving anamorphosis (G03B37/02, G03B37/04 take precedence) - G06T 3/18: Image warping, e.g. rearranging pixels individually - G09B 9/32: by projected image ({G09B9/307,} G09B9/36 take precedence) - H04N 9/3185: {Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14)} - H04N 9/3188: {Scale or resolution adjustment (scaling in general G06T3/40; resolution modifying circuits for displays in general G09G5/391)} - G02B 26/0825: {the reflecting element being a flexible sheet or membrane, e.g. for varying the focus (flexible mirrors for cosmetic use A45D42/24)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract An apparatus and method for optically remapping projected pixels to maximize the utilization and to optimize the distribution of remapped projection pixels to achieve optimal visual performance (generally uniform resolution and luminance). A device interposed between a projector and an imaging surface for optically remapping projected pixel locations with minimal aberration. When this device is interposed between a projector and an imaging surface, it changes the terminal location of each focused pixel such that it maximally coincides with the imaging surface, which is often a surface of complex curvature and very different from the native focal surface of the projector. One implementation of the technology includes a device that uses multiple optical surfaces. ## Claims ### Claim 1 A method for optically remapping pixels of an image onto a display screen of a simulator, comprising: projecting a frustum of light comprising the image from an origin point of a projector of the simulator along an optical path to a design eye point of the simulator, the frustum being rectangular and comprising: a first axis that is oriented approximately horizontally, the first axis comprising a first magnitude; and a second axis that is oriented approximately vertically, the second axis comprising a second magnitude that is less than the first magnitude; refracting the image with a refractive lens positioned in the optical path between the projector and the display screen; reflecting the image with a reflective surface of a reflective element positioned in the optical path between the refractive lens and the display screen; and projecting the image onto a display surface of the display screen, wherein the display surface is curved and is positioned in the optical path between the reflective element and the design eye point, wherein a pixel density of the image on the display surface is uniform, and wherein the display surface comprises: a first arc that is oriented approximately horizontally, the first arc having a first length; and a second arc that is oriented approximately vertically, the second arc having a second length that is less than the first length. ### Claim 2 (depends on 1) The method of claim 1, wherein the display screen is convex. ### Claim 3 (depends on 1) The method of claim 1, further comprising interposing a collimating mirror in the optical path between the design eye point and the display screen, wherein the image on the display surface is viewable in the collimating mirror from the design eye point. ### Claim 4 (depends on 1) The method of claim 1, wherein a horizontal field of view of the display screen exceeds 180 degrees, and wherein the display screen is a section of one of an ellipsoid, a toroid, and a minor variation from the ellipsoid or toroid. ### Claim 5 (depends on 1) The method of claim 1, further comprising arranging the refractive lens and/or the projector such that a center of curvature of the refractive lens is approximately coincident with the origin point of the projector. ### Claim 6 (depends on 1) The method of claim 1, wherein the refractive lens has an optical surface comprising one or more of: a shape of a freeform; and a Gaussian curvature of approximately zero. ### Claim 7 (depends on 1) The method of claim 1, further comprising adjusting the refractive lens by altering its optical effect. ### Claim 8 (depends on 1) The method of claim 1, further comprising adjusting an optical effect of the reflective element by changing the reflective surface to a freeform shape, wherein adjusting the optical effect of the reflective element includes one or more of mechanical deformation and thermal deformation of the reflective surface, and wherein the reflective surface is configured to provide anisotropic magnification of the image. ### Claim 9 (depends on 1) The method of claim 1, further comprising orienting the refractive lens such that a longest dimension of its focal surface is substantially orthogonal to a longest dimension of the reflective surface of the reflective element. ### Claim 10 A display system, comprising: a projector to project a frustum of light comprising an image from an origin point of the projector along an optical path to a design eye point of the display system, the frustum being rectangular and comprising: a first axis that is oriented approximately horizontally, the first axis comprising a first magnitude; and a second axis that is oriented approximately vertically, the second axis comprising a second magnitude that is less than the first magnitude; a refractive lens to refract the image, the refractive lens positioned in the optical path between the projector and the design eye point; a reflective element with a reflective surface to reflect the image, the reflective element positioned in the optical path between the refractive lens and the design eye point; and a display screen with a display surface, wherein the display surface is curved and is positioned in the optical path between the reflective element and the design eye point, wherein when the image is projected onto the display surface, a pixel density of the image is uniform, and wherein the display surface comprises: a first arc that is oriented approximately horizontally, the first arc having a first length; and a second arc that is oriented approximately vertically, the second arc having a second length that is less than the first length. ### Claim 11 (depends on 10) The display system of claim 10, wherein the display screen is convex. ### Claim 12 (depends on 10) The display system of claim 10, further comprising a collimating mirror interposed in the optical path between the design eye point and the display screen, wherein the image projected onto the display surface is viewable in the collimating mirror from the design eye point. ### Claim 13 (depends on 10) The display system of claim 10, wherein a horizontal field of view of the display screen exceeds 180 degrees, and wherein the display screen is a section of one of an ellipsoid, a toroid, and a minor variation from the ellipsoid or toroid. ### Claim 14 (depends on 10) The display system of claim 10, wherein one or more of the following is true: the refractive lens comprises a focal surface encompassing a location of a vertex of the frustum when it is projected by the projector; and a center of curvature of the refractive lens is approximately coincident with the origin point of the projector. ### Claim 15 (depends on 10) The display system of claim 10, wherein the refractive lens has an optical surface comprising one or more of: a shape of a freeform; and a Gaussian curvature of approximately zero. ### Claim 16 (depends on 10) The display system of claim 10, wherein an optical effect of the refractive lens is adjustable. ### Claim 17 (depends on 10) The display system of claim 10, wherein the reflective element is configured such that one or more of the following are true: an optical effect of the reflective element is adjustable; and the reflective surface provides anisotropic magnification of the image. ### Claim 18 (depends on 17) The display system of claim 17, wherein the optical effect of the reflective element is adjustable by one or more of mechanical deformation and thermal deformation of the reflective surface of the reflective element. ### Claim 19 (depends on 10) The display system of claim 10, wherein the reflective surface of the reflective element is adjustable to a freeform shape. ### Claim 20 (depends on 10) The display system of claim 10, wherein a longest dimension of a focal surface of the refractive lens is oriented substantially orthogonal to a longest dimension of the reflective surface of the reflective element.