# US 2015/0177906 A1 · Method for reducing perceived optical distortion > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2015/0177906 A1 - Document ID: US20150177906A1 - Status: Published application - Kind: A1 - Application number: 14/320,041 - Filed: 2014-06-30 - Published: 2015-06-25 - Earliest claimed: 2013-06-28 - Assignees: Tactus Technology, Inc. - Applicants: Tactus Technology, Inc. - Inventors: Micah B. Yairi; Radhakrishnan Parthasarathy - Web page: https://patentgrep.com/patent/US20150177906A1 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06T 3/02: Affine transformations (for image registration G06T3/147; for image mosaicing G06T3/4038) - G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) - G09G 5/003: {Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto (specific for a CRT G09G1/165; for a flat panel G09G3/2092)} - G09G 2320/028: by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract One variation of a method for reducing perceived optical distortion of light output through a dynamic tactile interface includes: rendering an image on a digital display coupled to a substrate opposite a tactile layer, the tactile layer defining a tactile surface, a peripheral region, and a deformable region adjacent the peripheral region, disconnected from the substrate, and operable between a retracted setting and an expanded setting, the deformable region substantially flush with the peripheral region in the retracted setting and offset above the peripheral region in the expanded setting; estimating a viewing position of a user relative to the digital display; transitioning the deformable region from the retracted setting into the expanded setting; and modifying the portion of the image rendered on the digital display according to the estimated viewing position of the user and a profile of the tactile surface across the deformable region in the expanded setting. ## Claims ### Claim 1 A method for reducing perceived optical distortion of light output through a dynamic tactile interface, the method comprising: rendering an image on a digital display coupled to a substrate opposite a tactile layer, the substrate and the tactile layer substantially transparent, the tactile layer defining a tactile surface, a peripheral region, and a deformable region, the peripheral region adjacent the deformable region and coupled to the substrate opposite the tactile surface, the deformable region disconnected from the substrate and operable between a retracted setting and an expanded setting, the tactile surface at the deformable region substantially flush with the tactile surface at the peripheral region in the retracted setting and offset above the tactile surface at the peripheral region in the expanded setting; estimating a viewing position of a user relative to the digital display; transitioning the deformable region from the retracted setting into the expanded setting; and modifying the portion of the image rendered on the digital display according to the estimated viewing position of the user and a profile of the tactile surface across the deformable region in the expanded setting. ### Claim 2 (depends on 1) The method of claim 1, wherein rendering the image on the digital display comprises rendering a first frame comprising an icon for an input key of a computing device coupled to the dynamic tactile interface, the icon substantially aligned with the deformable region in the retracted setting in the first frame; and wherein modifying the portion of the image comprises generating a second frame comprising a scaled and translated version of the icon and rendering the second frame on the digital display in response to transitioning the deformable region into the expanded setting. ### Claim 3 (depends on 2) The method of claim 2, wherein modifying the portion of the image comprises shifting to black a set of pixels in the digital display, the set of pixels corresponding to an area of the first icon excluding an area of an intersection of the first icon and the second icon as rendered on the digital display. ### Claim 4 (depends on 2) The method of claim 2, wherein modifying the portion of the image comprises non-uniformly reducing backlight intensity of a set of pixels in the digital display, the set of pixels corresponding to an area of the first icon excluding an area of an intersection of the first icon and the second icon as rendered on the digital display. ### Claim 5 (depends on 2) The method of claim 2, wherein scaling the icon and translating the icon from the first frame to generate the second frame comprises setting a scaling value based on a vertical position of the deformable region in the expanded setting, setting a translation magnitude value and a translation direction based on a vertical position of the deformable region in the expanded setting and the estimated viewing position of the user, applying the scaling value uniformly across the icon, and translating the icon according to the translation magnitude value and the translation direction in the first frame to generate the second frame. ### Claim 6 (depends on 1) The method of claim 1, wherein transitioning the deformable region from the retracted setting into the expanded setting comprises displacing a volume of fluid through a fluid channel to expand the deformable region, the fluid channel fluidly coupled to a cavity cooperatively defined by the substrate and the deformable region. ### Claim 7 (depends on 6) The method of claim 6, wherein modifying the portion of the image rendered on the digital display comprises estimating a three-dimensional surface profile of the tactile layer across the deformable region in the expanded setting based on a magnitude of the volume of fluid, estimating a non-uniform magnification of the portion of the image by the deformable region in the expanded setting based on the estimated three-dimensional surface profile, and non-uniformly scaling the portion of the image rendered on the digital display to compensate for the non-uniform magnification of the portion of the image rendered on the digital display. ### Claim 8 (depends on 7) The method of claim 7, wherein modifying the portion of the image rendered on the digital display comprises estimating a change in perceived position of the portion of the image by the user through the deformable region between the retracted setting and the expanded setting based on the estimated three-dimensional surface profile and the estimated viewing position of the user, calculating a translation magnitude value and a translation direction to compensate for the change in perceived position of the portion of the image by the user, and translating the portion of the image rendered on the digital display based on the translation magnitude value and the translation direction. ### Claim 9 (depends on 1) The method of claim 1, wherein estimating the viewing position of the user comprises capturing a photographic image of the user through a forward-facing camera arranged within a computing device coupled to the dynamic tactile interface, detecting eyes of the user within the photographic image, and generating a viewing position matrix defining an angle between the eyes of the user and the digital display along a first axis of the tactile layer and an angle between the eyes of the user and the digital display along a second axis of the tactile layer for each discrete position in a set of discrete positions across the tactile layer based on a position of the eyes within the photographic image; and wherein modifying the portion of the image rendered on the digital display comprises selecting a geometry matrix defining a profile of the tactile surface for the deformable region in the expanded setting for each discrete position in the set of discrete positions, transforming the image rendered on the digital display according to the viewing position matrix and the geometry matrix to generate a second image, and rendering the second image on the digital display. ### Claim 10 (depends on 9) The method of claim 9, wherein transforming the image rendered on the digital display comprises transforming the image into the second image further based on an index of refraction of the tactile layer and an index of refraction of a fluid arranged between the deformable region and the substrate. ### Claim 11 (depends on 9) The method of claim 9, wherein transitioning the deformable region from the retracted setting into the expanded setting comprises transitioning a set of deformable regions from the retracted setting into the expanded setting; and wherein selecting the geometry matrix comprises generating the geometry matrix defining an effective thickness of the tactile layer across the peripheral region and the set of deformable regions in the expanded setting for each discrete position in the set of discrete positions. ### Claim 12 (depends on 9) The method of claim 9, wherein generating the viewing position matrix comprises translating a position of the eyes within the photographic image to a viewing angle of the eyes to the forward-facing camera, translating a distance between the eyes within the photographic image to a viewing distance between the eyes and the forward-facing camera, and transforming the viewing angle and the viewing distance into an angle between the eyes of the user along the first axis and an angle between the eyes of the user along the second axis for each discrete position in the set of discrete positions across the tactile layer based on a location of each discrete position in the set of discrete positions across the tactile layer. ### Claim 13 (depends on 1) The method of claim 1, wherein rendering the image on the digital display comprises rendering the image on the digital display at a first time; wherein transitioning the deformable region from the retracted setting into the expanded setting comprises transitioning the deformable region into the expanded setting over a period of time succeeding the first time, the period of time terminating in a second time; and wherein modifying the portion of the image rendered on the digital display comprises cyclically refreshing an image rendered on the display according to a position of the deformable region over the peripheral region during the period of time. ### Claim 14 (depends on 13) The method of claim 13, wherein modifying the portion of the image comprises predicting a first perceived parallax of each pixel in the digital display by the user at the first time for the deformable region in the retracted setting, predicting a second perceived parallax of each pixel in the digital display by the user at the second time for the deformable region in the expanded setting, and modifying the image to compensate for a change in perceived parallax of each pixel of the digital display from the first perceived parallax to the second perceived parallax. ### Claim 15 (depends on 1) The method of claim 1, wherein transitioning the deformable region from the retracted setting into the expanded setting comprises transitioning the deformable region into the expanded setting at a first time; wherein rendering the image on the digital display comprises rendering the image on the digital display substantially at the first time; wherein estimating the viewing position of the user relative to the digital display comprises estimating a first viewing position of the user relative to the digital display substantially at the first time and estimating a second viewing position of the user relative to the digital display different from the first viewing position at a second time succeeding the first time; and wherein modifying the portion of the image rendered on the digital display comprises refreshing the image rendered on the digital display according to a difference between the first viewing position and the second viewing position. ### Claim 16 (depends on 15) The method of claim 15, wherein estimating the first viewing position of the user and the second viewing position of the user comprises estimating a new viewing position of the user relative to the digital display at a refresh rate, and wherein modifying the portion of the image rendered on the digital display comprises refreshing a transfer matrix at the refresh rate, the transfer matrix defining transformation of images rendered on the digital display based on an estimated position of the user to the digital display. ### Claim 17 A method for reducing perceived optical distortion of light output through a dynamic tactile interface, the dynamic tactile interface including a digital display coupled to a substrate opposite a tactile layer, the substrate and the tactile layer substantially transparent, the tactile layer defining a tactile surface, a peripheral region, and a deformable region, the peripheral region adjacent the deformable region and coupled to the substrate opposite the tactile surface, the deformable region disconnected from the substrate, the method comprising: transitioning the deformable region from a retracted setting into an expanded setting, the tactile surface at the deformable region substantially flush with the tactile surface at the peripheral region in the retracted setting and offset from the tactile surface at the peripheral region in the expanded setting; and at a first time, estimating a first viewing position of a user relative to the digital display; substantially at the first time, rendering a image on the digital display based on the first viewing position and a profile of the tactile surface across the deformable region in the expanded setting, the image comprising a portion rendered on the display adjacent the deformable region in the expanded setting; at a second time succeeding the first time, estimating a second viewing position of the user relative to the digital display; and modifying a position of the portion of the image rendered on the display adjacent the deformable region based on a difference between the first viewing position and the second viewing position. ### Claim 18 (depends on 17) The method of claim 17, wherein estimating the first viewing position of the user comprises capturing a photographic image of a face of the user with a camera arranged within a computing device incorporating the dynamic tactile interface, identifying eyes of the user within the photographic image, estimating an angle between the eyes of the user and the camera based on a position of the eyes within the photographic image, and transforming the angle between the eyes of the user and the camera into a first set of viewing angles of the user to a set of discrete positions across the digital display. ### Claim 19 (depends on 18) The method of claim 18, wherein modifying the position of the portion of the image rendered on the display comprises estimating a first perceived parallax of the image at the first time based on the first set of viewing angles, estimating a second perceived parallax of the image at the second time based on a second set of viewing angles of the user to the set of discrete positions across the digital display, and translating and scaling the portion of the image to compensate for a difference between the first perceived parallax and the second perceived parallax. ### Claim 20 (depends on 17) The method of claim 17, wherein transitioning the deformable region from the retracted setting into the expanded comprises displacing a preset volume of fluid into a fluid channel fluidly coupled to a cavity cooperatively defined by the substrate and the deformable region to expand the deformable region to a target height offset above the peripheral region. ### Claim 21 A method for reducing perceived optical distortion of light output through a dynamic tactile interface, the method comprising: rendering an image on a digital display, the digital display coupled to a tactile layer defining a tactile surface, a peripheral region, and a deformable region; estimating a viewing position of a user relative to the digital display; transitioning the deformable region from a retracted setting into an expanded setting, the tactile surface at the deformable region substantially flush with the tactile surface at the peripheral region in the retracted setting and offset from the tactile surface at the peripheral region in the expanded setting; and in response to transitioning the deformable region into the expanded setting, modifying the image rendered on the digital display according to the estimated viewing position of the user to compensate for a surface profile of the tactile layer at the deformable region in the expanded setting.