# US 10,872,472 B2 · Systems for augmented reality visual aids and tools > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,872,472 B2 - Document ID: US10872472B2 - Status: Granted - Kind: B2 - Application number: 16/789,237 - Filed: 2020-02-12 - Published: 2020-06-11 - Granted: 2020-12-22 - Earliest claimed: 2016-11-18 - Assignees: Eyedaptic, Inc. - Applicants: Eyedaptic, Inc. - Inventors: David Watola; Jay E. Cormier; Brian Kim - Web page: https://patentgrep.com/patent/US10872472B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G02B 27/0172: {characterised by optical features} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06T 5/70: Denoising; Smoothing - G09B 21/008: {using visual presentation of the information for the partially sighted} - G09B 21/009: {Teaching or communicating with deaf persons (G09B21/04 takes precedence)} - G02B 2027/011: {comprising device for correcting geometrical aberrations, distortion} - G02B 2027/0134: {of stereoscopic type} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0141: {characterised by the informative content of the display} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract Adaptive Control Driven System/ACDS 99, supports visual enhancement, mitigation of challenges and with basic image modification algorithms and any known hardware from contact lenses to IOLs to AR hardware glasses, & enables users to enhance vision with user interface based on a series of adjustments that are applied to move, modify, or reshape image sets and components with full advantage of the remaining useful retinal area, thus addressing aspects of visual challenges heretofore inaccessible by devices which learn needed adjustments. ## Claims ### Claim 1 A method of presenting real-time video images to a user on a display, comprising the steps of: displaying the real-time video images and a calibration pattern on the display to the user; receiving an input from the user that manipulates a parameter of the calibration pattern; continuously processing the real-time video images based on the input to produce warped real-time video images; continuously displaying the warped real-time video images on the display to the user. ### Claim 2 (depends on 1) The method of claim 1, wherein the real-time images and the calibration pattern appear distorted to the user where they overlap with a visual field defect of the user. ### Claim 3 (depends on 2) The method of claim 2, wherein the warped real-time video images reduce an appearance and amount of distortion of the visual field defect to the user. ### Claim 4 (depends on 1) The method of claim 1, wherein the calibration pattern comprises a plurality of points delineating a single grid cell. ### Claim 5 (depends on 4) The method of claim 4, wherein the manipulated parameter comprises an adjusted position of at least one of the plurality of points. ### Claim 6 (depends on 4) The method of claim 4, further comprising modifying the calibration pattern to include a plurality of grid cells. ### Claim 7 A method of calibrating real-time video images to correct for a visual field defect of a user, comprising the steps of: viewing a calibration pattern and the real-time video images on a display; manipulating the calibration pattern with an interactive user interface; instantaneously viewing warped real-time video images based on the manipulated calibration pattern; and repeating the manipulating the calibration pattern step and the instantaneously viewing warped real-time video images step to reduce the appearance of the visual field defect. ### Claim 8 (depends on 7) The method of claim 7, wherein the calibration pattern appears distorted to the user where it overlaps with the visual field defect. ### Claim 9 (depends on 8) The method of claim 8, wherein the warped real-time video images reduce an appearance and amount of distortion of the visual field defect to the user. ### Claim 10 (depends on 7) The method of claim 7, wherein the calibration pattern comprises a plurality of points delineating a single grid cell. ### Claim 11 (depends on 10) The method of claim 10, wherein manipulating the calibration pattern comprises changing a position of at least one of the plurality of points. ### Claim 12 (depends on 11) The method of claim 11, further comprising modifying the calibration pattern to include a plurality of grid cells. ### Claim 13 A method of presenting real-time video images to a user on a display, comprising the steps of: displaying a calibration grid and the real-time video images to the user on the display, the calibration grid having a first resolution; receiving a first input from the user that manipulates a first parameter of the calibration grid; processing the real-time video images based on the first input to produce warped real-time video images; adjusting a resolution of the calibration grid to a second resolution; displaying the calibration grid and the warped real-time video images on the display to the user, the calibration grid having the second resolution; receiving a second input from the user that manipulates a second parameter of the mapping grid; processing the real-time video images based on the second input to produce second warped real-time video images. ### Claim 14 (depends on 13) The method of claim 13, wherein the calibration grid appears distorted to the user where it overlaps with a visual field defect of the user. ### Claim 15 (depends on 13) The method of claim 13, wherein the display comprises a wearable display. ### Claim 16 (depends on 14) The method of claim 14, wherein the first and second warped real-time video images reduce an appearance and amount of distortion of the visual field defect to the user. ### Claim 17 (depends on 13) The method of claim 13, wherein the first resolution of the calibration grid comprises a plurality of points delineating a single grid cell. ### Claim 18 (depends on 17) The method of claim 17, wherein the manipulated first parameter comprises an adjusted position of at least one of the plurality of points. ### Claim 19 (depends on 17) The method of claim 17, wherein the second resolution of the calibration grid comprises a plurality of grid cells. ### Claim 20 (depends on 19) The method of claim 19, wherein an amount of the plurality of grid cells is selected from the group consisting of four grid cells, sixteen grid cells, and sixty-four grid cells.