# US 2021/0278670 A1 · Hybrid see through augmented reality systems and methods for low vision users > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0278670 A1 - Document ID: US20210278670A1 - Status: Published application - Kind: A1 - Application number: 17/057,181 - Filed: 2019-05-29 - Published: 2021-09-09 - Earliest claimed: 2018-05-29 - Assignees: Eyedaptic, Inc. - Applicants: Eyedaptic, Inc. - Inventors: David WATOLA; Jay E. CORMIER - Web page: https://patentgrep.com/patent/US20210278670A1 ## CPC - G02B 27/0172: {characterised by optical features} - G06T 5/70: Denoising; Smoothing - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/0147: {comprising a device modifying the resolution of the displayed image} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Provided herein are augmented reality visual aid systems, software, and methods which enhance vision, to simulate natural vision, by utilizing hybrid see through occlusion enabled hardware, and software through image manipulation, reprocessing, blending, for presentation and display to the eyes thus enabling a range of tasks previously lost or impacted. ## Claims ### Claim 1 A hybrid see-through augmented reality device, comprising: a frame configured to be worn on the head of a user; a camera disposed on the frame and configured to generate unprocessed real-time video images; a processor disposed on or in the frame and configured to apply image processing to the real-time video images from the camera to produce an enhanced video stream, the processor being further configured to gradually reduce the imaging processing towards the edges of the enhanced video stream; and a first display disposed within the frame and including a first barrier configured to substantially prevent external light corresponding to a central portion of the user's field of view from entering a first eye of the user while allowing external light corresponding to a peripheral portion of the user's field of view to enter the first eye of the user, the first display being configured to present the enhanced video stream to the central portion of the user's field of view while allowing the enhanced video stream to blend smoothly into the peripheral portion of the user's field of view that comprises the user's natural peripheral vision. ### Claim 2 (depends on 1) The device of claim 1, further comprising a second display disposed within the frame and including a second barrier configured to substantially prevent external light corresponding to the central portion of the user's field of view from entering a second eye of the user while allowing external light corresponding to the peripheral portion of the user's field of view to enter the second eye of the user. ### Claim 3 (depends on 2) The device of claim 2, wherein the processor is also configured to display the video stream on the second display. ### Claim 4 (canceled) ### Claim 5 (depends on 1) The device of claim 1, wherein the enhanced video stream is at least partially magnified when compared to the unprocessed real-time video images. ### Claim 6 (depends on 5) The device of claim 5, wherein the enhanced video stream is magnified in a central portion of the enhanced video stream. ### Claim 7 (depends on 6) The device of claim 6, wherein a portion of the enhanced video stream outside of the central portion is magnified less than the central portion but more than the unprocessed real-time video images. ### Claim 8 (depends on 1) The device of claim 1, wherein the processor is configured to process the unprocessed real-time video images to blend a top edge, a bottom edge, a left edge, and a right edge of the video stream with the peripheral portion of the user's field of view. ### Claim 9 (depends on 1) The device of claim 1, wherein the processor is configured to process the unprocessed real-time video images to blend only a left edge and a right edge of the video stream with the peripheral portion of the user's field of view. ### Claim 10 (depends on 1) The device of claim 1, wherein the processor is configured to process the unprocessed real-time video with image coordinate remapping to blend the video stream with the peripheral portion of the user's field of view. ### Claim 11 (depends on 10) The device of claim 10, wherein the image coordinate remapping comprises radial mapping. ### Claim 12 (depends on 1) The device of claim 1, further comprising an input device configured to receive an input from the user regarding a type and/or an amount of enhancement to apply to the unprocessed real-time video images. ### Claim 13 (depends on 12) The device of claim 12, wherein the input device comprises a physical mechanism. ### Claim 14 (depends on 12) The device of claim 12, wherein the input device comprises a microphone disposed on or in the housing configured to receive voice commands from the user. ### Claim 15 A method of providing enhanced vision for a low-vision user, comprising: generating unprocessed real-time video images with a head mounted camera; preventing light corresponding to a central portion of the user's field of view from entering a first eye of the user; applying image processing to the unprocessed real-time video images to produce an enhanced video stream wherein the image processing is reduced towards the edges of the enhanced video stream so as to blend smoothly into peripheral areas of vision of the user; displaying the enhanced video stream on a display positioned within the central portion of the user's field of view that substantially prevents external light corresponding to the central portion of the user's field of view from entering the first eye of the user while allowing external light corresponding to the peripheral portion of the user's field of view to enter the first eye of the user. ### Claim 16 (depends on 15) The method of claim 15, further comprising displaying the video stream on a second display positioned within the central portion of the user's field of view. ### Claim 17 (depends on 16) The method of claim 16, wherein the display is positioned in front of the first eye of the user and the second display is positioned in front of a second eye of the user. ### Claim 18 (canceled) ### Claim 19 (depends on 15) The method of claim 15, wherein the enhanced video stream is at least partially magnified when compared to the unprocessed real-time video images. ### Claim 20 (depends on 19) The method of claim 19, wherein the enhanced video stream is magnified in a central portion of the video stream. ### Claim 21 (depends on 20) The method of claim 20, wherein a portion of the video stream outside of the central portion is magnified less than the central portion but more than the unprocessed real-time video images. ### Claim 22 (depends on 15) The method of claim 15, further comprising processing the unprocessed real-time video images to blend a top edge, a bottom edge, a left edge, and a right edge of the video stream with the peripheral portion of the user's field of view. ### Claim 23 (depends on 15) The method of claim 15, further comprising processing the unprocessed real-time video images to blend only a left edge and a right edge of the video stream with the peripheral portion of the user's field of view. ### Claim 24 (depends on 15) The method of claim 15, further comprising processing the unprocessed real-time video with image coordinate remapping to blend the video stream with the peripheral portion of the user's field of view. ### Claim 25 (depends on 24) The method of claim 24, wherein the image coordinate remapping comprises radial mapping. ### Claim 26 A non-transitory computing device readable medium having instructions stored thereon that are executable by a processor to cause a computing device to: generate unprocessed real-time video images; apply image processing to the unprocessed real-time video images to produce an enhanced video stream wherein the image processing is reduced towards the edges of the enhanced video stream so as to blend smoothly into peripheral areas of vision of the user; display the enhanced video stream on a display positioned within the central portion of the user's field of view that substantially prevents external light corresponding to the central portion of the user's field of view from entering a first eye of the user while allowing external light corresponding to the peripheral portion of the user's field of view to enter the first eye of the user. ### Claim 27 (depends on 26) The device readable medium of claim 26, wherein the instructions further cause the computing device to display the video stream on a second display positioned within the central portion of the user's field of view. ### Claim 28 (depends on 27) The device readable medium of claim 27, wherein the display is positioned in front of the first eye of the user and the second display is positioned in front of a second eye of the user. ### Claim 29 (depends on 26) The device readable medium of claim 26, wherein the instructions further cause the computing device to process the unprocessed real-time video images such that the video stream is enhanced when compared to the unprocessed real-time video images. ### Claim 30 (depends on 29) The device readable medium of claim 29, wherein the enhanced video stream is at least partially magnified when compared to the unprocessed real-time video images. ### Claim 31 (depends on 30) The device readable medium of claim 30, wherein the enhanced video stream is magnified in a central portion of the enhanced video stream. ### Claim 32 (depends on 31) The device readable medium of claim 31, wherein a portion of the enhanced video stream outside of the central portion is magnified less than the central portion but more than the unprocessed real-time video images. ### Claim 33 (depends on 26) The device readable medium of claim 26, wherein the instructions further cause the computing device to process the unprocessed real-time video images to blend a top edge, a bottom edge, a left edge, and a right edge of the video stream with the peripheral portion of the user's field of view. ### Claim 34 (depends on 26) The device readable medium of claim 26, wherein the instructions further cause the computing device to process the unprocessed real-time video images to blend only a left edge and a right edge of the video stream with the peripheral portion of the user's field of view. ### Claim 35 (depends on 26) The device readable medium of claim 26, wherein the instructions further cause the computing device to process the unprocessed real-time video with image coordinate remapping to blend the video stream with the peripheral portion of the user's field of view. ### Claim 36 (depends on 35) The device readable medium of claim 35, wherein the image coordinate remapping comprises radial mapping. ### Claim 37 (depends on 1) The device of claim 1, wherein the first barrier is a physical barrier. ### Claim 38 (depends on 1) The device of claim 1, wherein the first barrier is electronically controlled.