# US 10,481,402 B1 · Field of view enhancement via dynamic display portions for a modified video stream > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,481,402 B1 - Document ID: US10481402B1 - Status: Granted - Kind: B1 - Application number: 16/428,380 - Filed: 2019-05-31 - Granted: 2019-11-19 - Earliest claimed: 2017-09-27 - Assignees: University of Miami - Applicants: University of Miami - Inventors: Mohamed Abou Shousha; Ahmed Sayed - Web page: https://patentgrep.com/patent/US10481402B1 ## CPC - A61B 3/032: Devices for presenting test symbols or characters, e.g. test chart projectors (A61B3/036 takes precedence) - G02B 27/0172: {characterised by optical features} - A61B 3/0091: {Fixation targets for viewing direction} - A61B 3/024: for determining the visual field, e.g. perimeter types - A61B 3/028: for testing visual acuity; for determination of refraction, e.g. phoropters - A61B 3/10: Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions - A61B 3/113: for determining or recording eye movement - G02B 27/017: {Head mounted} - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - G02B 2027/0123: {comprising devices increasing the field of view} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0141: {characterised by the informative content of the display} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract In certain embodiments, enhancement of a field of view of a user may be facilitated via one or more dynamic display portions. In some embodiments, one or more changes related to one or more eyes of a user may be monitored. Based on the monitoring, one or more positions of one or more transparent display portions of wearable device may be adjusted, where the transparent display portions enable the user to see through the wearable device. A live video stream representing an environment of the user may be obtained via the wearable device. A modified video stream derived from the live video stream may be displayed on one or more other display portions of the wearable device. ## Claims ### Claim 1 A system for facilitating enhancement of a field of view of a user via one or more dynamic display portions, the system comprising: a computer system that comprises one or more processors executing computer program instructions that, when executed, cause the computer system to: provide information related to one or more eyes of a user to a prediction model, the prediction model being configured based on the information related to the one or more eyes; monitor one or more changes related to the one or more eyes; provide the one or more monitored changes related to the one or more eyes to the prediction model to obtain a set of modification parameters; cause, based on one or more modification parameters of the set of modification parameters, an adjustment of one or more positions, shapes, or sizes of one or more transparent display portions of a wearable device, the one or more transparent display portions enabling the user to see through the wearable device; and cause a modified video stream derived from a live video stream to be displayed on one or more other display portions of the wearable device, the live video stream representing an environment of the user. ### Claim 2 (depends on 1) The system of claim 1, wherein causing the adjustment comprises causing, based on the one or more modification parameters, an adjustment of at least one position of the one or more transparent display portions of the wearable device. ### Claim 3 (depends on 1) The system of claim 1, wherein causing the adjustment comprises causing, based on the one or more modification parameters, an adjustment of at least one shape of the one or more transparent display portions of the wearable device. ### Claim 4 (depends on 1) The system of claim 1, wherein causing the adjustment comprises causing, based on the one or more modification parameters, an adjustment of at least one size of the one or more transparent display portions of the wearable device. ### Claim 5 (depends on 1) The system of claim 1, wherein the computer system is caused to: determine defective visual field portions of a visual field of the user, wherein the visual field of the user comprises visual field portions, the defective visual field portions being ones of the visual field portions that fails to satisfy one or more vision criteria, wherein causing the adjustment comprises causing the adjustment of the one or more positions, shapes, or sizes of the one or more transparent display portions such that the one or more transparent display portions do not overlap with any of the defective visual field portions. ### Claim 6 (depends on 1) The system of claim 1, wherein the one or more monitored changes comprises an eye movement, a change in gaze direction, or a pupil size change. ### Claim 7 (depends on 1) The system of claim 1, wherein the computer system is caused to: generate the modified video stream based on the live video stream and the one or more monitored changes related to the one or more eyes. ### Claim 8 (depends on 1) The system of claim 1, wherein the computer system is a wearable computer system comprising the one or more processors executing the computer program instructions that, when executed, cause the wearable computer system to perform all the foregoing operations. ### Claim 9 A method being implemented by one or more processors executing computer program instructions that, when executed, perform the method, the method comprising: providing information related to one or more eyes of a user to a prediction model, the prediction model being configured based on the information related to the one or more eyes; determining defective visual field portions of a visual field of a user, wherein the visual field of the user comprises visual field portions, the defective visual field portions being ones of the visual field portions that fails to satisfy one or more vision criteria; monitoring one or more changes related to the one or more eyes; providing the one or more monitored changes related to the one or more eyes to the prediction model to obtain a set of modification parameters; causing, based on one or more modification parameters of the set of modification parameters, an adjustment of one or more transparent display portions of a wearable device such that the adjustment of the one or more transparent display portions does not cause the one or more transparent display portions to overlap with any of the defective visual field portions, the one or more transparent display portions enabling the user to see through the wearable device; and causing a modified video stream derived from a live video stream to be displayed on one or more other display portions of the wearable device, the live video stream representing an environment of the user. ### Claim 10 (depends on 9) The method of claim 9, wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more positions of the one or more transparent display portions of the wearable device. ### Claim 11 (depends on 9) The method of claim 9, wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more shapes of the one or more transparent display portions of the wearable device. ### Claim 12 (depends on 9) The method of claim 9, wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more sizes of the one or more transparent display portions of the wearable device. ### Claim 13 (depends on 9) The method of claim 9, wherein the one or more monitored changes comprises an eye movement, a change in gaze direction, or a pupil size change. ### Claim 14 (depends on 9) The method of claim 9, further comprising: generating the modified video stream based on the live video stream and the one or more monitored changes related to the one or more eyes. ### Claim 15 (depends on 9) The method of claim 9, wherein providing the information related to the one or more eyes comprises providing, to the prediction model, feedback related to a set of stimuli displayed to the user, the feedback indicating whether or how the user senses one or more stimuli, the prediction model being configured based on the feedback related to the set of stimuli. ### Claim 16 (depends on 15) The method of claim 15, further comprising: generating the modified video stream based on (i) the live video stream and (ii) at least one modification parameter of the set of modification parameters. ### Claim 17 One or more non-transitory computer-readable media comprising instructions that, when executed by one or more processors, cause operations comprising: providing, to a prediction model, feedback related to a set of stimuli displayed to a user, the feedback indicating whether or how the user senses one or more stimuli, the prediction model being configured based on the feedback related to the set of stimuli; monitoring one or more changes related to one or more eyes of the user; providing the one or more monitored changes related to the one or more eyes to the prediction model to obtain a set of modification parameters; causing, based on one or more modification parameters of the set of modification parameters, an adjustment of one or more transparent display portions of a wearable device, the one or more transparent display portions enabling the user to see through the wearable device; and causing a modified video stream derived from a live video stream to be displayed on one or more other display portions of the wearable device, the live video stream representing an environment of the user. ### Claim 18 (depends on 17) The one or more non-transitory computer-readable media of claim 17, wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more shapes of the one or more transparent display portions of the wearable device. ### Claim 19 (depends on 17) The one or more non-transitory computer-readable media of claim 17, wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more sizes of the one or more transparent display portions of the wearable device. ### Claim 20 (depends on 17) The one or more non-transitory computer-readable media of claim 17, the operations further comprising: generating the modified video stream based on (i) the live video stream and (ii) at least one modification parameter of the set of modification parameters. ### Claim 21 A method being implemented by one or more processors executing computer program instructions that, when executed, perform the method, the method comprising: monitoring one or more changes related to one or more eyes of a user; determining defective visual field portions of a visual field of the user, wherein the visual field of the user comprises visual field portions, the defective visual field portions being ones of the visual field portions that fails to satisfy one or more vision criteria, causing, based on the monitoring, an adjustment of one or more transparent display portions of a wearable device, the one or more transparent display portions enabling the user to see through the wearable device; causing a modified video stream derived from a live video stream to be displayed on one or more other display portions of the wearable device, the live video stream representing an environment of the user; detecting an object in the defective visual field portions or predicted to be in the defective visual field portions; determining that the object is not sufficiently in any image portion of the modified video stream that corresponds to at least one of the visual field portions satisfying one or more vision criteria; generating a prediction indicating that the object will come in physical contact with the user; and causing an alert to be displayed based on (i) the prediction of physical contact and (ii) the determination that the object is not sufficiently in any image portion of the modified video stream that corresponds to at least one of the visual field portions satisfying the one or more vision criteria, wherein the alert indicates an oncoming direction of the object.