# US 10,311,641 B2 · Using saccadic eye movements to improve redirected walking > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,641 B2 - Document ID: US10311641B2 - Status: Granted - Kind: B2 - Application number: 15/376,420 - Filed: 2016-12-12 - Published: 2018-06-14 - Granted: 2019-06-04 - Earliest claimed: 2016-12-12 - Assignees: Intel Corporation - Applicants: Intel IP Corporation - Inventors: Daniel Pohl - Web page: https://patentgrep.com/patent/US10311641B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Systems, apparatuses and methods may provide for technology that identifies a change in virtual camera orientation that will increase a virtual walkable space associated with a rendered environment in a head mounted display (HMD) system. Additionally, a saccadic movement state may be detected with respect to a wearer of the HMD system, wherein the change in virtual camera orientation is conducted when the saccadic movement state is present. In one example, the change in virtual camera orientation may be bypassed when the saccadic movement state is not present. ## Claims ### Claim 1 A head mounted display system comprising: a housing including a wearable form factor; a display to visually present a rendered environment; and a saccadic control apparatus including: a redirection monitor, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, to identify a change in virtual camera orientation that will increase a virtual walkable space associated with the rendered environment, wherein the change in virtual camera orientation is to introduce a curvature into an initial scene rendering of the rendered environment, that includes a destination, to generate a second scene rendering, further wherein the curvature is in a curvature direction; an eye monitor, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, to detect a saccadic movement state with respect to a wearer of the head mounted display system, wherein the eye monitor is to detect a saccadic eye movement during the saccadic movement state; and an orientation adjuster, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, communicatively coupled to the redirection monitor and the eye monitor, the orientation adjuster to: when the saccadic movement state is present and the saccadic eye movement moves at least partly in the curvature direction, conduct the change in virtual camera orientation so that the second scene rendering is to be presented such that as the wearer moves toward the destination along the curvature, the wearer perceives that the wearer is moving along a straight path to the destination, and when the saccadic movement state is present and the saccadic eye movement moves at least partly opposite to the curvature direction, avoid the change in virtual camera orientation so that a third scene rendering is to be presented, wherein the third scene rendering includes unchanged content of the initial scene rendering to avoid introduction of the curvature. ### Claim 2 (depends on 1) The system of claim 1, wherein the orientation adjuster is to bypass the change in virtual camera orientation when the saccadic movement state is not present. ### Claim 3 (depends on 1) The system of claim 1, further comprising a graphics processor including a renderer to generate the rendered environment, wherein the orientation adjuster is to send an adjustment signal to the renderer to conduct the change in virtual camera orientation. ### Claim 4 (depends on 3) The system of claim 3, wherein the adjustment signal is to instruct the renderer to move the virtual camera orientation one of farther left or farther right. ### Claim 5 (depends on 1) The system of claim 1, further including one or more sensors to generate one or more eye tracking signals, wherein the eye monitor is to analyze at least one of the one or more eye tracking signals, and wherein the saccadic movement state is to be detected based on the one or more eye tracking signals. ### Claim 6 (depends on 1) The system of claim 1, wherein the saccadic control apparatus further includes a quality adjuster, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, communicatively coupled to the eye monitor, and wherein the quality adjuster is to reduce a scene quality of one or more frames rendered when the saccadic movement state is present. ### Claim 7 An apparatus comprising: a redirection monitor, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, to identify a change in virtual camera orientation that will increase a virtual walkable space associated with a rendered environment in a head mounted display system, wherein the change in virtual camera orientation is to introduce a curvature into an initial scene rendering of the rendered environment, that includes a destination, to generate a second scene rendering, further wherein the curvature is in a curvature direction; an eye monitor, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, to detect a saccadic movement state with respect to a wearer of the head mounted display system, wherein the eye monitor is to detect a saccadic eye movement during the saccadic movement state; and an orientation adjuster, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, communicatively coupled to the redirection monitor and the eye monitor, the orientation adjuster to: when the saccadic movement state is present and the saccadic eye movement moves at least partly in the curvature direction, conduct the change in virtual camera orientation so that the second scene rendering is to be presented such that as the wearer moves toward the destination along the curvature, the wearer perceives that the wearer is moving along a straight path to the destination, and when the saccadic movement state is present and the saccadic eye movement moves at least partly opposite to the curvature direction, avoid the change in virtual camera orientation so that a third scene rendering is to be presented, wherein the third scene rendering includes unchanged content of the initial scene rendering to avoid introduction of the curvature. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the orientation adjuster is to bypass the change in virtual camera orientation when the saccadic movement state is not present. ### Claim 9 (depends on 7) The apparatus of claim 7, wherein the orientation adjuster is to send an adjustment signal to a renderer of the head mounted display system to conduct the change in virtual camera orientation. ### Claim 10 (depends on 9) The apparatus of claim 9, wherein the adjustment signal is to instruct the renderer to move the virtual camera orientation one of farther left or farther right. ### Claim 11 (depends on 7) The apparatus of claim 7, wherein the eye monitor is to analyze one or more eye tracking signals from one or more sensors in the head mounted display system, and wherein the saccadic movement state is to be detected based on the one or more eye tracking signals. ### Claim 12 (depends on 7) The apparatus of claim 7, further including a quality adjuster, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, communicatively coupled to the eye monitor, the quality adjuster to reduce a scene quality of one or more frames rendered when the saccadic movement state is present. ### Claim 13 A method comprising: identifying a change in virtual camera orientation that will increase a virtual walkable space associated with a rendered environment in a head mounted display system, wherein the change in virtual camera orientation is to introduce a curvature into an initial scene rendering of the rendered environment, that includes a destination, to generate a second scene rendering, further wherein the curvature is in a curvature direction; detecting a saccadic movement state with respect to a wearer of the head mounted display system; detecting a saccadic eye movement during the saccadic movement state; when the saccadic movement state is present and the saccadic eye movement moves at least partly in the curvature direction, conducting the change in virtual camera orientation so that the second scene rendering is presented such that as the wearer moves toward the destination along the curvature, the wearer perceives that the wearer is moving along a straight path to the destination; and when the saccadic movement state is present and the saccadic eye movement moves at least partly opposite to the curvature direction, avoiding the change in virtual camera orientation so that a third scene rendering is presented, wherein the third scene rendering includes unchanged content of the initial scene rendering to avoid introduction of the curvature. ### Claim 14 (depends on 13) The method of claim 13, further including bypassing the change in virtual camera orientation when the saccadic movement state is not present. ### Claim 15 (depends on 13) The method of claim 13, wherein conducting the change in virtual camera orientation includes sending an adjustment signal to a renderer of the head mounted display system. ### Claim 16 (depends on 15) The method of claim 15, wherein the adjustment signal instructs the renderer to move the virtual camera orientation one of farther left or farther right. ### Claim 17 (depends on 13) The method of claim 13, further including analyzing one or more eye tracking signals from one or more sensors in the head mounted display system, wherein the saccadic movement state is detected based on the one or more eye tracking signals. ### Claim 18 (depends on 13) The method of claim 13, further including reducing a scene quality of one or more frames rendered when the saccadic movement state is present. ### Claim 19 At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a processor of a head mounted display system, cause the head mounted display system to: identify a change in virtual camera orientation that will increase a virtual walkable space associated with a rendered environment in the head mounted display system, wherein the change in virtual camera orientation is to introduce a curvature into an initial scene rendering of the rendered environment, that includes a destination, to generate a second scene rendering, further wherein the curvature is in a curvature direction; detect a saccadic movement state with respect to a wearer of the head mounted display system; detect a saccadic eye movement during the saccadic movement state; when the saccadic movement state is present and the saccadic eye movement moves at least partly in the curvature direction, conduct the change in virtual camera orientation so that the second scene rendering is to be presented such that as the wearer moves toward the destination along the curvature, the wearer perceives that the wearer is moving along a straight path to the destination; and when the saccadic movement state is present and the saccadic eye movement moves at least partly opposite to the curvature direction, avoid the change in virtual camera orientation so that a third scene rendering is to be presented, wherein the third scene rendering includes unchanged content of the initial scene rendering to avoid introduction of the curvature. ### Claim 20 (depends on 19) The at least one non-transitory computer readable storage medium of claim 19, wherein the instructions, when executed, cause the head mounted display system to bypass the change in virtual camera orientation when the saccadic movement state is not present. ### Claim 21 (depends on 19) The at least one non-transitory computer readable storage medium of claim 19, wherein the instructions, when executed, cause the head mounted display system to send an adjustment signal to a renderer of the head mounted display system to conduct the change in virtual camera orientation. ### Claim 22 (depends on 21) The at least one non-transitory computer readable storage medium of claim 21, wherein the adjustment signal is to instruct the renderer to move the virtual camera orientation one of farther left or farther right. ### Claim 23 (depends on 19) The at least one non-transitory computer readable storage medium of claim 19, wherein the instructions, when executed, cause the head mounted display system to analyze one or more eye tracking signals from one or more sensors in the head mounted display system, and wherein the saccadic movement state is to be detected based on the one or more eye tracking signals. ### Claim 24 (depends on 19) The at least one non-transitory computer readable storage medium of claim 19, wherein the instructions, when executed, cause the head mounted display system to reduce a scene quality of one or more frames rendered when the saccadic movement state is present.