# US 10,482,676 B2 · Systems and methods to provide an interactive environment over an expanded field-of-view > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,676 B2 - Document ID: US10482676B2 - Status: Granted - Kind: B2 - Application number: 16/186,011 - Filed: 2018-11-09 - Published: 2019-03-28 - Granted: 2019-11-19 - Earliest claimed: 2017-01-10 - Assignees: Meta View, Inc. - Applicants: Meta View, Inc. - Inventors: Sheng Yuan; Ashish Ahuja; Jie Xiang; Raymond Chun Hing Lo - Web page: https://patentgrep.com/patent/US10482676B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/0172: {characterised by optical features} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G02B 2027/0123: {comprising devices increasing the field of view} - G02B 2027/0134: {of stereoscopic type} - G02B 2027/014: {comprising information/image processing systems} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Systems and methods to provide an interactive environment over an expanded field-of-view are presented herein. The system may include one or more of a headset, a first image forming component held by the headset, a second image forming component held by the headset, one or more physical processors, and/or other components. The first image forming component may be configured to generate light rays to form a first set of images of virtual content at a first resolution. The first set of images of virtual content may be presented to the user over a first angular portion of the user's field-of-view. The second image forming component may be configured to generate light rays to form a second set of images of virtual content at a second resolution. The second set of images of virtual content may be presented to the user over a second angular portion of the user's field-of-view. ## Claims ### Claim 1 A system configured to provide an interactive environment over an expanded field-of-view, the system comprising: a headset configured to be installed on a head of a user; a first image forming component held by the headset configured to generate light rays to form a first set of images of virtual content, the first image forming component being configured such that (i) when the headset is installed on the head of the user, the first set of images of virtual content is presented to a first eye of the user over a first angular portion of the user's monocular field-of-view from the user's first eye, wherein the first angular portion is centered along a straight-ahead gaze direction of the user's first eye and (ii) the first set of images of virtual content is superimposed over a view of the real world to create at least part of an augmented reality environment; a second image forming component held by the headset configured to generate light rays to form a second set of images of virtual content, the second image forming component being configured such that (i) when the headset is installed on the head of the user, the second set of images of virtual content is presented to the first eye of the user over a second angular portion of the user's monocular field-of-view from the user's first eye, wherein the second angular portion is adjacent to the first angular portion, and (ii) the second set of images of virtual content are superimposed over the view of the real world to create at least a second part of the augmented reality environment; and one or more physical processors configured by machine-readable instructions to: control the first image forming component to generate the light rays to form the first set of images of virtual content; and control the second image forming component to generate the light rays to form the second set of images of virtual content. ### Claim 2 (depends on 1) The system of claim 1, wherein the first image forming component comprises: a first light source configured to generate the light rays to form the first set of images of virtual content; a first optical element, the first optical element being configured to receive the light rays generated by the first light source that are coupled into the first optical element and guide the light rays to an eye to present the first set of images over the first angular portion of the user's field-of-view, wherein the first set of images of virtual content are superimposed over the view of the real world; and wherein the one or more physical processors are further configured by machine-readable instructions such that controlling the first image forming component comprises controlling the first light source to generate the light rays to form the first set of images of virtual content. ### Claim 3 (depends on 2) The system of claim 2, wherein the second image forming component comprises: a second light source held by the headset configured to generate the light rays to form the second set of images of virtual content; a second optical element held by the headset, the second optical element being arranged on the headset such that (i) when the headset is installed on the head of the user, the user's vision over the second angular portion of the user's field-of-view is directed toward the second optical element, and (ii) the light rays generated by the second light source are directed onto the second optical element to form the second set of images of virtual content on the second optical element that reflect into the user's eye, wherein the second set of images of virtual content are superimposed over the view of the real world through the second optical element; and wherein the one or more physical processors are further configured by machine-readable instructions such that controlling the second image forming component comprises controlling the second light source to generate the light rays to form the second set of images of virtual content. ### Claim 4 (depends on 3) The system of claim 3, wherein the first light source and second light source are individually one or more of a microelectromechanical systems (MEMS) RGB laser scanner, a microLED microdisplay, an LED or RGB lasers illuminated liquid crystal on silicon (LCOS) microdisplay, a digital light projector (DLP), a digital micromirror device (DMD), a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, or an OLED microdisplay. ### Claim 5 (depends on 3) The system of claim 3, wherein the first optical element comprises a waveguide, and the second optical element comprises a partially reflective visor portion. ### Claim 6 (depends on 3) The system of claim 3, wherein the first optical element comprises a waveguide, and the second optical element comprises a beam splitter or a free form prism. ### Claim 7 (depends on 2) The system of claim 2, wherein the second image forming component comprises: a second light source configured to generate the light rays to form the second set of images of virtual content at the second resolution; a second optical element, the second optical element being configured to receive the light rays generated by the second light source that are coupled into the second optical element and guide the light rays to the eye to present the second set of images over the second angular portion of the user's field-of-view, wherein the second set of images of virtual content are superimposed over the view of the real world; and wherein the one or more physical processors are further configured by machine-readable instructions such that controlling the second image forming component comprises controlling the second light source to generate the light rays to form the second set of images of virtual content. ### Claim 8 (depends on 2) The system of claim 2, wherein the second image forming component comprises a scanning fiber system configured to generate the light rays to form the second set of images of virtual content at the second resolution. ### Claim 9 (depends on 2) The system of claim 2, wherein the second image forming component comprises: a second light source held by the headset configured to generate the light rays to form the second set of images of virtual content at the second resolution; and a deformable mirror. ### Claim 10 (depends on 9) The system of claim 9, further comprising a lens or an image fiber bundle. ### Claim 11 (depends on 1) The system of claim 1, wherein: the first image forming component is configured to form the first set of images of virtual content at a first resolution; the second image forming component is configured to form the second set of images of virtual content at a second resolution; and the first resolution is higher than the second resolution. ### Claim 12 (depends on 1) The system of claim 1, wherein the first angular portion does not overlap with the second angular portion of the user's field-of-view. ### Claim 13 (depends on 1) The system of claim 1, wherein the second angular portion of the user's monocular field-of-view from the user's first eye is positioned at a temporal side of the user's peripheral field-of-view when the gaze direction of the user's first eye is straight-ahead. ### Claim 14 (depends on 13) The system of claim 13, further comprising: a third image forming component held by the headset configured to generate light rays to form a third set of images of virtual content, the third image forming component being configured such that (i) when the headset is installed on the head of the user, the third set of images of virtual content is presented to the first eye of the user over a third angular portion of the user's monocular field-of-view from the user's first eye, and (ii) the third set of images of virtual content are superimposed over the view of the real world to create at least a third part of the augmented reality environment, wherein: the one or more physical processors configured by machine-readable instructions control the third image forming component to generate the light rays to form the second set of images of virtual content, and the third angular portion of the user's monocular field-of-view from the user's first eye is positioned at a nasal side of the user's peripheral field-of-view when the gaze direction of the user's first eye is straight ahead. ### Claim 15 A method to provide an interactive environment over an expanded field-of-view, the method being implemented in a headset configured to be installed on a head of a user, the headset comprising a first image forming component, a second image forming component, one or more physical processors, and storage media storing machine-readable instructions, the method comprising: generating, by the first image forming component, light rays to form a first set of images of virtual content; presenting, by the first image forming component, the first set of images of virtual content to a first eye of the user over a first angular portion of the user's monocular field-of-view from the user's first eye, wherein the first angular portion is centered along a straight-ahead gazed direction of the user's first eye, the first set of images of virtual content being superimposed over a view of the real world to create at least part of an augmented reality environment; generating, by the second image forming component, light rays to form a second set of images of virtual content; and presenting, by the second image forming component, the second set of images of virtual content to the first eye of the user over a second angular portion of the user's monocular field-of-view from the user's first eye, the second angular portion being adjacent to the first angular portion, the second set of images of virtual content being superimposed over the view of the real world to create at least a second part of the augmented reality environment. ### Claim 16 (depends on 15) The method of claim 15, wherein the first image forming component comprises a first light source configured to generate the light rays to form the first set of images and a first optical element, and wherein the method further comprises: coupling the light rays generated by the first light source into the first optical element and guiding the light rays coupled into the first optical element to an eye to form the first set of images of virtual content in the eye, wherein the first set of images of virtual content are superimposed over the view of the real world. ### Claim 17 (depends on 16) The method of claim 16, wherein the second image forming component comprises a second light source configured to generate the light rays to form the second set of images, and a second optical element, and wherein the method further comprises: directing the light rays generated by the second light source onto the second optical element to form the second set of images of virtual content on the second optical element and reflect the second set of images into the user's eye, wherein the second set of images of virtual content are superimposed over the view of the real world through the second optical element. ### Claim 18 (depends on 17) The method of claim 17, wherein the first light source and second light source are individually one or more of a microelectromechanical systems (MEMS) RGB laser scanner, a microLED microdisplay, an LED or RGB lasers illuminated liquid crystal on silicon (LCOS) microdisplay, a digital light projector (DLP), a digital micromirror device (DMD), a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, or an OLED microdisplay. ### Claim 19 (depends on 17) The method of claim 17, wherein the first optical element comprises a waveguide, and the second optical element comprises a partially reflective visor portion. ### Claim 20 (depends on 17) The method of claim 17, wherein the first optical element comprises a waveguide, and the second optical element comprises a beam splitter or a free form prism. ### Claim 21 (depends on 16) The method of claim 16, wherein the second image forming component comprises a second light source configured to generate the light rays to form the second set of images and a second optical element, and wherein the method further comprises: coupling the light rays generated by the second light source into the second optical element and guiding the light rays coupled into the second optical element to the eye to form the second set of images of virtual content in the eye, wherein the second set of images of virtual content are superimposed over the view of the real world. ### Claim 22 (depends on 15) The method of claim 15, wherein the second angular portion of the user's monocular field-of-view from the user's first eye is positioned at a temporal side of the user's peripheral field-of-view when the gaze direction of the user's first eye is straight-ahead.