# US 11,907,420 B2 · Managing devices having additive displays > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,907,420 B2 - Document ID: US11907420B2 - Status: Granted - Kind: B2 - Application number: 17/397,719 - Filed: 2021-08-09 - Published: 2021-11-25 - Granted: 2024-02-20 - Earliest claimed: 2019-09-27 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Devin W. Chalmers; Gregory L. Lutter; Jonathan C. Moisant-Thompson; Rahul Nair - Web page: https://patentgrep.com/patent/US11907420B2 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/017: {Head mounted} - G02B 27/0172: {characterised by optical features} - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - G06T 5/70: Denoising; Smoothing - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/0185: {Displaying image at variable distance} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract One or more techniques for managing virtual objects between one or more displays are described. In accordance with some embodiments, exemplary techniques for displaying a virtual object are described. ## Claims ### Claim 1 A head-mounted display (HMD) device, comprising: one or more image sensors; a primary display that extends across a field-of-view and has a first resolution; a secondary display that is physically and electronically coupled to the primary display and has a second resolution that is lower than the first resolution; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying a first portion of a virtual object via the secondary display; and displaying a second portion of the virtual object via the primary display, wherein displaying the second portion of the virtual object via the primary display includes: in accordance with a determination that the second portion of the virtual object is within a predefined distance from an edge of the primary display, applying a visual effect to the second portion of the virtual object while forgoing applying the visual effect to the first portion of the virtual object that is displayed via the secondary display. ### Claim 2 (depends on 1) The HMD device of claim 1, wherein the one or more programs further include instructions for: in accordance with a determination that the second portion of the virtual object is not within a predefined distance from the edge of the primary display, forgoing to apply the visual effect to the second portion of the virtual object. ### Claim 3 (depends on 1) The HMD device of claim 1, wherein: the first portion of the virtual object has a first visual appearance; and after applying the visual effect to the second portion of the virtual object, the second portion of the virtual object has a second visual appearance that is the same as the first visual appearance. ### Claim 4 (depends on 1) The HMD device of claim 1, wherein the one or more programs further include instructions for: concurrently displaying, via the primary display, a third portion of the virtual object that does not have the visual effect applied, wherein the third portion of the virtual object does not have the visual effect applied and is less blurry than the second portion of the virtual object. ### Claim 5 (depends on 1) The HMD device of claim 1, wherein the first portion of the virtual object is visually distinguished from the second portion of the virtual object. ### Claim 6 (depends on 1) The HMD device of claim 1, wherein applying the visual effect to the second portion of the virtual object includes: blurring the second portion of the virtual object. ### Claim 7 (depends on 6) The HMD device of claim 6, wherein, after the blurring the second portion of the virtual object, the second portion of the virtual object includes an amount of blur that is based on an amount of blur of the first portion of the virtual object. ### Claim 8 (depends on 6) The HMD device of claim 6, wherein blurring the second portion of the virtual object includes changing an amount of blur of the second portion of the virtual object based on a respective distance between the virtual object and the secondary display. ### Claim 9 (depends on 6) The HMD device of claim 6, wherein the second portion of the virtual object is blurred based on a characteristic of a detected, via the one or more images sensors, pupil looking through the HMD device. ### Claim 10 (depends on 1) The HMD device of claim 1, wherein applying the second portion of the virtual object includes: fading the second portion of the virtual object. ### Claim 11 (depends on 10) The HMD device of claim 10, wherein the second portion of the virtual object is faded proportionally to a detected blur of the secondary display. ### Claim 12 (depends on 10) The HMD device of claim 10, wherein the second portion of the virtual object is faded from a first color to a second color. ### Claim 13 (depends on 12) The HMD device of claim 12, wherein the first color is black, and wherein the second color is white. ### Claim 14 (depends on 1) The HMD device of claim 1, wherein displaying the second portion of the virtual object includes: rounding a corner of the second portion of the virtual object. ### Claim 15 (depends on 14) The HMD device of claim 14, wherein the corner is faded. ### Claim 16 A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a head-mounted display (HMD) device having one or more sensors, a primary display that extends across a field-of-view and has a first resolution, and a secondary display that is physically and electronically coupled to the primary display and has a second resolution that is lower than the first resolution, the one or more programs including instructions for: displaying a first portion of a virtual object via the secondary display; and displaying a second portion of the virtual object via the primary display, wherein displaying the second portion of the virtual object via the primary display includes: in accordance with a determination that the second portion of the virtual object is within a predefined distance from an edge of the primary display, applying a visual effect to the second portion of the virtual object while forgoing applying the visual effect to the first portion of the virtual object that is displayed via the secondary display. ### Claim 17 (depends on 16) The non-transitory computer-readable storage medium of claim 16, wherein: the first portion of the virtual object has a first visual appearance; and after applying the visual effect to the second portion of the virtual object, the second portion of the virtual object has a second visual appearance that is the same as the first visual appearance. ### Claim 18 (depends on 16) The non-transitory computer-readable storage medium of claim 16, wherein the one or more programs further include instructions for: concurrently displaying, via the primary display, a third portion of the virtual object that does not have the visual effect applied, wherein the third portion of the virtual object does not have the visual effect applied and is less blurry than the second portion of the virtual object. ### Claim 19 (depends on 16) The non-transitory computer-readable storage medium of claim 16, wherein applying the visual effect to the second portion of the virtual object includes: blurring the second portion of the virtual object. ### Claim 20 (depends on 19) The non-transitory computer-readable storage medium of claim 19, wherein, after the blurring the second portion of the virtual object, the second portion of the virtual object includes an amount of blur that is based on an amount of blur of the first portion of the virtual object. ### Claim 21 (depends on 19) The non-transitory computer-readable storage medium of claim 19, wherein blurring the second portion of the virtual object includes changing an amount of blur of the second portion of the virtual object based on a respective distance between the virtual object and the secondary display. ### Claim 22 A method for displaying a virtual object, the method comprising: at a system that is configured to communicate with one or more processors, memory, one or more image sensors, and a head-mounted display (HMD) device, the HMD device including a primary display that extends across a field-of-view and has a first resolution and a secondary display that is physically and electronically coupled to the primary display and has a second resolution that is lower than the first resolution: displaying a first portion of a virtual object via the secondary display; and displaying a second portion of the virtual object via the primary display, wherein displaying the second portion of the virtual object via the primary display includes: in accordance with a determination that the second portion of the virtual object is within a predefined distance from an edge of the primary display, applying a visual effect to the second portion of the virtual object while forgoing applying the visual effect to the first portion of the virtual object that is displayed via the secondary display. ### Claim 23 (depends on 22) The method of claim 22, wherein applying the visual effect to the second portion of the virtual object includes: blurring the second portion of the virtual object. ### Claim 24 (depends on 23) The method of claim 23, wherein, after the blurring the second portion of the virtual object, the second portion of the virtual object includes an amount of blur that is based on an amount of blur of the first portion of the virtual object. ### Claim 25 (depends on 23) The method of claim 23, wherein blurring the second portion of the virtual object includes changing an amount of blur of the second portion of the virtual object based on a respective distance between the virtual object and the secondary display. ### Claim 26 (depends on 1) The HMD device of claim 1, wherein applying the visual effect to the second portion of the virtual object includes: in accordance with a determination that the virtual object has a first characteristic, applying a first amount of the visual effect to the second portion of the virtual object; and in accordance with a determination that the virtual object has a second characteristic different from the first characteristic, applying a second amount of the visual effect, different from the first amount of the visual effect, to the second portion of the virtual object. ### Claim 27 (depends on 26) The HMD device of claim 26, wherein: the first characteristic is a size of the virtual object, a movement of the virtual object, or a color of the virtual object; and the second characteristic is a size of the virtual object, a movement of the virtual object, or a color of the virtual object. ### Claim 28 (depends on 1) The HMD device of claim 1, wherein applying the visual effect to the second portion of the virtual object includes: in accordance with a determination that the virtual object is a first type of virtual object, applying a first visual effect to the second portion of the virtual object; and in accordance with a determination that the virtual object is a second type of virtual object that is different from the first type of virtual object, applying a second visual effect, different from the first visual effect, to the second portion of the virtual object. ### Claim 29 (depends on 1) The HMD device of claim 1, wherein applying the visual effect to the second portion of the virtual object occurs while a pupil is looking in a respective direction and wherein applying the visual effect to the second portion of the virtual object includes: in accordance with a determination that there is a first user characteristic associated with a user wearing the HMD device, applying a first amount of the visual effect; and in accordance with a determination that there is a second user characteristic, different from the first characteristic, associated with the user wearing the HMD device, applying a second amount of the visual effect, different from the first amount of visual effect.