# US 12,118,687 B2 · Virtual location selection for virtual content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,687 B2 - Document ID: US12118687B2 - Status: Granted - Kind: B2 - Application number: 18/523,382 - Filed: 2023-11-29 - Published: 2024-03-21 - Granted: 2024-10-15 - Earliest claimed: 2019-06-24 - Assignees: Magic Leap, Inc. - Applicants: Magic Leap, Inc. - Inventors: Silas Warren; Omar Khan; Samuel A. Miller; Tushar Arora - Web page: https://patentgrep.com/patent/US12118687B2 ## CPC - G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G02B 2027/014: {comprising information/image processing systems} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2219/2004: Aligning objects, relative positioning of parts - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method for placing content in an augmented reality system. A notification is received regarding availability of new content to display in the augmented reality system. A confirmation is received that indicates acceptance of the new content. Three dimensional information that describes the physical environment is provided, to an external computing device, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content. Location information is received, from the external computing device, that indicates the assigned location. A display location on a display system of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment is determined, based on the location information. The new content is displayed on the display system at the display location. ## Claims ### Claim 1 A computer-implemented method, comprising: providing, for display by an augmented reality system, a notification on the augmented reality system indicating that new content is available; in response to receiving a confirmation input from a user, removing, by the augmented reality system, the notification from display on the augmented reality system; providing, by the augmented reality system and to a mobile device of a user of the augmented reality system, information that describes a physical environment surrounding the user; providing, by the augmented reality system, the new content for display on a display of the augmented reality system at a display location based on location information received from a mobile device of the user of the augmented reality system indicating an assigned location within the physical environment that the user has selected for new content to appear to the user to be displayed; receiving, from the mobile device of the user of the augmented reality system, an updated assigned location for the new content to be displayed; and determining, by the augmented reality system and based on the updated assigned location, an updated display location on the display of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an updated overlay at the updated assigned location in the physical environment. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the mobile device of the user with which the user indicates the assigned location is a mobile telephone of the user. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, comprising: generating, by the augmented reality system, a notification based on the augmented reality system receiving data from an external source that is external to the augmented reality system and indicating that the new content is available. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, comprising: receiving, by the augmented reality system and from the mobile device of the user of the augmented reality system, the location information. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, comprising: determining, by the augmented reality system and based on the location information, the display location. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, comprising: identifying candidate locations in the physical environment for display of the new content, wherein information provided to the mobile device identifies the candidate locations. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, wherein the information provided to the mobile device comprises a static representation of the physical environment surrounding the user. ### Claim 8 A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform one or more operations, comprising: providing, for display by an augmented reality system, a notification on the augmented reality system indicating that new content is available; in response to receiving a confirmation input from a user, removing, by the augmented reality system, the notification from display on the augmented reality system; providing, by the augmented reality system and to a mobile device of a user of the augmented reality system, information that describes a physical environment surrounding the user; providing, by the augmented reality system, the new content for display on a display of the augmented reality system at a display location based on location information received from a mobile device of the user of the augmented reality system indicating an assigned location within the physical environment that the user has selected for new content to appear to the user to be displayed; receiving, from the mobile device of the user of the augmented reality system, an updated assigned location for the new content to be displayed; and determining, by the augmented reality system and based on the updated assigned location, an updated display location on the display of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an updated overlay at the updated assigned location in the physical environment. ### Claim 9 (depends on 8) The non-transitory, computer-readable medium of claim 8, wherein the mobile device of the user with which the user indicates the assigned location is a mobile telephone of the user. ### Claim 10 (depends on 8) The non-transitory, computer-readable medium of claim 8, comprising: generating, by the augmented reality system, a notification based on the augmented reality system receiving data from an external source that is external to the augmented reality system and indicating that the new content is available. ### Claim 11 (depends on 8) The non-transitory, computer-readable medium of claim 8, comprising: receiving, by the augmented reality system and from the mobile device of the user of the augmented reality system, the location information. ### Claim 12 (depends on 8) The non-transitory, computer-readable medium of claim 8, comprising: determining, by the augmented reality system and based on the location information, the display location. ### Claim 13 (depends on 8) The non-transitory, computer-readable medium of claim 8, comprising: identifying candidate locations in the physical environment for display of the new content, wherein information provided to the mobile device identifies the candidate locations. ### Claim 14 (depends on 8) The non-transitory, computer-readable medium of claim 8, wherein the information provided to the mobile device comprises a static representation of the physical environment surrounding the user. ### Claim 15 A computer-implemented system, comprising: one or more computers; and one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations, comprising: providing, for display by an augmented reality system, a notification on the augmented reality system indicating that new content is available; in response to receiving a confirmation input from a user, removing, by the augmented reality system, the notification from display on the augmented reality system; providing, by the augmented reality system and to a mobile device of a user of the augmented reality system, information that describes a physical environment surrounding the user; providing, by the augmented reality system, the new content for display on a display of the augmented reality system at a display location based on location information received from a mobile device of the user of the augmented reality system indicating an assigned location within the physical environment that the user has selected for new content to appear to the user to be displayed; receiving, from the mobile device of the user of the augmented reality system, an updated assigned location for the new content to be displayed; and determining, by the augmented reality system and based on the updated assigned location, an updated display location on the display of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an updated overlay at the updated assigned location in the physical environment. ### Claim 16 (depends on 15) The computer-implemented system of claim 15, wherein the mobile device of the user with which the user indicates the assigned location is a mobile telephone of the user. ### Claim 17 (depends on 15) The computer-implemented system of claim 15, comprising: generating, by the augmented reality system, a notification based on the augmented reality system receiving data from an external source that is external to the augmented reality system and indicating that the new content is available. ### Claim 18 (depends on 15) The computer-implemented system of claim 15, comprising: receiving, by the augmented reality system and from the mobile device of the user of the augmented reality system, the location information. ### Claim 19 (depends on 15) The computer-implemented system of claim 15, comprising: determining, by the augmented reality system and based on the location information, the display location. ### Claim 20 (depends on 15) The computer-implemented system of claim 15, comprising: identifying candidate locations in the physical environment for display of the new content, wherein information provided to the mobile device identifies the candidate locations.