# US 10,771,512 B2 · Viewing a virtual reality environment on a user device by joining the user device to an augmented reality session > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,771,512 B2 - Document ID: US10771512B2 - Status: Granted - Kind: B2 - Application number: 16/175,765 - Filed: 2018-10-30 - Published: 2019-11-21 - Granted: 2020-09-08 - Earliest claimed: 2018-05-18 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Daniel Escudero; Toby Gilbert; Jose Antonio Santano Gonzalez - Web page: https://patentgrep.com/patent/US10771512B2 ## CPC - H04L 65/1076: Screening of IP real time communications, e.g. spam over Internet telephony [SPIT] - H04L 65/1093: by adding participants; by removing participants - G02B 27/017: {Head mounted} - G02B 27/0172: {characterised by optical features} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06K 7/10722: {Photodetector array or CCD scanning} - G06K 7/1417: {2D bar codes} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04L 65/1059: End-user terminal functionalities specially adapted for real-time communication - H04L 65/1069: Session establishment or de-establishment - H04L 65/1094: Inter-user-equipment sessions transfer or sharing - H04L 67/04: specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability - H04L 67/131: Protocols for games, networked simulations or virtual reality - H04L 67/146: Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding - H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)} - H04W 12/068: {using credential vaults, e.g. password manager applications or one time password [OTP] applications} - H04W 12/33: using wearable devices, e.g. using a smartwatch or smart-glasses - H04W 12/50: Secure pairing of devices - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0174: {holographic} - G06T 2219/024: Multi-user, collaborative environment - H04L 63/0838: {using one-time-passwords} - H04W 12/77: Graphical identity - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract A system for augmented reality viewing generates a unique code corresponding to a user device. Information corresponding to the unique code is broadcast from the user device and the unique code is displayed on the user device. The information is configured to be received by an augmented reality device. A camera of an augmented reality device is activated upon receiving the information broadcast from the user device. The camera is configured to scan for the unique code. The user device is joined to an augmented reality session of the augmented reality device in response to the camera scanning the unique code displayed on the user device and by transmitting identification information to the user device based on the unique code. The simplified joining process improves the user experience and allows the user to more quickly view an augmented reality environment directly on a user device. ## Claims ### Claim 1 A system for augmented reality viewing, the system comprising: a memory associated with a computing device, the memory including an augmented reality session component; and a processor that executes the augmented reality session component to: generate a unique code corresponding to a user device; broadcast information corresponding to the unique code from the user device, the information configured to be received by an augmented reality device; display the unique code on the user device; and join the user device to an augmented reality session of the augmented reality device using received identification information from the augmented reality device and based at least in part on the unique code displayed on the user device being scanned by the augmented reality device. ### Claim 2 (depends on 1) The system of claim 1, wherein the processor further executes the augmented reality session component to spatially align a hologram being displayed in the augmented reality session to a view of the user device. ### Claim 3 (depends on 1) The system of claim 1, wherein the augmented reality device comprises a camera and the processor further executes the augmented reality session component to activate the camera of the augmented reality device upon receiving the information broadcast from the user device, the camera configured to scan for the unique code. ### Claim 4 (depends on 3) The system of claim 3, wherein an initiation of a session joining application on the user device triggers the activation of the camera of the augmented reality device based at least in part on a broadcasting of a request to identify bundle identification (ID) sessions on a same wireless network as the user device. ### Claim 5 (depends on 3) The system of claim 3, wherein the augmented reality device transmits identification information to the user device based on the unique code to confirm a match with the displayed unique code. ### Claim 6 (depends on 1) The system of claim 1, wherein the augmented reality device comprises a HoloLens® device, the user device comprises one of a mobile phone or a tablet device, and the unique code comprises an augmented reality marker, the mobile phone or the tablet device is configured to generate and display the augmented reality marker and the HoloLens® device is configured to scan for the augmented reality marker and match the augmented reality marker to the user device based at least in part on the information broadcast from the user device. ### Claim 7 (depends on 1) The system of claim 1, wherein the processor further executes the augmented reality session component to receive spatial information from the augmented reality device and display an augmented reality session having at least one hologram being viewing by the augmented reality device with the hologram aligned spatially within the augmented reality space as viewed by the augmented reality device. ### Claim 8 (depends on 1) The system of claim 1, wherein the processor further executes the augmented reality session component to change an augmented reality space of the augmented reality session based on a control command received from the user device. ### Claim 9 A computerized method for viewing an augmented reality environment, the computerized method comprising: generating a unique code at a user device and displaying the unique code on the user device; broadcasting information formatted for reception by an augmented reality device, the broadcast information based at least in part on the unique code; and automatically joining the user device to an augmented reality session of the augmented reality device in response to the augmented reality device scanning the unique code displayed on the user device, at least one hologram in the augmented reality session being spatially aligned to a view of the user device. ### Claim 10 (depends on 9) The computerized method of claim 9, further comprising automatically activating a camera of the augmented reality device upon receiving the information broadcast from the user device, the camera configured to scan for the unique code. ### Claim 11 (depends on 10) The computerized method of claim 10, and further comprising, in response to an initiation of a session joining application on the user device, automatically triggering the activation of the camera of the augmented reality device based at least in part on a broadcasting of a request, from the user device, to identify bundle identification (ID) sessions on a same wireless network as the user device. ### Claim 12 (depends on 9) The computerized method of claim 9, wherein the augmented reality device comprises a HoloLens® device, the user device comprises one of a mobile phone or a tablet device, and the unique code comprises an augmented reality marker, the mobile phone or the tablet device is configured to generate and display the augmented reality marker and the HoloLens® device is configured to scan for the augmented reality marker and further comprising matching the augmented reality marker to the user device based at least in part on the information broadcast from the user device. ### Claim 13 (depends on 9) The computerized method of claim 9, receiving, at the user device, spatial information from the augmented reality device and displaying the augmented reality session having at least one hologram being viewing by the augmented reality device with the hologram aligned spatially within the augmented reality space as viewed by the augmented reality device. ### Claim 14 (depends on 9) The computerized method of claim 9, further comprising, after joining the user device to the augmented reality session, receiving one or more control commands from the user device that changes the augmented reality space. ### Claim 15 (depends on 9) The computerized method of claim 9, further comprising recording the augmented reality session at the user device. ### Claim 16 One or more computer storage media having computer-executable instructions for viewing an augmented reality environment that, upon execution by a processor, cause the processor to at least: generate a unique code corresponding to a user device; broadcast information corresponding to the unique code from the user device, the information configured to be received by an augmented reality device; display the unique code on the user device; and join the user device to an augmented reality session of the augmented reality device using received identification information from the augmented reality device and based at least in part on the unique code displayed on the user device being scanned by the augmented reality device. ### Claim 17 (depends on 16) The one or more computer storage media of claim 16 having further computer-executable instructions that, upon execution by a processor, cause the processor to at least spatially align a hologram being displayed in the augmented reality session to a view of the user device. ### Claim 18 (depends on 16) The one or more computer storage media of claim 16, wherein the augmented reality device comprises a camera and having further computer-executable instructions that, upon execution by a processor, cause the processor to at least activate the camera of the augmented reality device upon receiving the information broadcast from the user device, the camera configured to scan for the unique code. ### Claim 19 (depends on 16) The one or more computer storage media of claim 16, wherein an initiation of a session joining application on the user device triggers the activation of the camera of the augmented reality device based at least in part on a broadcasting of a request to identify bundle identification (ID) sessions on a same wireless network as the user device. ### Claim 20 (depends on 16) The one or more computer storage media of claim 16 having further computer-executable instructions that, upon execution by a processor, cause the processor to at least receive spatial information from the augmented reality device and display an augmented reality session having at least one hologram being viewing by the augmented reality device with the hologram aligned spatially within the augmented reality space as viewed by the augmented reality device, and change an augmented reality space of the augmented reality session based on a control command received from the user device.