# US 12,008,155 B2 · Reducing startup time of augmented reality experience > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,155 B2 - Document ID: US12008155B2 - Status: Granted - Kind: B2 - Application number: 18/201,419 - Filed: 2023-05-24 - Published: 2023-09-21 - Granted: 2024-06-11 - Earliest claimed: 2021-05-14 - Assignees: Snap Inc. - Applicants: Snap Inc. - Inventors: Jeroen Diederik Hol; Matthias Kalkgruber; Erick Mendez Mendez; Niall Murphy; Gerald Nilles; Mathieu Emmanuel Vignau - Web page: https://patentgrep.com/patent/US12008155B2 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G01C 21/1656: {with passive imaging devices, e.g. cameras} - G02B 27/0172: {characterised by optical features} - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data. ## Claims ### Claim 1 A method comprising: operating a device in a low power mode based on first tracking data from a first set of sensors of the device in response to powering the device; detecting, at the device, an augmented reality application request with the device operating in the low power mode; in response to detecting the augmented reality application request, displaying augmented reality content based on the first tracking data; in response to detecting the augmented reality application request, operating the device in a high power mode based on second tracking data from a second set of sensors of the device; and updating the augmented reality content based on the second tracking data. ### Claim 2 (depends on 1) The method of claim 1, wherein operating the device in the low power mode comprises: activating the first set of sensors without the second set of sensors upon powering the device; and accessing the first tracking data from the first set of sensors. ### Claim 3 (depends on 1) The method of claim 1, wherein operating the device in the high power mode comprises: activating the second set of sensors in response to detecting the augmented reality application request; and accessing the second tracking data from the second set of sensors. ### Claim 4 (depends on 1) The method of claim 1, further comprising: performing a device initialization operation upon powering the device, the device initialization operation being separate from the augmented reality application request; and in response to the device initialization operation, activating the first set of sensors without the second set of sensors. ### Claim 5 (depends on 1) The method of claim 1, further comprising: operating an augmented reality application at the device, wherein the augmented reality application request comprises a request for the augmented reality application to display augmented reality content in a display of the device. ### Claim 6 (depends on 1) The method of claim 1, wherein the first set of sensors comprises inertial measurement unit (IMU) sensors with a first power consumption. ### Claim 7 (depends on 6) The method of claim 6, wherein the second set of sensors comprises image sensors with a second power consumption that is higher than the first power consumption. ### Claim 8 (depends on 7) The method of claim 7, wherein the second tracking data comprises a set of image frames received by the image sensors. ### Claim 9 (depends on 1) The method of claim 1, wherein receiving the first tracking data comprises: receiving the first tracking data from a six-degrees of freedom tracking system, wherein the six-degrees of freedom tracking system determines rotational pose data. ### Claim 10 (depends on 1) The method of claim 1, wherein receiving the second tracking data comprises: receiving the second tracking data from a six-degrees of freedom tracking system, wherein the six-degrees of freedom tracking system determines rotational pose data and translational pose data. ### Claim 11 A device comprising: one or more processors; and a memory storing instructions that, when executed by the one or more processors, configure the device to perform operations comprising: operating a device in a low power mode based on first tracking data from a first set of sensors of the device in response to powering the device; detecting, at the device, an augmented reality application request with the device operating in the low power mode; in response to detecting the augmented reality application request, displaying augmented reality content based on the first tracking data; in response to detecting the augmented reality application request, operating the device in a high power mode based on second tracking data from a second set of sensors of the device; and updating the augmented reality content based on the second tracking data. ### Claim 12 (depends on 11) The device of claim 11, wherein operating the device in the low power mode comprises: activating the first set of sensors without the second set of sensors upon powering the device; and accessing the first tracking data from the first set of sensors. ### Claim 13 (depends on 11) The device of claim 11, wherein operating the device in the high power mode comprises: activating the second set of sensors in response to detecting the augmented reality application request; and accessing the second tracking data from the second set of sensors. ### Claim 14 (depends on 11) The device of claim 11, wherein the operations further comprise: performing a device initialization operation upon powering the device, the device initialization operation being separate from the augmented reality application request; and in response to the device initialization operation, activating the first set of sensors without the second set of sensors. ### Claim 15 (depends on 11) The device of claim 11, wherein the operations further comprise: operating an augmented reality application at the device, wherein the augmented reality application request comprises a request for the augmented reality application to display augmented reality content in a display of the device. ### Claim 16 (depends on 11) The device of claim 11, wherein the first set of sensors comprises inertial measurement unit (IMU) sensors with a first power consumption. ### Claim 17 (depends on 16) The device of claim 16, wherein the second set of sensors comprises image sensors with a second power consumption that is higher than the first power consumption. ### Claim 18 (depends on 17) The device of claim 17, wherein the second tracking data comprises a set of image frames received by the image sensors. ### Claim 19 (depends on 11) The device of claim 11, wherein the first tracking data comprise rotational pose data, wherein the second tracking data comprise rotational pose data and translational pose data. ### Claim 20 A non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising: operating a device in a low power mode based on first tracking data from a first set of sensors of the device in response to powering the device; detecting, at the device, an augmented reality application request with the device operating in the low power mode; in response to detecting the augmented reality application request, displaying augmented reality content based on the first tracking data; in response to detecting the augmented reality application request, operating the device in a high power mode based on second tracking data from a second set of sensors of the device; and updating the augmented reality content based on the second tracking data.