# US 10,504,287 B2 · Redundant tracking system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,287 B2 - Document ID: US10504287B2 - Status: Granted - Kind: B2 - Application number: 15/792,347 - Filed: 2017-10-24 - Published: 2018-04-26 - Granted: 2019-12-10 - Earliest claimed: 2016-10-24 - Assignees: Snap Inc. - Applicants: Snap Inc. - Inventors: Andrew James McPhee; Samuel Edward Hare; Peicheng Yu; Robert Cornelius Murphy; Dhritiman Sagar - Web page: https://patentgrep.com/patent/US10504287B2 ## CPC - G06T 19/003: {Navigation within 3D models or images} - A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry - G06F 11/08: Error detection or correction by redundancy in data representation, e.g. by using checking codes - G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments - G06T 15/20: Perspective computation - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer - G06F 2203/0382: Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience. ## Claims ### Claim 1 A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising a redundant tracking system, the redundant tracking system comprising a set of tracking systems that include at least a simultaneous localization and mapping tracking system, and a natural feature tracking system, and one or more processors that cause the system to perform operations comprising: rendering an object at a position in a three-dimensional space; tracking the object at the position in the three-dimensional space via a first tracking system among the set of tracking systems, the first tracking system tracking the object based on a set of indicia; detecting an interruption of at least an indicia from among the set of indicia tracked by the first tracking system; and tracking the object at the position in the three-dimensional space via a second tracking system among the set of tracking systems, in response to detecting the interruption of the indicia from among the set of indicia. ### Claim 2 (depends on 1) The system of claim 1, wherein the set of indicia comprises at least six indicia. ### Claim 3 (depends on 1) The system of claim 1, wherein the first tracking system is a natural feature tracking system. ### Claim 4 (depends on 1) The system of claim 1, wherein the second tracking system is a gyroscopic tracking system. ### Claim 5 (depends on 1) The system of claim 1, wherein the first tracking system tracks pitch, yaw, roll, and translations based on the set of indicia. ### Claim 6 (depends on 1) The system of claim 1, wherein the redundant tracking system causes the system to perform operations further comprising: maintaining a set of templates to generate objects to be displayed in the three-dimensional space; receiving a selection of a template from among the set of templates; receiving a selection of the position in the three-dimensional space; generating the object based on the selected template; and assigning the object to the position in the three-dimensional space. ### Claim 7 A method for tracking an object by a redundant tracking system, the redundant tracking system comprising a set of tracking systems that include at least a simultaneous localization and mapping tracking system, and a natural feature tracking system, and the method comprising: rendering the object at a position in a three-dimensional space; tracking the object at the position in the three-dimensional space via a first tracking system among the set of tracking systems, the first tracking system tracking the object based on a set of indicia; detecting an interruption of at least an indicia from among the set of indicia tracked by the first tracking system; and tracking the object at the position in the three-dimensional space via a second tracking system among the set of tracking systems, in response to detecting the interruption of the indicia from among the set of indicia. ### Claim 8 (depends on 7) The method of claim 7, wherein the set of indicia comprises at least six indicia. ### Claim 9 (depends on 7) The method of claim 7, wherein the first tracking system is a natural feature tracking system. ### Claim 10 (depends on 7) The method of claim 7, wherein the second tracking system is a gyroscopic tracking system. ### Claim 11 (depends on 7) The method of claim 7, wherein the first tracking system tracks pitch, yaw, roll, and translations based on the set of indicia. ### Claim 12 (depends on 7) The method of claim 7, further comprising: maintaining a set of templates to generate objects to be displayed in the three-dimensional space; receiving a selection of a template from among the set of templates; receiving a selection of the position in the three-dimensional space; generating the object based on the selected template; and assigning the object to the position in the three-dimensional space. ### Claim 13 A non-transitory machine-readable storage medium including a redundant tracking system, the redundant tracking system comprising a set of tracking systems that include at least a simultaneous localization and mapping system, and a natural feature tracking system, and comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising: rendering an object at a position in a three-dimensional space; tracking the object at the position in the three-dimensional space via a first tracking system among the set of tracking systems, the first tracking system tracking the object based on a set of indicia; detecting an interruption of at least an indicia from among the set of indicia tracked by the first tracking system; and tracking the object at the position in the three-dimensional space via a second tracking system among the set of tracking systems, in response to detecting the interruption of the indicia from among the set of indicia. ### Claim 14 (depends on 13) The non-transitory machine-readable storage medium of claim 13, wherein the set of indicia comprises at least six indicia. ### Claim 15 (depends on 13) The non-transitory machine-readable storage medium of claim 13, wherein the first tracking system is a natural feature tracking system. ### Claim 16 (depends on 13) The non-transitory machine-readable storage medium of claim 13, wherein the second tracking system is a gyroscopic tracking system. ### Claim 17 (depends on 13) The non-transitory machine-readable storage medium of claim 13, wherein the first tracking system tracks pitch, yaw, roll, and translations based on the set of indicia.